Jul 05 13:15:21.447968 ip-10-0-134-75 systemd[1]: Starting Kubernetes Kubelet...
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.821506    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825752    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825764    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825768    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825771    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825774    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825776    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825779    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:21.938137 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825782    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:21.894933 ip-10-0-134-75 systemd[1]: Started Kubernetes Kubelet.
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825790    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825794    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825796    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825799    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825802    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825804    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825807    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825810    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825812    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825816    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825819    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825821    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825824    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825827    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825829    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825832    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825835    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825837    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825841    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:21.939548 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825844    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825847    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825850    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825852    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825855    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825859    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825863    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825866    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825870    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825873    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825876    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825879    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825882    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825886    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825889    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825892    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825895    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825897    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825900    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825903    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:21.940946 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825905    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825908    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825910    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825913    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825915    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825918    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825920    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825924    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825927    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825930    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825933    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825936    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825938    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825941    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825944    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825946    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825949    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825951    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825955    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:21.941989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825958    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825961    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825964    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825968    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825970    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825973    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825976    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825980    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825982    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825985    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825988    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825990    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825993    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825995    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.825998    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826001    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826003    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826006    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826008    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826011    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:21.943709 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826014    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826016    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826019    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826021    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826024    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826027    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826030    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826033    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826035    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826038    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826041    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826043    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826046    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826750    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826756    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826759    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826762    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826765    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826768    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826771    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:21.944978 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826774    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826777    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826780    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826783    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826785    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826788    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826791    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826794    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826797    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826799    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826802    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826805    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826807    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826811    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826813    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826816    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826818    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826821    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826824    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:21.946272 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826826    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826829    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826831    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826835    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826838    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826841    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826843    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826846    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826848    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826851    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826854    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826856    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826859    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826861    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826864    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826867    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826869    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826872    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826874    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826876    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:21.947151 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826879    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826881    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826884    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826886    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826889    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826891    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826893    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826895    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826898    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826901    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826903    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826905    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826908    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826910    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826913    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826915    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826917    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826920    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826922    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826925    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:21.948038 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826927    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826930    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826932    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826935    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826937    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826940    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826943    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826946    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826949    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826951    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826954    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826956    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826959    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826961    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826964    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826966    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826969    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826971    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826973    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826976    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:21.949139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826978    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826980    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826986    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826990    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826993    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826996    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.826998    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827002    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827006    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827008    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827011    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827016    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827019    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827375    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827379    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827382    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827385    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827388    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:21.951259 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827390    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827394    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827397    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827399    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827403    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827406    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827409    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827411    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827414    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827416    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827419    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827421    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827424    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827426    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827429    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827431    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827434    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827436    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827439    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:21.952327 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827441    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827444    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827446    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827449    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827451    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827454    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827458    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827461    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827463    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827466    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827468    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827471    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827473    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827475    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827478    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827481    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827486    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827489    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827492    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827495    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:21.953645 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827497    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827500    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827502    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827505    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827507    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827510    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827512    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827514    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827517    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827519    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827521    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827524    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827526    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827529    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827531    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827534    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827536    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827539    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827543    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827546    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:21.954510 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827548    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827552    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827555    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827558    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827561    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827564    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827567    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827570    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827573    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827577    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827579    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827582    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827585    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827587    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827590    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827592    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827594    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827597    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:21.962302 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827599    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827602    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827604    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827606    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827609    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827611    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827614    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827616    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827619    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827621    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827624    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827626    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827630    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827632    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827635    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827638    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.827640    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827729    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827739    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827746    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827752    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 05 13:15:21.963056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827759    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827762    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827767    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827774    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827778    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827781    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827785    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827788    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827791    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827794    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827801    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827804    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827808    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827810    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827814    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827817    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827821    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827824    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827827    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827830    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827833    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827836    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827840    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827844    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 05 13:15:21.963733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827847    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827850    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827853    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827856    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827860    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827863    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827866    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827869    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827872    2565 flags.go:64] FLAG: --enable-server="true"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827874    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827878    2565 flags.go:64] FLAG: --event-burst="100"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827883    2565 flags.go:64] FLAG: --event-qps="50"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827886    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827889    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827892    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827896    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827898    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827901    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827904    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827907    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827910    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827912    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827915    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827918    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827920    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 05 13:15:21.964557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827923    2565 flags.go:64] FLAG: --feature-gates=""
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827927    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827930    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827933    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827936    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827939    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827944    2565 flags.go:64] FLAG: --help="false"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827947    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827950    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827953    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827969    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827973    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827977    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827980    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827983    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827986    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827989    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827992    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.827996    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828000    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828003    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828006    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828009    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828011    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 05 13:15:22.144363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828014    2565 flags.go:64] FLAG: --lock-file=""
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828017    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828020    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828023    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828028    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828031    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828034    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828037    2565 flags.go:64] FLAG: --logging-format="text"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828040    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828043    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828046    2565 flags.go:64] FLAG: --manifest-url=""
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828048    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828052    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828055    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828060    2565 flags.go:64] FLAG: --max-pods="110"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828063    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828066    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828069    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828072    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828074    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828077    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828080    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828089    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828092    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828095    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 05 13:15:22.160077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828098    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828102    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828107    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828111    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828114    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828117    2565 flags.go:64] FLAG: --port="10250"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828120    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828123    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07814c235721cd463"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828126    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828129    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828132    2565 flags.go:64] FLAG: --register-node="true"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828134    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828138    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828141    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828144    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828147    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828150    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828153    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828157    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828159    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828162    2565 flags.go:64] FLAG: --runonce="false"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828165    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828169    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828172    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828175    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 05 13:15:22.162229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828178    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828181    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828184    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828187    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828190    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828193    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828196    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828198    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828203    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828206    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828208    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828214    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828217    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828219    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828223    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828226    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828229    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828232    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828234    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828237    2565 flags.go:64] FLAG: --v="2"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828241    2565 flags.go:64] FLAG: --version="false"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828244    2565 flags.go:64] FLAG: --vmodule=""
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828248    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.828251    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828377    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:22.163537 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828381    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828386    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828389    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828392    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828397    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828400    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828403    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828405    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828408    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828411    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828413    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828416    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828418    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828421    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828423    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828431    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828434    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828436    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828439    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:22.167680 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828442    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828444    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828447    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828450    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828452    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828455    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828457    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828460    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828462    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828465    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828467    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828469    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828472    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828475    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828477    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828480    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828482    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828486    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828489    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:22.168616 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828491    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828494    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828497    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828499    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828502    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828504    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828507    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828510    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828512    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828516    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828518    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828521    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828523    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828526    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828529    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828532    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828534    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828537    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828539    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:22.171570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828542    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828544    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828547    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828549    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828552    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828556    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828559    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828562    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828566    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828569    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828572    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828576    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828579    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828582    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828584    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828587    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828590    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828593    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828596    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:22.172483 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828598    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828601    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828603    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828607    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828610    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828612    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828615    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828618    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828620    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828623    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828626    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828628    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828631    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828633    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828636    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828638    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828641    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828643    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828646    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828648    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828651    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:22.176612 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.828653    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.829237    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.837942    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.837958    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.837975    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.837981    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838042    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838047    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838051    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838054    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838057    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838060    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838063    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838066    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838069    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:22.177944 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838072    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838075    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838077    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838080    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838083    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838086    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838089    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838092    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838096    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838099    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838103    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838107    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838110    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838113    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838117    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838119    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838122    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838125    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838127    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:22.182035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838130    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838132    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838135    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838138    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838140    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838143    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838148    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838150    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838153    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838156    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838159    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838162    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838164    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838167    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838169    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838172    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838175    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838177    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838180    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838183    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:22.182951 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838185    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838188    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838190    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838193    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838196    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838198    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838201    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838203    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838206    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838209    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838211    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838214    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838216    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838219    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838221    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838224    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838226    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838229    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838233    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838236    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:22.186640 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838238    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838241    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838245    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838247    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838250    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838252    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838254    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838257    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838259    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838262    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838265    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838277    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838280    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838282    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838285    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838287    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838289    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838292    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838295    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838297    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:22.187566 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838300    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838302    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838305    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838307    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838311    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838315    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838317    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838320    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838323    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838325    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838329    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.838335    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838453    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838458    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:22.190484 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838461    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838465    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838468    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838471    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838474    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838477    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838480    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838482    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838485    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838487    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838491    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838494    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838496    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838499    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838501    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838504    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838506    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838509    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838511    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838514    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:22.191394 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838516    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838519    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838522    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838524    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838526    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838529    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838532    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838534    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838538    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838541    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838544    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838546    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838549    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838553    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838555    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838558    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838560    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838563    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838566    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838568    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:22.195536 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838571    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838573    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838575    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838579    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838581    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838584    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838586    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838589    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838591    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838594    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838596    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838599    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838601    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838604    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838606    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838609    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838611    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838614    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838616    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838618    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:22.196440 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838622    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838625    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838627    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838630    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838632    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838636    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838639    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838641    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838644    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838646    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838649    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838651    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838654    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838657    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838661    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838680    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838685    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838688    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838691    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:22.287310 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838693    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838697    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838701    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838704    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838707    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838710    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838713    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838717    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838720    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838723    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838725    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838728    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838731    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838735    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838737    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838740    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838742    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:22.289024 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:21.838745    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.838751    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.838854    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.842241    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.843456    2565 server.go:1019] "Starting client certificate rotation"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.843551    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.843586    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.845779    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.850042    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.861233    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.863495    2565 log.go:25] "Validated CRI v1 image API"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.864737    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 05 13:15:22.292348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.870427    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 13:15:22.293233 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.870423    2565 fs.go:135] Filesystem UUIDs: map[32af7ec0-95eb-47f4-8834-8f3c27e7b52a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 95348543-05a2-459c-bdeb-3a26b53ca36b:/dev/nvme0n1p3]
Jul 05 13:15:22.293233 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.870456    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.875570    2565 manager.go:216] Machine: {Timestamp:2026-07-05 13:15:21.874585315 +0000 UTC m=+0.311607031 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117140 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dac1d26f933df52f91442f67679b4 SystemUUID:ec2dac1d-26f9-33df-52f9-1442f67679b4 BootID:f57d630f-860f-4bd7-b8ed-740989580ab6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:e9:0d:44:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:e9:0d:44:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:fa:13:22:c5:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.875681    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.875754    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.876724    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.876751    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-75.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.878165    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.878175    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.878183    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.878767    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.880128    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883162    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883269    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883300    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883312    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883325    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883334    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883343    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 05 13:15:22.296116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883632    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.883646    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.886073    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.887849    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.887876    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888884    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888900    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888906    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888911    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888921    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888927    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888935    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888940    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888945    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888952    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888960    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.888966    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.889657    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.889681    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.890216    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxwwq"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.892268    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-75.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.892333    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.892334    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.893153    2565 server.go:1268] "Started kubelet"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.893404    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.893428    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.893488    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.894967    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.895681    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.898900    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxwwq"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.899717    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.901371    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-75.ec2.internal.18bf67160e8da34f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-75.ec2.internal,UID:ip-10-0-134-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-75.ec2.internal,},FirstTimestamp:2026-07-05 13:15:21.893110607 +0000 UTC m=+0.330132323,LastTimestamp:2026-07-05 13:15:21.893110607 +0000 UTC m=+0.330132323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-75.ec2.internal,}"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.904199    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.904212    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.904595    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.904869    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.904925    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.904941    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905018    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905029    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 05 13:15:22.300261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905341    2565 factory.go:55] Registering systemd factory
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905372    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905606    2565 factory.go:153] Registering CRI-O factory
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905621    2565 factory.go:223] Registration of the crio container factory successfully
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905693    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905715    2565 factory.go:103] Registering Raw factory
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.905729    2565 manager.go:1196] Started watching for new ooms in manager
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.906140    2565 manager.go:349] Starting recovery of all containers
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.907271    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.917129    2565 manager.go:354] Recovery completed
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.921444    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.923207    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-75.ec2.internal\" not found" node="ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.923335    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.923365    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.923379    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.923950    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.923955    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.923964    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.923978    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.924841    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.924869    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.924882    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.925320    2565 policy_none.go:49] "None policy: Start"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.925338    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.925353    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.926510    2565 policy_none.go:47] "Start"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.975205    2565 manager.go:337] "Starting Device Plugin manager"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.975269    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.975285    2565 server.go:87] "Starting device plugin registration server"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.975528    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.975540    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.975635    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.975741    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:21.975752    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.976187    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:21.976240    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.075895    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.077066    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.077094    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.077108    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.077138    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.082410    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.082430    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-75.ec2.internal\": node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.104652    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.106006    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.106036    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.106062    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.106094    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.106448    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.302096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.107966    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.206157    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"]
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.206233    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.206695    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.208084    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.208117    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.208131    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.209438    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.209548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.209582    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.210142    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.210167    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.210180    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.210233    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.210250    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.210260    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.211527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.211553    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.212802    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.212826    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.212837    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.306605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e248d9ed01089d1ca33c4184b25849f2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-75.ec2.internal\" (UID: \"e248d9ed01089d1ca33c4184b25849f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.306635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e820eb0691173ad92dd1c08f2a054507-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal\" (UID: \"e820eb0691173ad92dd1c08f2a054507\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.306682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e820eb0691173ad92dd1c08f2a054507-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal\" (UID: \"e820eb0691173ad92dd1c08f2a054507\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.308390 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.307609    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.411889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.407468    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e248d9ed01089d1ca33c4184b25849f2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-75.ec2.internal\" (UID: \"e248d9ed01089d1ca33c4184b25849f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.411889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.407410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e248d9ed01089d1ca33c4184b25849f2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-75.ec2.internal\" (UID: \"e248d9ed01089d1ca33c4184b25849f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.411889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.407531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e820eb0691173ad92dd1c08f2a054507-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal\" (UID: \"e820eb0691173ad92dd1c08f2a054507\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.411889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.407551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e820eb0691173ad92dd1c08f2a054507-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal\" (UID: \"e820eb0691173ad92dd1c08f2a054507\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.411889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.407620    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e820eb0691173ad92dd1c08f2a054507-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal\" (UID: \"e820eb0691173ad92dd1c08f2a054507\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.411889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.407656    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e820eb0691173ad92dd1c08f2a054507-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal\" (UID: \"e820eb0691173ad92dd1c08f2a054507\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.411889 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.407667    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.518526 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.508043    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.599597 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.599570    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-75.ec2.internal\" not found" node="ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.602508 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.602488    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.604115 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.604097    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-75.ec2.internal\" not found" node="ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.608892 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.608874    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.609143 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.609130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.709288 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.709202    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-75.ec2.internal\" not found"
Jul 05 13:15:22.709509 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.709492    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:22.805571 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.805538    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.817130 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.817109    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 13:15:22.819059 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.819045    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal"
Jul 05 13:15:22.829487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.829471    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 13:15:22.843653 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.843633    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 05 13:15:22.843820 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.843798    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 13:15:22.843871 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.843820    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 13:15:22.843871 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.843836    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 13:15:22.886017 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.885993    2565 apiserver.go:52] "Watching apiserver"
Jul 05 13:15:22.904304 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.904275    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 05 13:15:22.904409 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.904305    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 13:10:22 +0000 UTC" deadline="2028-01-29 23:26:13.46315385 +0000 UTC"
Jul 05 13:15:22.904409 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.904334    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13762h10m50.558824691s"
Jul 05 13:15:22.908551 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.908257    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 05 13:15:22.910272 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.910243    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-m99wq","openshift-image-registry/node-ca-k88r5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal","openshift-network-operator/iptables-alerter-z4zfp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2","openshift-cluster-node-tuning-operator/tuned-8gxj4","openshift-multus/multus-additional-cni-plugins-zclhg","openshift-multus/multus-zcfg5","openshift-multus/network-metrics-daemon-m8wgm","openshift-network-diagnostics/network-check-target-jrd7x","openshift-ovn-kubernetes/ovnkube-node-nj8l7","kube-system/global-pull-secret-syncer-gt6kj","kube-system/konnectivity-agent-lq2gn","kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal"]
Jul 05 13:15:22.911823 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.911799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:22.911928 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.911871    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:22.912875 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.912858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:22.914015 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.913993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:22.915154 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.915131    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:22.915336 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.915312    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.915441 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.915347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 05 13:15:22.915441 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.915353    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.915653 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.915637    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9dsn\""
Jul 05 13:15:22.916032 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.916016    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.916380 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.916334    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 05 13:15:22.916497 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.916378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:22.916497 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.916401    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.916497 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.916459    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 05 13:15:22.916737 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.916721    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6xzc8\""
Jul 05 13:15:22.917544 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.917526    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.917759 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.917733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:22.917816 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.917767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 05 13:15:22.918086 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.918070    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2h8nt\""
Jul 05 13:15:22.918152 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.918136    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 13:15:22.918211 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.918173    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.919032 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.919018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:22.919091 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.919073    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:22.920252 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.920229    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.920327 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.920252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:22.920327 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.920280    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.920711 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.920690    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.920772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.920759    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.920875 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.920851    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gz97x\""
Jul 05 13:15:22.920983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.920939    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pnqq4\""
Jul 05 13:15:22.921578 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.921559    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:22.922973 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.922956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:22.923607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.923593    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 05 13:15:22.923882 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.923866    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 05 13:15:22.924139 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.924098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 05 13:15:22.924273 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.924143    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.924273 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.924219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4pwzs\""
Jul 05 13:15:22.924273 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.924242    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qxvhb\""
Jul 05 13:15:22.924415 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.924400    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:22.925250 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.925234    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.925393 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.925379    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qcbg2\""
Jul 05 13:15:22.925465 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.925449    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 05 13:15:22.925538 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.925523    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 05 13:15:22.927026 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.927007    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 05 13:15:22.927230 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.927214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:22.927230 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.927223    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 05 13:15:22.927338 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.927263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2jx2x\""
Jul 05 13:15:22.927338 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:22.927270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:22.927338 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.927314    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 05 13:15:22.927779 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.927764    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 05 13:15:22.927929 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.927915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.928054 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.928038    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.943861 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.943837    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bntpm"
Jul 05 13:15:22.952929 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:22.952910    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bntpm"
Jul 05 13:15:23.006038 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.006018    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 05 13:15:23.010377 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-log-socket\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.010488 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-kubelet-config\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.010488 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cni-binary-copy\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.010488 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1863775-a053-442d-96ec-7c30f9e1c8f5-tmp-dir\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.010488 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-registration-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-device-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-systemd-units\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-host\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-netns\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-daemon-config\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-systemd\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-etc-kubernetes\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-slash\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovn-node-metrics-cert\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.010772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c956574-b319-45c6-a6b4-8df662003658-iptables-alerter-script\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c956574-b319-45c6-a6b4-8df662003658-host-slash\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-modprobe-d\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-var-lib-kubelet\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-tuned\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-os-release\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-socket-dir-parent\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-cni-bin\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.010997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f9723c3-246b-41a8-bc29-6daccde48fa5-konnectivity-ca\") pod \"konnectivity-agent-lq2gn\" (UID: \"0f9723c3-246b-41a8-bc29-6daccde48fa5\") " pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-lib-modules\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f9723c3-246b-41a8-bc29-6daccde48fa5-agent-certs\") pod \"konnectivity-agent-lq2gn\" (UID: \"0f9723c3-246b-41a8-bc29-6daccde48fa5\") " pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-sys-fs\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhjhg\" (UniqueName: \"kubernetes.io/projected/8289e10e-1278-4eb1-b100-ea582961d22f-kube-api-access-nhjhg\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.011247 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-cni-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-os-release\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-dbus\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysctl-conf\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20acce01-cd07-44b0-9c66-6a4477df36c7-tmp\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-hostroot\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysconfig\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-kubernetes\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1863775-a053-442d-96ec-7c30f9e1c8f5-hosts-file\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-socket-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-kubelet\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-cni-netd\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.011801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-system-cni-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5bc2cdb-7da6-475a-a976-312ae291d9eb-cni-binary-copy\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-conf-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-run-netns\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-etc-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-ovn\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-host\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-sys\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.011996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-env-overrides\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovnkube-script-lib\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-system-cni-dir\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-cnibin\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.012401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-kubelet\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-var-lib-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-cni-multus\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d78md\" (UniqueName: \"kubernetes.io/projected/b5bc2cdb-7da6-475a-a976-312ae291d9eb-kube-api-access-d78md\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-run\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqk58\" (UniqueName: \"kubernetes.io/projected/f5b1e411-1b12-4c47-8bcc-569d58b86fae-kube-api-access-cqk58\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-multus-certs\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cnibin\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-serviceca\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dksnf\" (UniqueName: \"kubernetes.io/projected/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-kube-api-access-dksnf\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysctl-d\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2wj\" (UniqueName: \"kubernetes.io/projected/20acce01-cd07-44b0-9c66-6a4477df36c7-kube-api-access-5v2wj\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xd58\" (UniqueName: \"kubernetes.io/projected/75f30836-9af3-4a95-a1d4-77d36c72d50a-kube-api-access-6xd58\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj978\" (UniqueName: \"kubernetes.io/projected/7c956574-b319-45c6-a6b4-8df662003658-kube-api-access-zj978\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-systemd\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.013140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-etc-selinux\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.013940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-node-log\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.013940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovnkube-config\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.013940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx4r9\" (UniqueName: \"kubernetes.io/projected/d1863775-a053-442d-96ec-7c30f9e1c8f5-kube-api-access-lx4r9\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.013940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kl4p\" (UniqueName: \"kubernetes.io/projected/7cda9f2c-b7c7-421d-93a1-c99170d528c7-kube-api-access-4kl4p\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:23.013940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-k8s-cni-cncf-io\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.013940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.012794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-cni-bin\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.113374 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-daemon-config\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-systemd\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-etc-kubernetes\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-slash\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovn-node-metrics-cert\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113468    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-systemd\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c956574-b319-45c6-a6b4-8df662003658-iptables-alerter-script\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113536    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-etc-kubernetes\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113536    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-slash\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.113607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c956574-b319-45c6-a6b4-8df662003658-host-slash\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-modprobe-d\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-var-lib-kubelet\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113854    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-modprobe-d\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-tuned\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-os-release\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113930    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-var-lib-kubelet\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-socket-dir-parent\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-cni-bin\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.113997    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c956574-b319-45c6-a6b4-8df662003658-host-slash\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f9723c3-246b-41a8-bc29-6daccde48fa5-konnectivity-ca\") pod \"konnectivity-agent-lq2gn\" (UID: \"0f9723c3-246b-41a8-bc29-6daccde48fa5\") " pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-lib-modules\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f9723c3-246b-41a8-bc29-6daccde48fa5-agent-certs\") pod \"konnectivity-agent-lq2gn\" (UID: \"0f9723c3-246b-41a8-bc29-6daccde48fa5\") " pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:23.114102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-daemon-config\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114135    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-socket-dir-parent\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-sys-fs\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114144    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c956574-b319-45c6-a6b4-8df662003658-iptables-alerter-script\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114142    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-sys-fs\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjhg\" (UniqueName: \"kubernetes.io/projected/8289e10e-1278-4eb1-b100-ea582961d22f-kube-api-access-nhjhg\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114218    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-os-release\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114221    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-lib-modules\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114224    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-cni-bin\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-cni-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-os-release\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-dbus\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysctl-conf\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20acce01-cd07-44b0-9c66-6a4477df36c7-tmp\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114398    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114430    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-hostroot\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-cni-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.114785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-hostroot\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114498    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-dbus\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114480    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-os-release\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114571    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysctl-conf\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysconfig\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114294    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114660    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysconfig\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-kubernetes\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1863775-a053-442d-96ec-7c30f9e1c8f5-hosts-file\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-socket-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114802    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-kubernetes\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-kubelet\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.115761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-cni-netd\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114851    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1863775-a053-442d-96ec-7c30f9e1c8f5-hosts-file\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114891    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-kubelet\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-system-cni-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5bc2cdb-7da6-475a-a976-312ae291d9eb-cni-binary-copy\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-conf-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-run-netns\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.114990    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-socket-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-etc-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115042    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-run-netns\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-ovn\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115080    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-multus-conf-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115114    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-cni-netd\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115125    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-etc-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115155    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-ovn\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.114991    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:23.116803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115194    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-run-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115175    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-system-cni-dir\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.115268    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret podName:c1144a9f-42a3-46cc-9c16-0b6bc954cd65 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:23.615227974 +0000 UTC m=+2.052249692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret") pod "global-pull-secret-syncer-gt6kj" (UID: "c1144a9f-42a3-46cc-9c16-0b6bc954cd65") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-host\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-sys\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115551    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5bc2cdb-7da6-475a-a976-312ae291d9eb-cni-binary-copy\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-env-overrides\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115617    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-sys\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovnkube-script-lib\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115664    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-host\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-system-cni-dir\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115685    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f9723c3-246b-41a8-bc29-6daccde48fa5-konnectivity-ca\") pod \"konnectivity-agent-lq2gn\" (UID: \"0f9723c3-246b-41a8-bc29-6daccde48fa5\") " pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-cnibin\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115735    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-cnibin\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.117833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-kubelet\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115779    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-var-lib-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-cni-multus\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.115953    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-var-lib-openvswitch\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.115966    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.116013    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:23.615995652 +0000 UTC m=+2.053017365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116064    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-kubelet\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d78md\" (UniqueName: \"kubernetes.io/projected/b5bc2cdb-7da6-475a-a976-312ae291d9eb-kube-api-access-d78md\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-run\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116127    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqk58\" (UniqueName: \"kubernetes.io/projected/f5b1e411-1b12-4c47-8bcc-569d58b86fae-kube-api-access-cqk58\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-multus-certs\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cnibin\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116205    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-env-overrides\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-serviceca\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.118480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116262    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-system-cni-dir\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dksnf\" (UniqueName: \"kubernetes.io/projected/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-kube-api-access-dksnf\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysctl-d\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2wj\" (UniqueName: \"kubernetes.io/projected/20acce01-cd07-44b0-9c66-6a4477df36c7-kube-api-access-5v2wj\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xd58\" (UniqueName: \"kubernetes.io/projected/75f30836-9af3-4a95-a1d4-77d36c72d50a-kube-api-access-6xd58\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj978\" (UniqueName: \"kubernetes.io/projected/7c956574-b319-45c6-a6b4-8df662003658-kube-api-access-zj978\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116454    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-systemd\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-etc-selinux\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-node-log\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116531    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-systemd\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116537    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovnkube-script-lib\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovnkube-config\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx4r9\" (UniqueName: \"kubernetes.io/projected/d1863775-a053-442d-96ec-7c30f9e1c8f5-kube-api-access-lx4r9\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kl4p\" (UniqueName: \"kubernetes.io/projected/7cda9f2c-b7c7-421d-93a1-c99170d528c7-kube-api-access-4kl4p\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116656    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-serviceca\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-k8s-cni-cncf-io\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.119281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-cni-bin\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116714    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-cni-multus\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-log-socket\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-kubelet-config\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cni-binary-copy\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116850    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-sysctl-d\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1863775-a053-442d-96ec-7c30f9e1c8f5-tmp-dir\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116898    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovnkube-config\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116990    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-etc-selinux\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117005    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-run\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.116895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-registration-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-node-log\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-device-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-systemd-units\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-host\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-netns\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-netns\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117295    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-multus-certs\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.120116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117346    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cnibin\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117381    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-var-lib-cni-bin\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117432    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-device-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117472    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5bc2cdb-7da6-475a-a976-312ae291d9eb-host-run-k8s-cni-cncf-io\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117480    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8289e10e-1278-4eb1-b100-ea582961d22f-registration-dir\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117508    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-log-socket\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117534    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75f30836-9af3-4a95-a1d4-77d36c72d50a-systemd-units\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117545    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20acce01-cd07-44b0-9c66-6a4477df36c7-host\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-kubelet-config\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.117621    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1863775-a053-442d-96ec-7c30f9e1c8f5-tmp-dir\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.118249    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b1e411-1b12-4c47-8bcc-569d58b86fae-cni-binary-copy\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.118912    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20acce01-cd07-44b0-9c66-6a4477df36c7-etc-tuned\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.119030    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75f30836-9af3-4a95-a1d4-77d36c72d50a-ovn-node-metrics-cert\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.119804    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20acce01-cd07-44b0-9c66-6a4477df36c7-tmp\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.120819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.119853    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f9723c3-246b-41a8-bc29-6daccde48fa5-agent-certs\") pod \"konnectivity-agent-lq2gn\" (UID: \"0f9723c3-246b-41a8-bc29-6daccde48fa5\") " pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:23.127374 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.127335    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode248d9ed01089d1ca33c4184b25849f2.slice/crio-45e10fb9c57431bc6a20eb67fd6a86dd2f9677077dfef10e149a29ec288d1bb8 WatchSource:0}: Error finding container 45e10fb9c57431bc6a20eb67fd6a86dd2f9677077dfef10e149a29ec288d1bb8: Status 404 returned error can't find the container with id 45e10fb9c57431bc6a20eb67fd6a86dd2f9677077dfef10e149a29ec288d1bb8
Jul 05 13:15:23.127980 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.127956    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:23.128091 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.127986    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:23.128091 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.128015    2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7vjx for pod openshift-network-diagnostics/network-check-target-jrd7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:23.128202 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.128111    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx podName:330bad06-7513-4d1f-9850-7353655acb21 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:23.62808313 +0000 UTC m=+2.065104853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b7vjx" (UniqueName: "kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx") pod "network-check-target-jrd7x" (UID: "330bad06-7513-4d1f-9850-7353655acb21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:23.132023 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.131688    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhjhg\" (UniqueName: \"kubernetes.io/projected/8289e10e-1278-4eb1-b100-ea582961d22f-kube-api-access-nhjhg\") pod \"aws-ebs-csi-driver-node-skpm2\" (UID: \"8289e10e-1278-4eb1-b100-ea582961d22f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.134157 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.134101    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dksnf\" (UniqueName: \"kubernetes.io/projected/03cafd34-c293-4a41-ba5b-17ac1ab25e1a-kube-api-access-dksnf\") pod \"node-ca-k88r5\" (UID: \"03cafd34-c293-4a41-ba5b-17ac1ab25e1a\") " pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.134624 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.134598    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj978\" (UniqueName: \"kubernetes.io/projected/7c956574-b319-45c6-a6b4-8df662003658-kube-api-access-zj978\") pod \"iptables-alerter-z4zfp\" (UID: \"7c956574-b319-45c6-a6b4-8df662003658\") " pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.135291 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.135267    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:15:23.135401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.135332    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xd58\" (UniqueName: \"kubernetes.io/projected/75f30836-9af3-4a95-a1d4-77d36c72d50a-kube-api-access-6xd58\") pod \"ovnkube-node-nj8l7\" (UID: \"75f30836-9af3-4a95-a1d4-77d36c72d50a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.135470 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.135402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx4r9\" (UniqueName: \"kubernetes.io/projected/d1863775-a053-442d-96ec-7c30f9e1c8f5-kube-api-access-lx4r9\") pod \"node-resolver-m99wq\" (UID: \"d1863775-a053-442d-96ec-7c30f9e1c8f5\") " pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.135470 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.135429    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2wj\" (UniqueName: \"kubernetes.io/projected/20acce01-cd07-44b0-9c66-6a4477df36c7-kube-api-access-5v2wj\") pod \"tuned-8gxj4\" (UID: \"20acce01-cd07-44b0-9c66-6a4477df36c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.135693 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.135468    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kl4p\" (UniqueName: \"kubernetes.io/projected/7cda9f2c-b7c7-421d-93a1-c99170d528c7-kube-api-access-4kl4p\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:23.136242 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.136225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d78md\" (UniqueName: \"kubernetes.io/projected/b5bc2cdb-7da6-475a-a976-312ae291d9eb-kube-api-access-d78md\") pod \"multus-zcfg5\" (UID: \"b5bc2cdb-7da6-475a-a976-312ae291d9eb\") " pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.136915 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.136893    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqk58\" (UniqueName: \"kubernetes.io/projected/f5b1e411-1b12-4c47-8bcc-569d58b86fae-kube-api-access-cqk58\") pod \"multus-additional-cni-plugins-zclhg\" (UID: \"f5b1e411-1b12-4c47-8bcc-569d58b86fae\") " pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.244848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.244766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k88r5"
Jul 05 13:15:23.254170 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.254141    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cafd34_c293_4a41_ba5b_17ac1ab25e1a.slice/crio-1ba6bef432f13fc6ccecfd03429aafe4d5584d932a725c0a2289a04be7e446c9 WatchSource:0}: Error finding container 1ba6bef432f13fc6ccecfd03429aafe4d5584d932a725c0a2289a04be7e446c9: Status 404 returned error can't find the container with id 1ba6bef432f13fc6ccecfd03429aafe4d5584d932a725c0a2289a04be7e446c9
Jul 05 13:15:23.261710 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.261692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcfg5"
Jul 05 13:15:23.268173 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.268158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4zfp"
Jul 05 13:15:23.268917 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.268871    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bc2cdb_7da6_475a_a976_312ae291d9eb.slice/crio-348026b70f306d4b4d7e78701053df2d2e1780d7342d113a0db05563e1bcaeb3 WatchSource:0}: Error finding container 348026b70f306d4b4d7e78701053df2d2e1780d7342d113a0db05563e1bcaeb3: Status 404 returned error can't find the container with id 348026b70f306d4b4d7e78701053df2d2e1780d7342d113a0db05563e1bcaeb3
Jul 05 13:15:23.276788 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.276767    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c956574_b319_45c6_a6b4_8df662003658.slice/crio-3fb0750ab1f3f017c6b5c81ff6dca6174f6481ca6df909d7d96193d97ee3124a WatchSource:0}: Error finding container 3fb0750ab1f3f017c6b5c81ff6dca6174f6481ca6df909d7d96193d97ee3124a: Status 404 returned error can't find the container with id 3fb0750ab1f3f017c6b5c81ff6dca6174f6481ca6df909d7d96193d97ee3124a
Jul 05 13:15:23.280888 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.280871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m99wq"
Jul 05 13:15:23.289682 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.289662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gxj4"
Jul 05 13:15:23.289931 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.289911    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1863775_a053_442d_96ec_7c30f9e1c8f5.slice/crio-9948c09b328e4c2ea90214b2095e43b7baa630cbd6900f39e6bfe1d987cc5efe WatchSource:0}: Error finding container 9948c09b328e4c2ea90214b2095e43b7baa630cbd6900f39e6bfe1d987cc5efe: Status 404 returned error can't find the container with id 9948c09b328e4c2ea90214b2095e43b7baa630cbd6900f39e6bfe1d987cc5efe
Jul 05 13:15:23.296389 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.296369    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20acce01_cd07_44b0_9c66_6a4477df36c7.slice/crio-a7e20e96ead1ebbe242f15bdb34980e7e6b744c0807dbb4faab440ba850ac6b4 WatchSource:0}: Error finding container a7e20e96ead1ebbe242f15bdb34980e7e6b744c0807dbb4faab440ba850ac6b4: Status 404 returned error can't find the container with id a7e20e96ead1ebbe242f15bdb34980e7e6b744c0807dbb4faab440ba850ac6b4
Jul 05 13:15:23.314165 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.314140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:23.321385 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.321363    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9723c3_246b_41a8_bc29_6daccde48fa5.slice/crio-c6f83dea19a24ebd6a6848d735137c06f1e3946f7e19d940eff636eb35461705 WatchSource:0}: Error finding container c6f83dea19a24ebd6a6848d735137c06f1e3946f7e19d940eff636eb35461705: Status 404 returned error can't find the container with id c6f83dea19a24ebd6a6848d735137c06f1e3946f7e19d940eff636eb35461705
Jul 05 13:15:23.335497 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.335477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2"
Jul 05 13:15:23.342872 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.342850    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8289e10e_1278_4eb1_b100_ea582961d22f.slice/crio-51546f3aacb55c2ce7ecc30f7e797dec1edc338aaeec188160d594d9d1fb3893 WatchSource:0}: Error finding container 51546f3aacb55c2ce7ecc30f7e797dec1edc338aaeec188160d594d9d1fb3893: Status 404 returned error can't find the container with id 51546f3aacb55c2ce7ecc30f7e797dec1edc338aaeec188160d594d9d1fb3893
Jul 05 13:15:23.346909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.346891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zclhg"
Jul 05 13:15:23.351692 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.351663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:23.354989 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.354970    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b1e411_1b12_4c47_8bcc_569d58b86fae.slice/crio-e897f7b4da5d93af37abf047f748ddcc8bab1948c7dbc6ac7ee9cd81b43b7d92 WatchSource:0}: Error finding container e897f7b4da5d93af37abf047f748ddcc8bab1948c7dbc6ac7ee9cd81b43b7d92: Status 404 returned error can't find the container with id e897f7b4da5d93af37abf047f748ddcc8bab1948c7dbc6ac7ee9cd81b43b7d92
Jul 05 13:15:23.359710 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:23.359690    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f30836_9af3_4a95_a1d4_77d36c72d50a.slice/crio-b7d56f439142336ea7900ac6b4304fbc3130c5235519c6c5e5a6509c6f850066 WatchSource:0}: Error finding container b7d56f439142336ea7900ac6b4304fbc3130c5235519c6c5e5a6509c6f850066: Status 404 returned error can't find the container with id b7d56f439142336ea7900ac6b4304fbc3130c5235519c6c5e5a6509c6f850066
Jul 05 13:15:23.394680 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.394639    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:23.620361 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.620263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:23.620361 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.620325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:23.620592 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.620494    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:23.620738 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.620620    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:24.620573834 +0000 UTC m=+3.057595564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:23.621096 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.621073    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:23.621207 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.621135    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret podName:c1144a9f-42a3-46cc-9c16-0b6bc954cd65 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:24.621117256 +0000 UTC m=+3.058138961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret") pod "global-pull-secret-syncer-gt6kj" (UID: "c1144a9f-42a3-46cc-9c16-0b6bc954cd65") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:23.721057 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.721017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:23.721438 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.721367    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:23.721438 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.721395    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:23.721438 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.721408    2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7vjx for pod openshift-network-diagnostics/network-check-target-jrd7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:23.721640 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:23.721473    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx podName:330bad06-7513-4d1f-9850-7353655acb21 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:24.721453197 +0000 UTC m=+3.158474924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b7vjx" (UniqueName: "kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx") pod "network-check-target-jrd7x" (UID: "330bad06-7513-4d1f-9850-7353655acb21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:23.804825 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.804787    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:23.955444 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.955266    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:10:23 +0000 UTC" deadline="2028-02-18 10:25:59.605789457 +0000 UTC"
Jul 05 13:15:23.955444 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:23.955330    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14229h10m35.650464198s"
Jul 05 13:15:24.107158 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.107125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:24.107158 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.107170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:24.107409 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.107270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:24.107782 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.107747    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:24.107896 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.107814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:24.107896 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.107887    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:24.149559 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.149499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2" event={"ID":"8289e10e-1278-4eb1-b100-ea582961d22f","Type":"ContainerStarted","Data":"51546f3aacb55c2ce7ecc30f7e797dec1edc338aaeec188160d594d9d1fb3893"}
Jul 05 13:15:24.160506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.160418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lq2gn" event={"ID":"0f9723c3-246b-41a8-bc29-6daccde48fa5","Type":"ContainerStarted","Data":"c6f83dea19a24ebd6a6848d735137c06f1e3946f7e19d940eff636eb35461705"}
Jul 05 13:15:24.171970 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.171927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal" event={"ID":"e820eb0691173ad92dd1c08f2a054507","Type":"ContainerStarted","Data":"078e749ca29a3c93e0f347f34d1fc17b1d8adf18c9f0872435af0455728f8361"}
Jul 05 13:15:24.192425 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.192304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal" event={"ID":"e248d9ed01089d1ca33c4184b25849f2","Type":"ContainerStarted","Data":"45e10fb9c57431bc6a20eb67fd6a86dd2f9677077dfef10e149a29ec288d1bb8"}
Jul 05 13:15:24.205785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.205567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"b7d56f439142336ea7900ac6b4304fbc3130c5235519c6c5e5a6509c6f850066"}
Jul 05 13:15:24.234880 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.234847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gxj4" event={"ID":"20acce01-cd07-44b0-9c66-6a4477df36c7","Type":"ContainerStarted","Data":"a7e20e96ead1ebbe242f15bdb34980e7e6b744c0807dbb4faab440ba850ac6b4"}
Jul 05 13:15:24.246136 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.246105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m99wq" event={"ID":"d1863775-a053-442d-96ec-7c30f9e1c8f5","Type":"ContainerStarted","Data":"9948c09b328e4c2ea90214b2095e43b7baa630cbd6900f39e6bfe1d987cc5efe"}
Jul 05 13:15:24.264190 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.264152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4zfp" event={"ID":"7c956574-b319-45c6-a6b4-8df662003658","Type":"ContainerStarted","Data":"3fb0750ab1f3f017c6b5c81ff6dca6174f6481ca6df909d7d96193d97ee3124a"}
Jul 05 13:15:24.295649 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.295611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcfg5" event={"ID":"b5bc2cdb-7da6-475a-a976-312ae291d9eb","Type":"ContainerStarted","Data":"348026b70f306d4b4d7e78701053df2d2e1780d7342d113a0db05563e1bcaeb3"}
Jul 05 13:15:24.323863 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.323818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k88r5" event={"ID":"03cafd34-c293-4a41-ba5b-17ac1ab25e1a","Type":"ContainerStarted","Data":"1ba6bef432f13fc6ccecfd03429aafe4d5584d932a725c0a2289a04be7e446c9"}
Jul 05 13:15:24.328354 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.328316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerStarted","Data":"e897f7b4da5d93af37abf047f748ddcc8bab1948c7dbc6ac7ee9cd81b43b7d92"}
Jul 05 13:15:24.362537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.362506    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:24.629258 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.628451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:24.629258 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.628508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:24.629258 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.628654    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:24.629258 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.628735    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:26.62869585 +0000 UTC m=+5.065717558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:24.629258 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.629121    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:24.629258 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.629167    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret podName:c1144a9f-42a3-46cc-9c16-0b6bc954cd65 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:26.629152907 +0000 UTC m=+5.066174614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret") pod "global-pull-secret-syncer-gt6kj" (UID: "c1144a9f-42a3-46cc-9c16-0b6bc954cd65") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:24.730193 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.729697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:24.730193 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.729934    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:24.730193 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.729956    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:24.730193 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.729970    2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7vjx for pod openshift-network-diagnostics/network-check-target-jrd7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:24.730193 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:24.730151    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx podName:330bad06-7513-4d1f-9850-7353655acb21 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:26.730011746 +0000 UTC m=+5.167033479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b7vjx" (UniqueName: "kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx") pod "network-check-target-jrd7x" (UID: "330bad06-7513-4d1f-9850-7353655acb21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:24.956473 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.955739    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:10:23 +0000 UTC" deadline="2027-12-25 18:15:50.559265173 +0000 UTC"
Jul 05 13:15:24.956473 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.955803    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12917h0m25.603466815s"
Jul 05 13:15:24.963309 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:24.963284    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:26.110789 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:26.110709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:26.111292 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.110873    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:26.111372 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:26.111324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:26.111490 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.111423    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:26.111570 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:26.111491    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:26.111620 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.111583    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:26.651396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:26.651328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:26.651567 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:26.651426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:26.651667 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.651564    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:26.651667 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.651645    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret podName:c1144a9f-42a3-46cc-9c16-0b6bc954cd65 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:30.651614385 +0000 UTC m=+9.088636096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret") pod "global-pull-secret-syncer-gt6kj" (UID: "c1144a9f-42a3-46cc-9c16-0b6bc954cd65") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:26.651818 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.651742    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:26.651818 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.651783    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:30.651769193 +0000 UTC m=+9.088790897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:26.752410 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:26.752313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:26.752596 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.752525    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:26.752596 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.752545    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:26.752596 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.752560    2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7vjx for pod openshift-network-diagnostics/network-check-target-jrd7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:26.752844 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:26.752624    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx podName:330bad06-7513-4d1f-9850-7353655acb21 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:30.752603938 +0000 UTC m=+9.189625669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b7vjx" (UniqueName: "kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx") pod "network-check-target-jrd7x" (UID: "330bad06-7513-4d1f-9850-7353655acb21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:28.107192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:28.107160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:28.107192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:28.107177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:28.107951 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:28.107160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:28.107951 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:28.107311    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:28.107951 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:28.107772    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:28.107951 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:28.107873    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:30.107408 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:30.107142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:30.107408 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.107305    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:30.107977 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:30.107791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:30.107977 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.107888    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:30.108101 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:30.108032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:30.108161 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.108118    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:30.688532 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:30.688486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:30.688791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:30.688555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:30.688791 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.688693    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:30.688791 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.688739    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:30.688791 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.688780    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret podName:c1144a9f-42a3-46cc-9c16-0b6bc954cd65 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:38.688755522 +0000 UTC m=+17.125777248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret") pod "global-pull-secret-syncer-gt6kj" (UID: "c1144a9f-42a3-46cc-9c16-0b6bc954cd65") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:30.689036 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.688805    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:38.688792542 +0000 UTC m=+17.125814253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:30.789602 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:30.789322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:30.789602 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.789548    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:30.789602 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.789574    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:30.789602 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.789588    2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7vjx for pod openshift-network-diagnostics/network-check-target-jrd7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:30.789971 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:30.789655    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx podName:330bad06-7513-4d1f-9850-7353655acb21 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:38.789636031 +0000 UTC m=+17.226657735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b7vjx" (UniqueName: "kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx") pod "network-check-target-jrd7x" (UID: "330bad06-7513-4d1f-9850-7353655acb21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:32.108070 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:32.108016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:32.108537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:32.108161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:32.108537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:32.108203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:32.108537 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:32.108200    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:32.108537 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:32.108290    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:32.108537 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:32.108385    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:34.107011 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:34.106967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:34.107483 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:34.106976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:34.107483 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:34.107122    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:34.107483 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:34.106976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:34.107483 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:34.107200    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:34.107483 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:34.107292    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:36.107241 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:36.107204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:36.107241 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:36.107236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:36.107780 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:36.107204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:36.107780 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:36.107363    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:36.107780 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:36.107430    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:36.107780 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:36.107538    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:38.106454 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:38.106417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:38.106916 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:38.106418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:38.106916 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:38.106530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:38.106916 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.106546    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:38.106916 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.106610    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:38.106916 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.106705    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:38.754564 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:38.754518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:38.754775 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:38.754576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:38.754775 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.754705    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:38.754884 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.754782    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret podName:c1144a9f-42a3-46cc-9c16-0b6bc954cd65 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:54.754760384 +0000 UTC m=+33.191782087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret") pod "global-pull-secret-syncer-gt6kj" (UID: "c1144a9f-42a3-46cc-9c16-0b6bc954cd65") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:38.754884 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.754711    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:38.754884 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.754866    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:54.754852094 +0000 UTC m=+33.191873813 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:38.855373 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:38.855337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:38.855560 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.855539    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:38.855611 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.855565    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:38.855611 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.855579    2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7vjx for pod openshift-network-diagnostics/network-check-target-jrd7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:38.855699 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:38.855641    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx podName:330bad06-7513-4d1f-9850-7353655acb21 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:54.855622582 +0000 UTC m=+33.292644286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b7vjx" (UniqueName: "kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx") pod "network-check-target-jrd7x" (UID: "330bad06-7513-4d1f-9850-7353655acb21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:40.106422 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:40.106389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:40.106942 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:40.106389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:40.106942 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:40.106518    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:40.106942 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:40.106634    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:40.106942 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:40.106690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:40.106942 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:40.106785    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:42.109327 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:42.109296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:42.109327 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:42.109319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:42.109787 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:42.109309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:42.109787 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:42.109393    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:42.109787 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:42.109481    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:42.109787 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:42.109571    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:44.107863 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.107220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:44.107863 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.107575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:44.107863 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:44.107786    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:44.108497 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:44.107901    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:44.108497 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.107939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:44.108497 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:44.108012    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:44.398401 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.398371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcfg5" event={"ID":"b5bc2cdb-7da6-475a-a976-312ae291d9eb","Type":"ContainerStarted","Data":"ff3fb93b8404b6e9e57e3b361f471846667522b29b4521b5cf283eb370040a8d"}
Jul 05 13:15:44.400761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.400736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal" event={"ID":"e248d9ed01089d1ca33c4184b25849f2","Type":"ContainerStarted","Data":"845191d74b44fa7f667689adc166292b30b102f31ee9c74204e269e3dfc2d402"}
Jul 05 13:15:44.405106 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.405087    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:15:44.405607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.405444    2565 generic.go:356] "Generic (PLEG): container finished" podID="75f30836-9af3-4a95-a1d4-77d36c72d50a" containerID="af663a6222cfce730062126303b97789ab5b36d749ea9027b17acc83770d785d" exitCode=1
Jul 05 13:15:44.405607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.405529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"abec357d27d9ccadf215f5692a38262f2f4af1b84d0aac7e2fc6b3c13b219b95"}
Jul 05 13:15:44.405607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.405596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"9ec02f0e229f231a8090c06705ef93da154390d6c337b2d52e0cb0b7d0ac93b9"}
Jul 05 13:15:44.405842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.405647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"c15c02fbf0afd40a608d645d3b6d1e24534bb2d1544a3e0e3bb36486ec45a165"}
Jul 05 13:15:44.405842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.405718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerDied","Data":"af663a6222cfce730062126303b97789ab5b36d749ea9027b17acc83770d785d"}
Jul 05 13:15:44.405842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.405769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"2ae916af033c796a9a152d08b1f4809ce98c96dea0fd063a7cd5836d5294246d"}
Jul 05 13:15:44.407308 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.407285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gxj4" event={"ID":"20acce01-cd07-44b0-9c66-6a4477df36c7","Type":"ContainerStarted","Data":"c5ac1f4bc5c28c8183e174bdd36f3803cc62eee56f8d6c37baa3a2e1bbf42276"}
Jul 05 13:15:44.419507 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.419463    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zcfg5" podStartSLOduration=1.75451137 podStartE2EDuration="22.419451418s" totalImagesPullingTime="20.664940048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:44.418130185 +0000 UTC m=+22.855151910" watchObservedRunningTime="2026-07-05 13:15:44.419451418 +0000 UTC m=+22.856473142"
Jul 05 13:15:44.436192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:44.436153    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8gxj4" podStartSLOduration=2.201481872 podStartE2EDuration="22.436138539s" totalImagesPullingTime="20.234656667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:44.43602773 +0000 UTC m=+22.873049456" watchObservedRunningTime="2026-07-05 13:15:44.436138539 +0000 UTC m=+22.873160263"
Jul 05 13:15:45.411587 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.411558    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:15:45.412317 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.411975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"4d3a19a358322ac6957cb51d20018eb1a4a4152117cc5aaff8da142b66478944"}
Jul 05 13:15:45.413272 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.413250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m99wq" event={"ID":"d1863775-a053-442d-96ec-7c30f9e1c8f5","Type":"ContainerStarted","Data":"70d8282b2dbe1e4f65a07ee00d4b78a92f2b6184efe22e6e33cb3f91cb4b5fc9"}
Jul 05 13:15:45.416137 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.416109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4zfp" event={"ID":"7c956574-b319-45c6-a6b4-8df662003658","Type":"ContainerStarted","Data":"b7258fc36b33a3cd9b33ec27e5e1617d9be92cd3c4a578dc791e35ca9df99b0d"}
Jul 05 13:15:45.417591 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.417563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k88r5" event={"ID":"03cafd34-c293-4a41-ba5b-17ac1ab25e1a","Type":"ContainerStarted","Data":"196702a04b60925be79207010393223ae7f692b7716aad27eef99b8c152f2664"}
Jul 05 13:15:45.418866 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.418847    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5b1e411-1b12-4c47-8bcc-569d58b86fae" containerID="5bd07ad995591651f896a0fad4f92db793c041e5206a807e699f4a6f6062fe27" exitCode=0
Jul 05 13:15:45.419049 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.418904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerDied","Data":"5bd07ad995591651f896a0fad4f92db793c041e5206a807e699f4a6f6062fe27"}
Jul 05 13:15:45.420335 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.420318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2" event={"ID":"8289e10e-1278-4eb1-b100-ea582961d22f","Type":"ContainerStarted","Data":"044c05242ccc9335cbf301437b924b00ce29dba5e71f7fe3e79c0a2ab67ea308"}
Jul 05 13:15:45.421530 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.421508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lq2gn" event={"ID":"0f9723c3-246b-41a8-bc29-6daccde48fa5","Type":"ContainerStarted","Data":"5f0237cce8fe78a36bba8342d7288c46d02c78109f441088b1d1d88d1e4133f6"}
Jul 05 13:15:45.422908 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.422755    2565 generic.go:356] "Generic (PLEG): container finished" podID="e820eb0691173ad92dd1c08f2a054507" containerID="2910e10e44934e5e459f444a9b2d3e4aa11004eeabcc1868a0e002faf2de2e79" exitCode=0
Jul 05 13:15:45.423002 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.422836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal" event={"ID":"e820eb0691173ad92dd1c08f2a054507","Type":"ContainerDied","Data":"2910e10e44934e5e459f444a9b2d3e4aa11004eeabcc1868a0e002faf2de2e79"}
Jul 05 13:15:45.427432 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.427389    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-75.ec2.internal" podStartSLOduration=22.42737564 podStartE2EDuration="22.42737564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:44.453371234 +0000 UTC m=+22.890392960" watchObservedRunningTime="2026-07-05 13:15:45.42737564 +0000 UTC m=+23.864397364"
Jul 05 13:15:45.427518 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.427460    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m99wq" podStartSLOduration=3.187749407 podStartE2EDuration="23.427454675s" totalImagesPullingTime="20.239705268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:45.426863115 +0000 UTC m=+23.863884840" watchObservedRunningTime="2026-07-05 13:15:45.427454675 +0000 UTC m=+23.864476402"
Jul 05 13:15:45.456946 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.456910    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k88r5" podStartSLOduration=3.182312587 podStartE2EDuration="23.456898838s" totalImagesPullingTime="20.274586251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:45.456516462 +0000 UTC m=+23.893538183" watchObservedRunningTime="2026-07-05 13:15:45.456898838 +0000 UTC m=+23.893920563"
Jul 05 13:15:45.469811 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.469773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z4zfp" podStartSLOduration=3.217597718 podStartE2EDuration="23.469762375s" totalImagesPullingTime="20.252164657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:45.469200676 +0000 UTC m=+23.906222400" watchObservedRunningTime="2026-07-05 13:15:45.469762375 +0000 UTC m=+23.906784100"
Jul 05 13:15:45.506792 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.506757    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lq2gn" podStartSLOduration=3.316351457 podStartE2EDuration="23.506744845s" totalImagesPullingTime="20.190393388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:45.484027945 +0000 UTC m=+23.921049670" watchObservedRunningTime="2026-07-05 13:15:45.506744845 +0000 UTC m=+23.943766585"
Jul 05 13:15:45.610395 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.610374    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:45.610789 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.610770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:45.726336 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.726316    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 05 13:15:45.990559 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.990428    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T13:15:45.726332242Z","UUID":"103a682d-38c4-44a9-b394-64b7eac1bfe1","Handler":null,"Name":"","Endpoint":""}
Jul 05 13:15:45.991961 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.991940    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 05 13:15:45.992086 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:45.991981    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 05 13:15:46.106645 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:46.106608    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:46.106645 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:46.106627    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:46.106932 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:46.106767    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:46.106997 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:46.106976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:46.107100 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:46.107078    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:46.107186 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:46.107165    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:46.427712 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:46.427616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2" event={"ID":"8289e10e-1278-4eb1-b100-ea582961d22f","Type":"ContainerStarted","Data":"6673ac9e759cd2c31495f27250d1bbf6f5045a6f53d8195ca11a2b0a591cb73f"}
Jul 05 13:15:46.429709 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:46.429680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal" event={"ID":"e820eb0691173ad92dd1c08f2a054507","Type":"ContainerStarted","Data":"c3120d4caa48fcda991f3f285c8e382de4803f244f3d8e5e8fcb4cf69e51c4c0"}
Jul 05 13:15:46.444728 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:46.444682    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-75.ec2.internal" podStartSLOduration=23.444649639 podStartE2EDuration="23.444649639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:46.444569994 +0000 UTC m=+24.881591720" watchObservedRunningTime="2026-07-05 13:15:46.444649639 +0000 UTC m=+24.881671365"
Jul 05 13:15:47.435270 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:47.435242    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:15:47.435864 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:47.435655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"61798c33cfc803c2bcb3e62a2dcdee50df5d03e8badab6c910ce1bb43b4df3f5"}
Jul 05 13:15:47.439698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:47.439648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2" event={"ID":"8289e10e-1278-4eb1-b100-ea582961d22f","Type":"ContainerStarted","Data":"1a9397c58dcb85a76867192fe6988aa699a4c0154bd874126e1d00b51e598862"}
Jul 05 13:15:47.439839 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:47.439703    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 05 13:15:47.457754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:47.457703    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skpm2" podStartSLOduration=1.997875408 podStartE2EDuration="24.45768424s" totalImagesPullingTime="22.459808832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:47.45716414 +0000 UTC m=+25.894185866" watchObservedRunningTime="2026-07-05 13:15:47.45768424 +0000 UTC m=+25.894705963"
Jul 05 13:15:48.107266 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:48.107233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:48.107443 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:48.107233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:48.107443 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:48.107364    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:48.107443 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:48.107233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:48.107443 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:48.107414    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:48.107650 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:48.107514    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:50.107539 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.107265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:50.108172 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.107265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:50.108172 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:50.107595    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:50.108172 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.107323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:50.108172 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:50.107659    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:50.108172 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:50.107731    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:50.448580 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.448493    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5b1e411-1b12-4c47-8bcc-569d58b86fae" containerID="6ec4caed44e8431dafaec483afcedf40bd80573650e8e67396a2b841a97057b0" exitCode=0
Jul 05 13:15:50.448747 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.448581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerDied","Data":"6ec4caed44e8431dafaec483afcedf40bd80573650e8e67396a2b841a97057b0"}
Jul 05 13:15:50.452182 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.452080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:15:50.452389 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.452369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"312e94dee11485e68e11cc76261715b56bb8ccb75db7fb67547b65137ad5c0a8"}
Jul 05 13:15:50.452698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.452680    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:50.452776 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.452748    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:50.452906 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.452891    2565 scope.go:117] "RemoveContainer" containerID="af663a6222cfce730062126303b97789ab5b36d749ea9027b17acc83770d785d"
Jul 05 13:15:50.468480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:50.468460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:51.456640 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.456609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerStarted","Data":"6b25226a852f33cdd2f067eafcf6b3070eff05ad9c3c6058f2723366ed2df3b4"}
Jul 05 13:15:51.459722 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.459704    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:15:51.460038 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.460021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" event={"ID":"75f30836-9af3-4a95-a1d4-77d36c72d50a","Type":"ContainerStarted","Data":"c3b4431e09fbcbcc654933afc023f154ec14e7dd613130ef2497654d498c1ba5"}
Jul 05 13:15:51.460255 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.460241    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:51.474033 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.474010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:15:51.509425 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.509380    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7" podStartSLOduration=8.073237053 podStartE2EDuration="28.509366877s" totalImagesPullingTime="20.436129824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:51.507926824 +0000 UTC m=+29.944948549" watchObservedRunningTime="2026-07-05 13:15:51.509366877 +0000 UTC m=+29.946388611"
Jul 05 13:15:51.811627 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.811591    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrd7x"]
Jul 05 13:15:51.811842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.811760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:51.811910 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:51.811863    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:51.816563 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.816535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m8wgm"]
Jul 05 13:15:51.816694 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.816649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:51.816803 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:51.816782    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:51.817194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.817169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gt6kj"]
Jul 05 13:15:51.817280 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:51.817261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:51.817362 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:51.817345    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:52.463855 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:52.463821    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5b1e411-1b12-4c47-8bcc-569d58b86fae" containerID="6b25226a852f33cdd2f067eafcf6b3070eff05ad9c3c6058f2723366ed2df3b4" exitCode=0
Jul 05 13:15:52.464241 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:52.463904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerDied","Data":"6b25226a852f33cdd2f067eafcf6b3070eff05ad9c3c6058f2723366ed2df3b4"}
Jul 05 13:15:53.106979 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:53.106909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:53.107105 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:53.107024    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:53.247888 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:53.247852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:53.248047 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:53.248037    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 05 13:15:53.248378 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:53.248357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lq2gn"
Jul 05 13:15:53.468176 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:53.468153    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5b1e411-1b12-4c47-8bcc-569d58b86fae" containerID="d34ee1d36417281c81710b09de44f8d9c57640a8aeb4d0600c0191b6a9792f38" exitCode=0
Jul 05 13:15:53.468475 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:53.468232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerDied","Data":"d34ee1d36417281c81710b09de44f8d9c57640a8aeb4d0600c0191b6a9792f38"}
Jul 05 13:15:54.107041 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:54.106818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:54.107223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:54.106878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:54.107223 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.107151    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:54.107223 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.107175    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:54.771369 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:54.771336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:54.771891 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:54.771441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:54.771891 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.771681    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:54.771891 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.771691    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:54.771891 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.771753    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:26.771736831 +0000 UTC m=+65.208758534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:54.771891 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.771768    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret podName:c1144a9f-42a3-46cc-9c16-0b6bc954cd65 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:26.771762424 +0000 UTC m=+65.208784127 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret") pod "global-pull-secret-syncer-gt6kj" (UID: "c1144a9f-42a3-46cc-9c16-0b6bc954cd65") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:54.872491 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:54.872457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:54.872662 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.872606    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:54.872662 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.872626    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:54.872662 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.872638    2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7vjx for pod openshift-network-diagnostics/network-check-target-jrd7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:54.872910 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:54.872720    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx podName:330bad06-7513-4d1f-9850-7353655acb21 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:26.872699317 +0000 UTC m=+65.309721037 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b7vjx" (UniqueName: "kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx") pod "network-check-target-jrd7x" (UID: "330bad06-7513-4d1f-9850-7353655acb21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:55.106410 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:55.106382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:55.106561 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:55.106484    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gt6kj" podUID="c1144a9f-42a3-46cc-9c16-0b6bc954cd65"
Jul 05 13:15:56.112617 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.112585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:56.113037 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:56.112713    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrd7x" podUID="330bad06-7513-4d1f-9850-7353655acb21"
Jul 05 13:15:56.113037 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.112767    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:56.113037 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:56.112896    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:15:56.767185 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.767112    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-75.ec2.internal" event="NodeReady"
Jul 05 13:15:56.767341 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.767269    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 05 13:15:56.847946 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.847899    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvlkl"]
Jul 05 13:15:56.850813 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.850779    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p7kl8"]
Jul 05 13:15:56.850953 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.850875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:56.852538 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.852514    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:56.853409 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.853384    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9gzst\""
Jul 05 13:15:56.853697 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.853608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 05 13:15:56.853697 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.853611    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 05 13:15:56.855033 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.855007    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 05 13:15:56.855164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.855085    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 05 13:15:56.855287 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.855266    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5scw5\""
Jul 05 13:15:56.855416 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.855340    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 05 13:15:56.859507 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.859486    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p7kl8"]
Jul 05 13:15:56.862567 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.862545    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvlkl"]
Jul 05 13:15:56.984973 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.984942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42gm\" (UniqueName: \"kubernetes.io/projected/044cb6b3-47cc-419e-8326-05bed4594c21-kube-api-access-z42gm\") pod \"ingress-canary-p7kl8\" (UID: \"044cb6b3-47cc-419e-8326-05bed4594c21\") " pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:56.985164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.985038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:56.985164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.985073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgppw\" (UniqueName: \"kubernetes.io/projected/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-kube-api-access-xgppw\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:56.985164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.985099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-tmp-dir\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:56.985164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.985131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-config-volume\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:56.985164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:56.985150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/044cb6b3-47cc-419e-8326-05bed4594c21-cert\") pod \"ingress-canary-p7kl8\" (UID: \"044cb6b3-47cc-419e-8326-05bed4594c21\") " pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:57.085972 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.085936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.086177 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.085992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgppw\" (UniqueName: \"kubernetes.io/projected/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-kube-api-access-xgppw\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.086177 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.086019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-tmp-dir\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.086177 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.086057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-config-volume\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.086177 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.086077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/044cb6b3-47cc-419e-8326-05bed4594c21-cert\") pod \"ingress-canary-p7kl8\" (UID: \"044cb6b3-47cc-419e-8326-05bed4594c21\") " pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:57.086177 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:57.086124    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:15:57.086433 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:57.086196    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:15:57.586175026 +0000 UTC m=+36.023196729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:15:57.086433 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.086221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42gm\" (UniqueName: \"kubernetes.io/projected/044cb6b3-47cc-419e-8326-05bed4594c21-kube-api-access-z42gm\") pod \"ingress-canary-p7kl8\" (UID: \"044cb6b3-47cc-419e-8326-05bed4594c21\") " pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:57.086534 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.086439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-tmp-dir\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.086829 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.086812    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-config-volume\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.090807 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.090783    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/044cb6b3-47cc-419e-8326-05bed4594c21-cert\") pod \"ingress-canary-p7kl8\" (UID: \"044cb6b3-47cc-419e-8326-05bed4594c21\") " pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:57.095432 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.095385    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgppw\" (UniqueName: \"kubernetes.io/projected/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-kube-api-access-xgppw\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.095545 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.095430    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42gm\" (UniqueName: \"kubernetes.io/projected/044cb6b3-47cc-419e-8326-05bed4594c21-kube-api-access-z42gm\") pod \"ingress-canary-p7kl8\" (UID: \"044cb6b3-47cc-419e-8326-05bed4594c21\") " pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:57.107205 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.107188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:15:57.109886 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.109864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 13:15:57.170197 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.170154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p7kl8"
Jul 05 13:15:57.591061 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.591021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:57.591483 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:57.591173    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:15:57.591483 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:57.591239    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:15:58.591219911 +0000 UTC m=+37.028241635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:15:57.643718 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:57.643552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p7kl8"]
Jul 05 13:15:57.648568 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:15:57.648539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044cb6b3_47cc_419e_8326_05bed4594c21.slice/crio-442faaa78bdce29ec17df554c45eb59b0dc0af46ee8ff3b3b26e2a2a1b0a2f0f WatchSource:0}: Error finding container 442faaa78bdce29ec17df554c45eb59b0dc0af46ee8ff3b3b26e2a2a1b0a2f0f: Status 404 returned error can't find the container with id 442faaa78bdce29ec17df554c45eb59b0dc0af46ee8ff3b3b26e2a2a1b0a2f0f
Jul 05 13:15:58.106304 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.106276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:15:58.106452 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.106285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:15:58.108879 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.108858    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 13:15:58.109026 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.108858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-852z8\""
Jul 05 13:15:58.109133 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.109111    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 13:15:58.109801 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.109770    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 13:15:58.109902 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.109835    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgr78\""
Jul 05 13:15:58.481057 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.480964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p7kl8" event={"ID":"044cb6b3-47cc-419e-8326-05bed4594c21","Type":"ContainerStarted","Data":"442faaa78bdce29ec17df554c45eb59b0dc0af46ee8ff3b3b26e2a2a1b0a2f0f"}
Jul 05 13:15:58.484077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.484044    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5b1e411-1b12-4c47-8bcc-569d58b86fae" containerID="2aec582a96c455709e18d11838656e03b329add5ddee8f39ddd63540c0407217" exitCode=0
Jul 05 13:15:58.484222 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.484119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerDied","Data":"2aec582a96c455709e18d11838656e03b329add5ddee8f39ddd63540c0407217"}
Jul 05 13:15:58.597717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:58.597506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:15:58.597717 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:58.597619    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:15:58.598091 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:15:58.598059    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:16:00.59766181 +0000 UTC m=+39.034683515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:15:59.490474 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:59.490437    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5b1e411-1b12-4c47-8bcc-569d58b86fae" containerID="ed9b6a21e48b0e2c1b188d0e2f4a0e650cfc52bf3472e20ea190013a2d0cd4b4" exitCode=0
Jul 05 13:15:59.490982 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:15:59.490474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerDied","Data":"ed9b6a21e48b0e2c1b188d0e2f4a0e650cfc52bf3472e20ea190013a2d0cd4b4"}
Jul 05 13:16:00.494595 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:00.494517    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p7kl8" event={"ID":"044cb6b3-47cc-419e-8326-05bed4594c21","Type":"ContainerStarted","Data":"9c3da77f2f2856e2316f142f92c5e0627d6567dd4d99133de27a5a977424f927"}
Jul 05 13:16:00.497889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:00.497865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zclhg" event={"ID":"f5b1e411-1b12-4c47-8bcc-569d58b86fae","Type":"ContainerStarted","Data":"4cbb17b4ac888b493e49f8a6cf1fccdfbfe0c11b92250d3c6381f6b184bfb901"}
Jul 05 13:16:00.509984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:00.509945    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p7kl8" podStartSLOduration=2.119779305 podStartE2EDuration="4.509930428s" totalImagesPullingTime="2.390151123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:16:00.509486026 +0000 UTC m=+38.946507751" watchObservedRunningTime="2026-07-05 13:16:00.509930428 +0000 UTC m=+38.946952177"
Jul 05 13:16:00.531908 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:00.531868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zclhg" podStartSLOduration=7.52446985 podStartE2EDuration="37.531851825s" totalImagesPullingTime="30.007381975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:16:00.530709867 +0000 UTC m=+38.967731589" watchObservedRunningTime="2026-07-05 13:16:00.531851825 +0000 UTC m=+38.968873550"
Jul 05 13:16:00.612644 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:00.612608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:16:00.613088 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:00.613061    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:00.613219 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:00.613166    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:16:04.613143685 +0000 UTC m=+43.050165403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:16:04.643358 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:04.643323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:16:04.643775 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:04.643484    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:04.643775 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:04.643546    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:16:12.643529902 +0000 UTC m=+51.080551609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:16:12.698042 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:12.697996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:16:12.698516 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:12.698152    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:12.698516 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:12.698217    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:16:28.698200701 +0000 UTC m=+67.135222404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:16:23.478710 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:23.478661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nj8l7"
Jul 05 13:16:26.797790 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.797735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:16:26.798246 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.797804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:16:26.800622 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.800601    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 13:16:26.800694 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.800654    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 13:16:26.808804 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:26.808787    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 05 13:16:26.808861 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:26.808844    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:17:30.808827343 +0000 UTC m=+129.245849045 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : secret "metrics-daemon-secret" not found
Jul 05 13:16:26.811919 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.811893    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1144a9f-42a3-46cc-9c16-0b6bc954cd65-original-pull-secret\") pod \"global-pull-secret-syncer-gt6kj\" (UID: \"c1144a9f-42a3-46cc-9c16-0b6bc954cd65\") " pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:16:26.816867 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.816846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gt6kj"
Jul 05 13:16:26.898128 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.898097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:16:26.901140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.901117    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 13:16:26.912176 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.912151    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 13:16:26.922533 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.922513    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vjx\" (UniqueName: \"kubernetes.io/projected/330bad06-7513-4d1f-9850-7353655acb21-kube-api-access-b7vjx\") pod \"network-check-target-jrd7x\" (UID: \"330bad06-7513-4d1f-9850-7353655acb21\") " pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:16:26.926399 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.926378    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-852z8\""
Jul 05 13:16:26.934365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.934343    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:16:26.934457 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:26.934342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gt6kj"]
Jul 05 13:16:26.937918 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:16:26.937884    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1144a9f_42a3_46cc_9c16_0b6bc954cd65.slice/crio-99dadf2e0f0d48062ef0ef4c4577e8cee102d25ca6d9fcd4e373c0466f866e86 WatchSource:0}: Error finding container 99dadf2e0f0d48062ef0ef4c4577e8cee102d25ca6d9fcd4e373c0466f866e86: Status 404 returned error can't find the container with id 99dadf2e0f0d48062ef0ef4c4577e8cee102d25ca6d9fcd4e373c0466f866e86
Jul 05 13:16:27.052918 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:27.051599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrd7x"]
Jul 05 13:16:27.054401 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:16:27.054377    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330bad06_7513_4d1f_9850_7353655acb21.slice/crio-3d7f06af16791c1b3e7e835bca20b42d9778f1f9f6d4c2a7af2abd9a9b6a30b5 WatchSource:0}: Error finding container 3d7f06af16791c1b3e7e835bca20b42d9778f1f9f6d4c2a7af2abd9a9b6a30b5: Status 404 returned error can't find the container with id 3d7f06af16791c1b3e7e835bca20b42d9778f1f9f6d4c2a7af2abd9a9b6a30b5
Jul 05 13:16:27.558732 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:27.558686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gt6kj" event={"ID":"c1144a9f-42a3-46cc-9c16-0b6bc954cd65","Type":"ContainerStarted","Data":"99dadf2e0f0d48062ef0ef4c4577e8cee102d25ca6d9fcd4e373c0466f866e86"}
Jul 05 13:16:27.560365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:27.560335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrd7x" event={"ID":"330bad06-7513-4d1f-9850-7353655acb21","Type":"ContainerStarted","Data":"3d7f06af16791c1b3e7e835bca20b42d9778f1f9f6d4c2a7af2abd9a9b6a30b5"}
Jul 05 13:16:28.709123 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:28.709078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:16:28.709606 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:28.709239    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:28.709606 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:16:28.709315    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:17:00.709294739 +0000 UTC m=+99.146316452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:16:32.575158 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:32.575120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gt6kj" event={"ID":"c1144a9f-42a3-46cc-9c16-0b6bc954cd65","Type":"ContainerStarted","Data":"429aa740ea811948be9b910ed62a2e723477ec457dfbed8db0d01d20ff5e6359"}
Jul 05 13:16:32.576563 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:32.576540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrd7x" event={"ID":"330bad06-7513-4d1f-9850-7353655acb21","Type":"ContainerStarted","Data":"a47b70a41ed97b0047d5e123f6f50755dd90c098862a20374a98492706773602"}
Jul 05 13:16:32.576689 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:32.576678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:16:32.590707 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:32.590639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gt6kj" podStartSLOduration=64.828054831 podStartE2EDuration="1m9.590625974s" totalImagesPullingTime="4.762571143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:16:32.588891963 +0000 UTC m=+71.025913688" watchObservedRunningTime="2026-07-05 13:16:32.590625974 +0000 UTC m=+71.027647676"
Jul 05 13:16:32.602584 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:16:32.602541    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jrd7x" podStartSLOduration=65.959729329 podStartE2EDuration="1m10.602526555s" totalImagesPullingTime="4.642797226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:16:32.601846596 +0000 UTC m=+71.038868322" watchObservedRunningTime="2026-07-05 13:16:32.602526555 +0000 UTC m=+71.039548258"
Jul 05 13:17:00.557392 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.557268    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"]
Jul 05 13:17:00.559821 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.559797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.563199 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.563173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 05 13:17:00.563199 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.563191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 05 13:17:00.563395 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.563203    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 05 13:17:00.563395 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.563248    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cx5md\""
Jul 05 13:17:00.563553 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.563539    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 05 13:17:00.570597 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.570575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"]
Jul 05 13:17:00.619501 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.619472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33a1a04c-8cef-4c63-8b93-264c96cc8442-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bc446d76b-npqff\" (UID: \"33a1a04c-8cef-4c63-8b93-264c96cc8442\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.619656 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.619521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7vhh\" (UniqueName: \"kubernetes.io/projected/33a1a04c-8cef-4c63-8b93-264c96cc8442-kube-api-access-r7vhh\") pod \"managed-serviceaccount-addon-agent-7bc446d76b-npqff\" (UID: \"33a1a04c-8cef-4c63-8b93-264c96cc8442\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.720379 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.720339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:17:00.720379 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.720385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33a1a04c-8cef-4c63-8b93-264c96cc8442-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bc446d76b-npqff\" (UID: \"33a1a04c-8cef-4c63-8b93-264c96cc8442\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.720600 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.720415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7vhh\" (UniqueName: \"kubernetes.io/projected/33a1a04c-8cef-4c63-8b93-264c96cc8442-kube-api-access-r7vhh\") pod \"managed-serviceaccount-addon-agent-7bc446d76b-npqff\" (UID: \"33a1a04c-8cef-4c63-8b93-264c96cc8442\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.720600 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:17:00.720457    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:17:00.720600 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:17:00.720546    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:18:04.720526308 +0000 UTC m=+163.157548011 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:17:00.723089 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.723061    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33a1a04c-8cef-4c63-8b93-264c96cc8442-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bc446d76b-npqff\" (UID: \"33a1a04c-8cef-4c63-8b93-264c96cc8442\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.729311 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.729287    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7vhh\" (UniqueName: \"kubernetes.io/projected/33a1a04c-8cef-4c63-8b93-264c96cc8442-kube-api-access-r7vhh\") pod \"managed-serviceaccount-addon-agent-7bc446d76b-npqff\" (UID: \"33a1a04c-8cef-4c63-8b93-264c96cc8442\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.874983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.874884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"
Jul 05 13:17:00.993556 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:00.993526    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff"]
Jul 05 13:17:00.996379 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:17:00.996352    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33a1a04c_8cef_4c63_8b93_264c96cc8442.slice/crio-92f349ad90973ec11fa8da0b67234882191347064495ae11cb1bbed098f70f26 WatchSource:0}: Error finding container 92f349ad90973ec11fa8da0b67234882191347064495ae11cb1bbed098f70f26: Status 404 returned error can't find the container with id 92f349ad90973ec11fa8da0b67234882191347064495ae11cb1bbed098f70f26
Jul 05 13:17:01.648139 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:01.648105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff" event={"ID":"33a1a04c-8cef-4c63-8b93-264c96cc8442","Type":"ContainerStarted","Data":"92f349ad90973ec11fa8da0b67234882191347064495ae11cb1bbed098f70f26"}
Jul 05 13:17:03.582293 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:03.582257    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jrd7x"
Jul 05 13:17:04.657129 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:04.657091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff" event={"ID":"33a1a04c-8cef-4c63-8b93-264c96cc8442","Type":"ContainerStarted","Data":"7c8714bcbfe1fee981a411700743bc588c9bf235791e1e2db0f90330f01eda14"}
Jul 05 13:17:04.672710 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:04.672646    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff" podStartSLOduration=1.488742453 podStartE2EDuration="4.67263106s" totalImagesPullingTime="3.183888607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:17:04.671286855 +0000 UTC m=+103.108308580" watchObservedRunningTime="2026-07-05 13:17:04.67263106 +0000 UTC m=+103.109652785"
Jul 05 13:17:30.823068 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:17:30.823018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:17:30.823578 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:17:30.823187    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 05 13:17:30.823578 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:17:30.823258    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:32.823241769 +0000 UTC m=+251.260263473 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : secret "metrics-daemon-secret" not found
Jul 05 13:17:59.864226 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:17:59.864165    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvlkl" podUID="be43ce0d-dcd4-4ae1-b807-44d64600b3ad"
Jul 05 13:18:00.791324 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:18:00.791291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:18:01.118930 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:18:01.118821    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:18:04.748310 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:18:04.748274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:18:04.748737 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:18:04.748382    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:18:04.748737 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:18:04.748437    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls podName:be43ce0d-dcd4-4ae1-b807-44d64600b3ad nodeName:}" failed. No retries permitted until 2026-07-05 13:20:06.748423489 +0000 UTC m=+285.185445195 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls") pod "dns-default-gvlkl" (UID: "be43ce0d-dcd4-4ae1-b807-44d64600b3ad") : secret "dns-default-metrics-tls" not found
Jul 05 13:18:14.106780 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:18:14.106698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:19:04.940595 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:04.940560    2565 generic.go:356] "Generic (PLEG): container finished" podID="33a1a04c-8cef-4c63-8b93-264c96cc8442" containerID="7c8714bcbfe1fee981a411700743bc588c9bf235791e1e2db0f90330f01eda14" exitCode=255
Jul 05 13:19:04.941001 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:04.940635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff" event={"ID":"33a1a04c-8cef-4c63-8b93-264c96cc8442","Type":"ContainerDied","Data":"7c8714bcbfe1fee981a411700743bc588c9bf235791e1e2db0f90330f01eda14"}
Jul 05 13:19:04.946219 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:04.946200    2565 scope.go:117] "RemoveContainer" containerID="7c8714bcbfe1fee981a411700743bc588c9bf235791e1e2db0f90330f01eda14"
Jul 05 13:19:05.945046 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:05.945009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc446d76b-npqff" event={"ID":"33a1a04c-8cef-4c63-8b93-264c96cc8442","Type":"ContainerStarted","Data":"4f417e0893c90caaa1a613d6e80cadb079ae3a87743b6feefa889e1bd5225cd7"}
Jul 05 13:19:21.086737 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.086702    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6784f5cbdc-dltf9"]
Jul 05 13:19:21.089425 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.089410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.095696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.095281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 05 13:19:21.095696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.095358    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 05 13:19:21.095696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.095414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 05 13:19:21.095696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.095520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7xdnz\""
Jul 05 13:19:21.095696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.095540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 05 13:19:21.095970 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.095783    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 05 13:19:21.103970 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.103952    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 05 13:19:21.133737 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.133709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6784f5cbdc-dltf9"]
Jul 05 13:19:21.152155 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.152135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-default-certificate\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.152244 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.152169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.152244 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.152193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.152323 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.152295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-stats-auth\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.152363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.152331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467zr\" (UniqueName: \"kubernetes.io/projected/5177401f-c1db-4148-abc0-04c10d6f095e-kube-api-access-467zr\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.189720 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.189695    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"]
Jul 05 13:19:21.192513 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.192500    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:21.198486 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.197994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 05 13:19:21.198486 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.198048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"]
Jul 05 13:19:21.198486 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.198257    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6pz8d\""
Jul 05 13:19:21.198486 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.198257    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:19:21.198773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.198723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 05 13:19:21.200929 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.200913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.215292 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.215276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fcfs\""
Jul 05 13:19:21.215591 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.215572    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 05 13:19:21.215755 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.215740    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 05 13:19:21.215900 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.215883    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 05 13:19:21.225235 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.225215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"]
Jul 05 13:19:21.227809 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.227791    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 05 13:19:21.232918 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.232898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"]
Jul 05 13:19:21.252578 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.252691 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d0131df-7014-4ab3-b700-78663f0bd4e9-ca-trust-extracted\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.252691 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m554k\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-kube-api-access-m554k\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.252691 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:21.252820 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-trusted-ca\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.252820 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-bound-sa-token\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.252820 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.252803    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:21.75278277 +0000 UTC m=+240.189804473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : configmap references non-existent config key: service-ca.crt
Jul 05 13:19:21.252965 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-stats-auth\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.253022 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.252966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467zr\" (UniqueName: \"kubernetes.io/projected/5177401f-c1db-4148-abc0-04c10d6f095e-kube-api-access-467zr\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.253022 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.253001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-image-registry-private-configuration\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.253119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.253036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.253119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.253092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-installation-pull-secrets\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.253225 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.253132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-certificates\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.253225 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.253162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-default-certificate\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.253225 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.253205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztpr2\" (UniqueName: \"kubernetes.io/projected/eba3e5d4-26d1-43b5-b465-7655c5b32391-kube-api-access-ztpr2\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:21.253514 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.253239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.253514 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.253320    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 05 13:19:21.253514 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.253372    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:21.75335711 +0000 UTC m=+240.190378813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : secret "router-metrics-certs-default" not found
Jul 05 13:19:21.255224 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.255205    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-stats-auth\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.255386 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.255366    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-default-certificate\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.274076 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.274048    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-467zr\" (UniqueName: \"kubernetes.io/projected/5177401f-c1db-4148-abc0-04c10d6f095e-kube-api-access-467zr\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.353550 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-certificates\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.353550 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztpr2\" (UniqueName: \"kubernetes.io/projected/eba3e5d4-26d1-43b5-b465-7655c5b32391-kube-api-access-ztpr2\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:21.353744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d0131df-7014-4ab3-b700-78663f0bd4e9-ca-trust-extracted\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.353744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m554k\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-kube-api-access-m554k\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.353744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:21.353744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-trusted-ca\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.353744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-bound-sa-token\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.354001 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-image-registry-private-configuration\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.354001 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.354001 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.353813    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 05 13:19:21.354001 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-installation-pull-secrets\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.354001 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.353898    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls podName:eba3e5d4-26d1-43b5-b465-7655c5b32391 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:21.853866502 +0000 UTC m=+240.290888206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gs9qg" (UID: "eba3e5d4-26d1-43b5-b465-7655c5b32391") : secret "samples-operator-tls" not found
Jul 05 13:19:21.354001 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.353976    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d0131df-7014-4ab3-b700-78663f0bd4e9-ca-trust-extracted\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.354307 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.354045    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:21.354307 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.354058    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff6fbccc6-2bn6p: secret "image-registry-tls" not found
Jul 05 13:19:21.354307 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.354093    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls podName:8d0131df-7014-4ab3-b700-78663f0bd4e9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:21.854080351 +0000 UTC m=+240.291102054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls") pod "image-registry-7ff6fbccc6-2bn6p" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9") : secret "image-registry-tls" not found
Jul 05 13:19:21.354307 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.354144    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-certificates\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.354795 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.354773    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-trusted-ca\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.356097 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.356080    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-installation-pull-secrets\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.356155 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.356139    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-image-registry-private-configuration\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.372620 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.372588    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztpr2\" (UniqueName: \"kubernetes.io/projected/eba3e5d4-26d1-43b5-b465-7655c5b32391-kube-api-access-ztpr2\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:21.372730 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.372712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-bound-sa-token\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.376749 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.376730    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m554k\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-kube-api-access-m554k\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.757108 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.757016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.757279 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.757144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:21.757279 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.757197    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.757180492 +0000 UTC m=+241.194202196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : configmap references non-existent config key: service-ca.crt
Jul 05 13:19:21.757279 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.757247    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 05 13:19:21.757421 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.757315    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.757297455 +0000 UTC m=+241.194319172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : secret "router-metrics-certs-default" not found
Jul 05 13:19:21.858023 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.857990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:21.858232 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:21.858052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:21.858232 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.858132    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 05 13:19:21.858232 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.858194    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls podName:eba3e5d4-26d1-43b5-b465-7655c5b32391 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.858177844 +0000 UTC m=+241.295199547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gs9qg" (UID: "eba3e5d4-26d1-43b5-b465-7655c5b32391") : secret "samples-operator-tls" not found
Jul 05 13:19:21.858232 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.858140    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:21.858232 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.858234    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff6fbccc6-2bn6p: secret "image-registry-tls" not found
Jul 05 13:19:21.858402 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:21.858274    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls podName:8d0131df-7014-4ab3-b700-78663f0bd4e9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.858262958 +0000 UTC m=+241.295284661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls") pod "image-registry-7ff6fbccc6-2bn6p" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9") : secret "image-registry-tls" not found
Jul 05 13:19:22.764484 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:22.764374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:22.764484 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:22.764442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:22.765038 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.764513    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 05 13:19:22.765038 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.764599    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.76457007 +0000 UTC m=+243.201591776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : secret "router-metrics-certs-default" not found
Jul 05 13:19:22.765279 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.765241    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.765223209 +0000 UTC m=+243.202244927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : configmap references non-existent config key: service-ca.crt
Jul 05 13:19:22.866536 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:22.866496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:22.866731 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:22.866568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:22.866731 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.866645    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:22.866731 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.866657    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 05 13:19:22.866731 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.866681    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff6fbccc6-2bn6p: secret "image-registry-tls" not found
Jul 05 13:19:22.866731 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.866726    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls podName:eba3e5d4-26d1-43b5-b465-7655c5b32391 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.866712316 +0000 UTC m=+243.303734019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gs9qg" (UID: "eba3e5d4-26d1-43b5-b465-7655c5b32391") : secret "samples-operator-tls" not found
Jul 05 13:19:22.866918 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:22.866739    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls podName:8d0131df-7014-4ab3-b700-78663f0bd4e9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.866733431 +0000 UTC m=+243.303755134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls") pod "image-registry-7ff6fbccc6-2bn6p" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9") : secret "image-registry-tls" not found
Jul 05 13:19:24.779647 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:24.779603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:24.779647 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:24.779651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:24.780113 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.779760    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 05 13:19:24.780113 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.779831    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:28.779811091 +0000 UTC m=+247.216832794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : configmap references non-existent config key: service-ca.crt
Jul 05 13:19:24.780113 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.779855    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:28.779845436 +0000 UTC m=+247.216867139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : secret "router-metrics-certs-default" not found
Jul 05 13:19:24.880349 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:24.880319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:24.880518 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:24.880378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:24.880518 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.880466    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:24.880518 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.880478    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff6fbccc6-2bn6p: secret "image-registry-tls" not found
Jul 05 13:19:24.880629 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.880521    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls podName:8d0131df-7014-4ab3-b700-78663f0bd4e9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:28.880507755 +0000 UTC m=+247.317529459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls") pod "image-registry-7ff6fbccc6-2bn6p" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9") : secret "image-registry-tls" not found
Jul 05 13:19:24.880629 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.880468    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 05 13:19:24.880629 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:24.880593    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls podName:eba3e5d4-26d1-43b5-b465-7655c5b32391 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:28.880579218 +0000 UTC m=+247.317600920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gs9qg" (UID: "eba3e5d4-26d1-43b5-b465-7655c5b32391") : secret "samples-operator-tls" not found
Jul 05 13:19:26.095327 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.095291    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rzwsg"]
Jul 05 13:19:26.099625 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.099606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.103423 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.103396    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 05 13:19:26.104051 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.104036    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 05 13:19:26.104500 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.104482    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 05 13:19:26.104546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.104502    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 05 13:19:26.104732 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.104720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ztcxg\""
Jul 05 13:19:26.127331 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.127311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rzwsg"]
Jul 05 13:19:26.189322 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.189296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/133f08a0-ebc7-4d30-9ab5-d6a37661b609-data-volume\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.189452 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.189330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzkb\" (UniqueName: \"kubernetes.io/projected/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-api-access-zwzkb\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.189452 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.189387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.189562 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.189473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.189562 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.189494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/133f08a0-ebc7-4d30-9ab5-d6a37661b609-crio-socket\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.290791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.290757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.290791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.290791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/133f08a0-ebc7-4d30-9ab5-d6a37661b609-crio-socket\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.291028 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.290815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/133f08a0-ebc7-4d30-9ab5-d6a37661b609-data-volume\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.291028 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.290836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzkb\" (UniqueName: \"kubernetes.io/projected/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-api-access-zwzkb\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.291028 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.290908    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/133f08a0-ebc7-4d30-9ab5-d6a37661b609-crio-socket\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.291028 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.290920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.291028 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.290933    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:26.291028 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.291004    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:26.79098264 +0000 UTC m=+245.228004377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:26.291028 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.291026    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.291306 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.291084    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:26.791066767 +0000 UTC m=+245.228088474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.291306 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.291166    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/133f08a0-ebc7-4d30-9ab5-d6a37661b609-data-volume\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.306430 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.306411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzkb\" (UniqueName: \"kubernetes.io/projected/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-api-access-zwzkb\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.795342 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.795305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.795544 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:26.795420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:26.795544 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.795427    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.795544 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.795488    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.795469 +0000 UTC m=+246.232490706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.795719 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.795548    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:26.795719 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:26.795605    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.795589533 +0000 UTC m=+246.232611255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:27.802365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:27.802325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:27.802814 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:27.802417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:27.802814 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:27.802458    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:27.802814 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:27.802515    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:27.802814 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:27.802525    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.80250846 +0000 UTC m=+248.239530163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:27.802814 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:27.802553    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.802542355 +0000 UTC m=+248.239564059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:28.096550 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:28.096477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m99wq_d1863775-a053-442d-96ec-7c30f9e1c8f5/dns-node-resolver/0.log"
Jul 05 13:19:28.810087 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:28.810045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:28.810087 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:28.810087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:28.810509 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.810221    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 05 13:19:28.810509 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.810282    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:36.810264629 +0000 UTC m=+255.247286332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : configmap references non-existent config key: service-ca.crt
Jul 05 13:19:28.810509 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.810307    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:36.810299857 +0000 UTC m=+255.247321561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : secret "router-metrics-certs-default" not found
Jul 05 13:19:28.910653 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:28.910619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:28.910802 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:28.910720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:28.910802 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.910765    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:28.910802 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.910784    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff6fbccc6-2bn6p: secret "image-registry-tls" not found
Jul 05 13:19:28.910926 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.910836    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls podName:8d0131df-7014-4ab3-b700-78663f0bd4e9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:36.910822419 +0000 UTC m=+255.347844121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls") pod "image-registry-7ff6fbccc6-2bn6p" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9") : secret "image-registry-tls" not found
Jul 05 13:19:28.910926 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.910848    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 05 13:19:28.910926 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:28.910892    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls podName:eba3e5d4-26d1-43b5-b465-7655c5b32391 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:36.910880762 +0000 UTC m=+255.347902464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gs9qg" (UID: "eba3e5d4-26d1-43b5-b465-7655c5b32391") : secret "samples-operator-tls" not found
Jul 05 13:19:29.104913 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.104846    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k88r5_03cafd34-c293-4a41-ba5b-17ac1ab25e1a/node-ca/0.log"
Jul 05 13:19:29.390141 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.390065    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-82qsz"]
Jul 05 13:19:29.393200 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.393184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.410679 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.410648    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 05 13:19:29.410795 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.410691    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 05 13:19:29.410795 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.410762    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 05 13:19:29.411633 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.411618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6z4t8\""
Jul 05 13:19:29.411757 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.411742    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 05 13:19:29.436717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.436693    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-82qsz"]
Jul 05 13:19:29.515703 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.515679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh9jf\" (UniqueName: \"kubernetes.io/projected/3c34e461-8167-467d-a182-289e0bbc5401-kube-api-access-dh9jf\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.515844 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.515719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3c34e461-8167-467d-a182-289e0bbc5401-signing-key\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.515844 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.515746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3c34e461-8167-467d-a182-289e0bbc5401-signing-cabundle\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.616377 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.616333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3c34e461-8167-467d-a182-289e0bbc5401-signing-cabundle\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.616525 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.616503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh9jf\" (UniqueName: \"kubernetes.io/projected/3c34e461-8167-467d-a182-289e0bbc5401-kube-api-access-dh9jf\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.616563 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.616547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3c34e461-8167-467d-a182-289e0bbc5401-signing-key\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.617123 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.617103    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3c34e461-8167-467d-a182-289e0bbc5401-signing-cabundle\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.618934 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.618917    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3c34e461-8167-467d-a182-289e0bbc5401-signing-key\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.628091 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.628069    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh9jf\" (UniqueName: \"kubernetes.io/projected/3c34e461-8167-467d-a182-289e0bbc5401-kube-api-access-dh9jf\") pod \"service-ca-758f599c5-82qsz\" (UID: \"3c34e461-8167-467d-a182-289e0bbc5401\") " pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.701071 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.701017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-82qsz"
Jul 05 13:19:29.818476 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.818442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:29.818889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.818564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:29.818889 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:29.818568    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:29.818889 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:29.818634    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:29.818889 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:29.818714    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:33.81869302 +0000 UTC m=+252.255714746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:29.818889 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:29.818732    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:33.818725032 +0000 UTC m=+252.255746738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:29.844542 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.844504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-82qsz"]
Jul 05 13:19:29.848166 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:19:29.848142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c34e461_8167_467d_a182_289e0bbc5401.slice/crio-3bb480768b19e99952dc1bb0f09a629f3a48e431a7c7fe440a82efbd6b785ef1 WatchSource:0}: Error finding container 3bb480768b19e99952dc1bb0f09a629f3a48e431a7c7fe440a82efbd6b785ef1: Status 404 returned error can't find the container with id 3bb480768b19e99952dc1bb0f09a629f3a48e431a7c7fe440a82efbd6b785ef1
Jul 05 13:19:29.895793 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:29.895771    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p7kl8_044cb6b3-47cc-419e-8326-05bed4594c21/serve-healthcheck-canary/0.log"
Jul 05 13:19:30.013257 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:30.013175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-82qsz" event={"ID":"3c34e461-8167-467d-a182-289e0bbc5401","Type":"ContainerStarted","Data":"3bb480768b19e99952dc1bb0f09a629f3a48e431a7c7fe440a82efbd6b785ef1"}
Jul 05 13:19:32.019325 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:32.019291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-82qsz" event={"ID":"3c34e461-8167-467d-a182-289e0bbc5401","Type":"ContainerStarted","Data":"1ea5171252668f004b0c3f9f41a881de191351777e04e59a54caf3f50dacb5e3"}
Jul 05 13:19:32.047396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:32.047335    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-82qsz" podStartSLOduration=1.431810847 podStartE2EDuration="3.04731605s" totalImagesPullingTime="1.615505203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:32.0465864 +0000 UTC m=+250.483608125" watchObservedRunningTime="2026-07-05 13:19:32.04731605 +0000 UTC m=+250.484337775"
Jul 05 13:19:32.846107 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:32.846067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:19:32.846321 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:32.846265    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 05 13:19:32.846379 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:32.846355    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs podName:7cda9f2c-b7c7-421d-93a1-c99170d528c7 nodeName:}" failed. No retries permitted until 2026-07-05 13:21:34.846335085 +0000 UTC m=+373.283356792 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs") pod "network-metrics-daemon-m8wgm" (UID: "7cda9f2c-b7c7-421d-93a1-c99170d528c7") : secret "metrics-daemon-secret" not found
Jul 05 13:19:33.855046 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:33.855015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:33.855460 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:33.855072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:33.855460 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:33.855164    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:33.855460 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:33.855182    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:33.855460 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:33.855228    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:41.855212198 +0000 UTC m=+260.292233902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:33.855460 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:33.855242    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:41.855236047 +0000 UTC m=+260.292257750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:36.877201 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:36.877162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:36.877201 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:36.877204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:36.877853 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:36.877330    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle podName:5177401f-c1db-4148-abc0-04c10d6f095e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:52.877317271 +0000 UTC m=+271.314338974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle") pod "router-default-6784f5cbdc-dltf9" (UID: "5177401f-c1db-4148-abc0-04c10d6f095e") : configmap references non-existent config key: service-ca.crt
Jul 05 13:19:36.879682 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:36.879641    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5177401f-c1db-4148-abc0-04c10d6f095e-metrics-certs\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:36.977932 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:36.977895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:36.978084 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:36.978066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:36.980231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:36.980204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"image-registry-7ff6fbccc6-2bn6p\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") " pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:36.980349 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:36.980209    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba3e5d4-26d1-43b5-b465-7655c5b32391-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gs9qg\" (UID: \"eba3e5d4-26d1-43b5-b465-7655c5b32391\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:37.104820 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:37.104792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6pz8d\""
Jul 05 13:19:37.110202 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:37.110186    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fcfs\""
Jul 05 13:19:37.111194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:37.111181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"
Jul 05 13:19:37.118008 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:37.117993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:37.265869 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:37.265839    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg"]
Jul 05 13:19:37.319789 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:37.319765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"]
Jul 05 13:19:37.325721 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:19:37.325694    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0131df_7014_4ab3_b700_78663f0bd4e9.slice/crio-e3f1648bd1f5400c9e84328fbf5ec0e51cb7e7a09b28aa2ff12066812bff9d57 WatchSource:0}: Error finding container e3f1648bd1f5400c9e84328fbf5ec0e51cb7e7a09b28aa2ff12066812bff9d57: Status 404 returned error can't find the container with id e3f1648bd1f5400c9e84328fbf5ec0e51cb7e7a09b28aa2ff12066812bff9d57
Jul 05 13:19:38.038047 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:38.038006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" event={"ID":"8d0131df-7014-4ab3-b700-78663f0bd4e9","Type":"ContainerStarted","Data":"f909c60a0dce5f3ca3706e0b2665aee063895f551553f2a63b6fd0f9645f20d8"}
Jul 05 13:19:38.038521 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:38.038071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" event={"ID":"8d0131df-7014-4ab3-b700-78663f0bd4e9","Type":"ContainerStarted","Data":"e3f1648bd1f5400c9e84328fbf5ec0e51cb7e7a09b28aa2ff12066812bff9d57"}
Jul 05 13:19:38.038521 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:38.038173    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:19:38.039252 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:38.039229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg" event={"ID":"eba3e5d4-26d1-43b5-b465-7655c5b32391","Type":"ContainerStarted","Data":"6921926da94bacb1071b5f6fc898ad6144fe6ad9a486826f599e1da64f858211"}
Jul 05 13:19:39.044316 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:39.044284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg" event={"ID":"eba3e5d4-26d1-43b5-b465-7655c5b32391","Type":"ContainerStarted","Data":"1c94a789195ee0822346618da1718cb43114a5282a1c07e6bf927ab36fca0e77"}
Jul 05 13:19:39.044729 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:39.044348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg" event={"ID":"eba3e5d4-26d1-43b5-b465-7655c5b32391","Type":"ContainerStarted","Data":"36a9e6cd753733fa92ba2c0e4672dc02f5a24f536d1868e0e859b81455ce1e64"}
Jul 05 13:19:39.090080 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:39.090006    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" podStartSLOduration=18.08998543 podStartE2EDuration="18.08998543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:38.079047692 +0000 UTC m=+256.516069417" watchObservedRunningTime="2026-07-05 13:19:39.08998543 +0000 UTC m=+257.527007158"
Jul 05 13:19:41.920282 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:41.920244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:41.920690 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:41.920320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:41.920690 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:41.920420    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:41.920690 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:19:41.920466    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls podName:133f08a0-ebc7-4d30-9ab5-d6a37661b609 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:57.920453 +0000 UTC m=+276.357474702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rzwsg" (UID: "133f08a0-ebc7-4d30-9ab5-d6a37661b609") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:41.920828 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:41.920807    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/133f08a0-ebc7-4d30-9ab5-d6a37661b609-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:52.900458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:52.900383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:52.901022 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:52.901001    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5177401f-c1db-4148-abc0-04c10d6f095e-service-ca-bundle\") pod \"router-default-6784f5cbdc-dltf9\" (UID: \"5177401f-c1db-4148-abc0-04c10d6f095e\") " pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:53.200844 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:53.200767    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7xdnz\""
Jul 05 13:19:53.208948 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:53.208929    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:53.361889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:53.361841    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gs9qg" podStartSLOduration=31.003901083 podStartE2EDuration="32.361823749s" totalImagesPullingTime="1.357922666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:39.089073855 +0000 UTC m=+257.526095579" watchObservedRunningTime="2026-07-05 13:19:53.361823749 +0000 UTC m=+271.798845474"
Jul 05 13:19:53.362347 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:53.362331    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6784f5cbdc-dltf9"]
Jul 05 13:19:53.364991 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:19:53.364965    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5177401f_c1db_4148_abc0_04c10d6f095e.slice/crio-3a9f10f9c242583280e7c285a87b2f158086cff073f65e60a1d94f7049fd66e6 WatchSource:0}: Error finding container 3a9f10f9c242583280e7c285a87b2f158086cff073f65e60a1d94f7049fd66e6: Status 404 returned error can't find the container with id 3a9f10f9c242583280e7c285a87b2f158086cff073f65e60a1d94f7049fd66e6
Jul 05 13:19:54.087199 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:54.087160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6784f5cbdc-dltf9" event={"ID":"5177401f-c1db-4148-abc0-04c10d6f095e","Type":"ContainerStarted","Data":"c177cf2287a04cf403868635bfeb37abdb1f2990a5d2342dc516d708995979ff"}
Jul 05 13:19:54.087589 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:54.087255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6784f5cbdc-dltf9" event={"ID":"5177401f-c1db-4148-abc0-04c10d6f095e","Type":"ContainerStarted","Data":"3a9f10f9c242583280e7c285a87b2f158086cff073f65e60a1d94f7049fd66e6"}
Jul 05 13:19:54.134428 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:54.134378    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6784f5cbdc-dltf9" podStartSLOduration=33.134364735 podStartE2EDuration="33.134364735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:54.131242995 +0000 UTC m=+272.568264717" watchObservedRunningTime="2026-07-05 13:19:54.134364735 +0000 UTC m=+272.571386459"
Jul 05 13:19:54.210181 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:54.210144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:54.212866 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:54.212841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:55.090129 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:55.090099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:55.091266 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:55.091246    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6784f5cbdc-dltf9"
Jul 05 13:19:57.122339 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:57.122310    2565 patch_prober.go:28] interesting pod/image-registry-7ff6fbccc6-2bn6p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 05 13:19:57.122716 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:57.122355    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:19:57.938703 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:57.938655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:57.940903 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:57.940875    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/133f08a0-ebc7-4d30-9ab5-d6a37661b609-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rzwsg\" (UID: \"133f08a0-ebc7-4d30-9ab5-d6a37661b609\") " pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:58.209559 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:58.209483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rzwsg"
Jul 05 13:19:58.335699 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:58.335654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rzwsg"]
Jul 05 13:19:58.338513 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:19:58.338484    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133f08a0_ebc7_4d30_9ab5_d6a37661b609.slice/crio-96ed6b4dcf05ec63de05a74eaa01199f1fce3496d4c8b68a79eb93b6d3adebce WatchSource:0}: Error finding container 96ed6b4dcf05ec63de05a74eaa01199f1fce3496d4c8b68a79eb93b6d3adebce: Status 404 returned error can't find the container with id 96ed6b4dcf05ec63de05a74eaa01199f1fce3496d4c8b68a79eb93b6d3adebce
Jul 05 13:19:59.050496 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:59.050461    2565 patch_prober.go:28] interesting pod/image-registry-7ff6fbccc6-2bn6p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 05 13:19:59.050694 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:59.050527    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:19:59.104303 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:19:59.104201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzwsg" event={"ID":"133f08a0-ebc7-4d30-9ab5-d6a37661b609","Type":"ContainerStarted","Data":"96ed6b4dcf05ec63de05a74eaa01199f1fce3496d4c8b68a79eb93b6d3adebce"}
Jul 05 13:20:00.014747 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.014715    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"]
Jul 05 13:20:00.019992 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.019933    2565 patch_prober.go:28] interesting pod/image-registry-7ff6fbccc6-2bn6p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 05 13:20:00.020119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.019993    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:20:00.169389 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.169354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5849f668b-t9j28"]
Jul 05 13:20:00.177836 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.177811    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.184274 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.184214    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5849f668b-t9j28"]
Jul 05 13:20:00.257895 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.257810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5271c2f2-229b-4720-95bc-cd97206124df-installation-pull-secrets\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.257895 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.257861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvvbs\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-kube-api-access-nvvbs\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.258095 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.257936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5271c2f2-229b-4720-95bc-cd97206124df-image-registry-private-configuration\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.258095 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.257995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5271c2f2-229b-4720-95bc-cd97206124df-trusted-ca\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.258095 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.258030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-bound-sa-token\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.258095 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.258088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5271c2f2-229b-4720-95bc-cd97206124df-ca-trust-extracted\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.258223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.258124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5271c2f2-229b-4720-95bc-cd97206124df-registry-certificates\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.258223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.258162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-registry-tls\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359514 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-bound-sa-token\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359699 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5271c2f2-229b-4720-95bc-cd97206124df-ca-trust-extracted\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359699 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5271c2f2-229b-4720-95bc-cd97206124df-registry-certificates\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359699 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-registry-tls\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359699 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5271c2f2-229b-4720-95bc-cd97206124df-installation-pull-secrets\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359942 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvvbs\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-kube-api-access-nvvbs\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359942 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5271c2f2-229b-4720-95bc-cd97206124df-image-registry-private-configuration\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.359942 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.359785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5271c2f2-229b-4720-95bc-cd97206124df-trusted-ca\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.360097 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.360014    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5271c2f2-229b-4720-95bc-cd97206124df-ca-trust-extracted\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.360727 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.360655    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5271c2f2-229b-4720-95bc-cd97206124df-registry-certificates\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.360852 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.360819    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5271c2f2-229b-4720-95bc-cd97206124df-trusted-ca\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.362533 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.362509    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5271c2f2-229b-4720-95bc-cd97206124df-image-registry-private-configuration\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.362724 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.362700    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5271c2f2-229b-4720-95bc-cd97206124df-installation-pull-secrets\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.362838 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.362809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-registry-tls\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.369769 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.369735    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-bound-sa-token\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.370131 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.370107    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvvbs\" (UniqueName: \"kubernetes.io/projected/5271c2f2-229b-4720-95bc-cd97206124df-kube-api-access-nvvbs\") pod \"image-registry-5849f668b-t9j28\" (UID: \"5271c2f2-229b-4720-95bc-cd97206124df\") " pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:00.489481 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:00.489440    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:02.315366 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:02.315334    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5849f668b-t9j28"]
Jul 05 13:20:02.318307 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:20:02.318282    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5271c2f2_229b_4720_95bc_cd97206124df.slice/crio-8008ef756268a8d1c71f2769d230a895075679e39dc107374fae994885afab0b WatchSource:0}: Error finding container 8008ef756268a8d1c71f2769d230a895075679e39dc107374fae994885afab0b: Status 404 returned error can't find the container with id 8008ef756268a8d1c71f2769d230a895075679e39dc107374fae994885afab0b
Jul 05 13:20:03.119879 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:03.119842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5849f668b-t9j28" event={"ID":"5271c2f2-229b-4720-95bc-cd97206124df","Type":"ContainerStarted","Data":"35faaad0b9ef0ca90a2763beb558310dcadcc72dd503069b907a61e91bf4fbec"}
Jul 05 13:20:03.119980 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:03.119905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5849f668b-t9j28" event={"ID":"5271c2f2-229b-4720-95bc-cd97206124df","Type":"ContainerStarted","Data":"8008ef756268a8d1c71f2769d230a895075679e39dc107374fae994885afab0b"}
Jul 05 13:20:03.120562 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:03.120538    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:03.122994 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:03.122971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzwsg" event={"ID":"133f08a0-ebc7-4d30-9ab5-d6a37661b609","Type":"ContainerStarted","Data":"a628a7aa4d010a9eae4d909561c5b8c51b2f4320cd64a8f3e99ba8a460d8cbcd"}
Jul 05 13:20:03.123095 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:03.123016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzwsg" event={"ID":"133f08a0-ebc7-4d30-9ab5-d6a37661b609","Type":"ContainerStarted","Data":"0f074c015628390591d17ec92e0796be706308057cd444bdc03e5641b11885e3"}
Jul 05 13:20:03.792376 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:20:03.792323    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvlkl" podUID="be43ce0d-dcd4-4ae1-b807-44d64600b3ad"
Jul 05 13:20:04.127153 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:04.127073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:20:06.136322 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.136285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rzwsg" event={"ID":"133f08a0-ebc7-4d30-9ab5-d6a37661b609","Type":"ContainerStarted","Data":"1cd520b16ef5076595a7f2b15ae20dd57e35739ddeec27907cab6bb2240e2a52"}
Jul 05 13:20:06.167366 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.167321    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5849f668b-t9j28" podStartSLOduration=6.167305311 podStartE2EDuration="6.167305311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:03.161842482 +0000 UTC m=+281.598864208" watchObservedRunningTime="2026-07-05 13:20:06.167305311 +0000 UTC m=+284.604327036"
Jul 05 13:20:06.815872 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.815836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:20:06.818113 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.818095    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be43ce0d-dcd4-4ae1-b807-44d64600b3ad-metrics-tls\") pod \"dns-default-gvlkl\" (UID: \"be43ce0d-dcd4-4ae1-b807-44d64600b3ad\") " pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:20:06.831938 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.831917    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9gzst\""
Jul 05 13:20:06.838677 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.838655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:20:06.968263 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.968208    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rzwsg" podStartSLOduration=33.885992112 podStartE2EDuration="40.968190284s" totalImagesPullingTime="7.082198172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:19:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:06.169263114 +0000 UTC m=+284.606284840" watchObservedRunningTime="2026-07-05 13:20:06.968190284 +0000 UTC m=+285.405212009"
Jul 05 13:20:06.968621 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:06.968603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvlkl"]
Jul 05 13:20:06.971337 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:20:06.971310    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe43ce0d_dcd4_4ae1_b807_44d64600b3ad.slice/crio-f4e44f9d9f4406d5df51a6d5e3dd96d1e49d7839f3d64f7956a74c04c936a32f WatchSource:0}: Error finding container f4e44f9d9f4406d5df51a6d5e3dd96d1e49d7839f3d64f7956a74c04c936a32f: Status 404 returned error can't find the container with id f4e44f9d9f4406d5df51a6d5e3dd96d1e49d7839f3d64f7956a74c04c936a32f
Jul 05 13:20:07.140592 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:07.140519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvlkl" event={"ID":"be43ce0d-dcd4-4ae1-b807-44d64600b3ad","Type":"ContainerStarted","Data":"f4e44f9d9f4406d5df51a6d5e3dd96d1e49d7839f3d64f7956a74c04c936a32f"}
Jul 05 13:20:09.148342 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:09.148313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvlkl" event={"ID":"be43ce0d-dcd4-4ae1-b807-44d64600b3ad","Type":"ContainerStarted","Data":"ebaf0cc0de0f534d3b082c6534e92ddd1a6991bb1790659bcd91d406fc136cf8"}
Jul 05 13:20:09.148796 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:09.148359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvlkl" event={"ID":"be43ce0d-dcd4-4ae1-b807-44d64600b3ad","Type":"ContainerStarted","Data":"2d56838cd5eda71d6f04dc13fe7f10e8255e3f7c8d369029f1aa83602c2d4104"}
Jul 05 13:20:09.148796 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:09.148473    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:20:10.019523 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:10.019487    2565 patch_prober.go:28] interesting pod/image-registry-7ff6fbccc6-2bn6p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 05 13:20:10.019696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:10.019542    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:20:11.442409 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.442339    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvlkl" podStartSLOduration=253.964393836 podStartE2EDuration="4m15.442316293s" totalImagesPullingTime="1.477922457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:09.180995228 +0000 UTC m=+287.618016953" watchObservedRunningTime="2026-07-05 13:20:11.442316293 +0000 UTC m=+289.879338020"
Jul 05 13:20:11.443926 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.443903    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"]
Jul 05 13:20:11.447631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.447613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.455084 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.455009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 05 13:20:11.455249 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.455232    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 05 13:20:11.456060 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.455856    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 05 13:20:11.456528 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.456506    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 05 13:20:11.466054 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.465915    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 05 13:20:11.466387 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.466372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cscwl\""
Jul 05 13:20:11.487530 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.487506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"]
Jul 05 13:20:11.519746 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.519718    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"]
Jul 05 13:20:11.522617 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.522603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.532227 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.532206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 05 13:20:11.532405 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.532270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 05 13:20:11.532489 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.532279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hhfkh\""
Jul 05 13:20:11.532610 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.532290    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 05 13:20:11.552848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.552826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"]
Jul 05 13:20:11.554827 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.554805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f023722c-18c8-4068-ac88-735a927ebf12-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.554941 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.554848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t94wp\" (UniqueName: \"kubernetes.io/projected/f023722c-18c8-4068-ac88-735a927ebf12-kube-api-access-t94wp\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.554941 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.554906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.555052 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.554948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.655991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.655955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.656150 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.655999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.656150 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.656150 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.656297 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f07896df-7828-4395-922f-7dca0d36163a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.656297 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:20:11.656251    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 05 13:20:11.656297 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhzg\" (UniqueName: \"kubernetes.io/projected/f07896df-7828-4395-922f-7dca0d36163a-kube-api-access-pmhzg\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.656451 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f023722c-18c8-4068-ac88-735a927ebf12-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.656451 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t94wp\" (UniqueName: \"kubernetes.io/projected/f023722c-18c8-4068-ac88-735a927ebf12-kube-api-access-t94wp\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.656451 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:20:11.656382    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-tls podName:f023722c-18c8-4068-ac88-735a927ebf12 nodeName:}" failed. No retries permitted until 2026-07-05 13:20:12.156338916 +0000 UTC m=+290.593360633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-4pcq5" (UID: "f023722c-18c8-4068-ac88-735a927ebf12") : secret "openshift-state-metrics-tls" not found
Jul 05 13:20:11.656607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f07896df-7828-4395-922f-7dca0d36163a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.656607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.656554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.657039 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.657010    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f023722c-18c8-4068-ac88-735a927ebf12-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.658974 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.658943    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.683277 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.683249    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bj277"]
Jul 05 13:20:11.684135 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.684113    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t94wp\" (UniqueName: \"kubernetes.io/projected/f023722c-18c8-4068-ac88-735a927ebf12-kube-api-access-t94wp\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:11.688167 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.688143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.691047 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.691029    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 05 13:20:11.691570 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.691533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 05 13:20:11.693771 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.693719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2xspd\""
Jul 05 13:20:11.693771 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.693739    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 05 13:20:11.757570 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.757712 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f07896df-7828-4395-922f-7dca0d36163a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.757712 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhzg\" (UniqueName: \"kubernetes.io/projected/f07896df-7828-4395-922f-7dca0d36163a-kube-api-access-pmhzg\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.757840 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-sys\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.757902 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f07896df-7828-4395-922f-7dca0d36163a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.757902 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758000 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de5fd667-43bc-4f86-8066-0250989bca1f-metrics-client-ca\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758000 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.758000 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f07896df-7828-4395-922f-7dca0d36163a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.758140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.757995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.758140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-tls\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-root\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6pwg\" (UniqueName: \"kubernetes.io/projected/de5fd667-43bc-4f86-8066-0250989bca1f-kube-api-access-g6pwg\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-textfile\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758356 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758356 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-wtmp\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.758475 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758371    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.758475 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.758465    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f07896df-7828-4395-922f-7dca0d36163a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.760429 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.760407    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.760722 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.760705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f07896df-7828-4395-922f-7dca0d36163a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.773119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.773099    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhzg\" (UniqueName: \"kubernetes.io/projected/f07896df-7828-4395-922f-7dca0d36163a-kube-api-access-pmhzg\") pod \"kube-state-metrics-7c9dbb8b7d-dz4jv\" (UID: \"f07896df-7828-4395-922f-7dca0d36163a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.831873 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.831850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"
Jul 05 13:20:11.859592 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859719 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de5fd667-43bc-4f86-8066-0250989bca1f-metrics-client-ca\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859719 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-tls\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859719 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-root\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6pwg\" (UniqueName: \"kubernetes.io/projected/de5fd667-43bc-4f86-8066-0250989bca1f-kube-api-access-g6pwg\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-textfile\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-wtmp\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-root\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.859877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-sys\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.860174 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859951    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-wtmp\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.860174 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.859992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de5fd667-43bc-4f86-8066-0250989bca1f-sys\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.860279 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.860265    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-textfile\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.860279 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.860266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de5fd667-43bc-4f86-8066-0250989bca1f-metrics-client-ca\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.860377 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.860351    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.862354 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.862332    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.862607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.862588    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de5fd667-43bc-4f86-8066-0250989bca1f-node-exporter-tls\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:11.885902 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:11.885873    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6pwg\" (UniqueName: \"kubernetes.io/projected/de5fd667-43bc-4f86-8066-0250989bca1f-kube-api-access-g6pwg\") pod \"node-exporter-bj277\" (UID: \"de5fd667-43bc-4f86-8066-0250989bca1f\") " pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:12.001426 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.001352    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bj277"
Jul 05 13:20:12.013092 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:20:12.013069    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5fd667_43bc_4f86_8066_0250989bca1f.slice/crio-d2aad3ee675d4d7040256e905939f410347a33ff192b975ef0df735c0d0388b5 WatchSource:0}: Error finding container d2aad3ee675d4d7040256e905939f410347a33ff192b975ef0df735c0d0388b5: Status 404 returned error can't find the container with id d2aad3ee675d4d7040256e905939f410347a33ff192b975ef0df735c0d0388b5
Jul 05 13:20:12.028754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.028728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv"]
Jul 05 13:20:12.031547 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:20:12.031525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf07896df_7828_4395_922f_7dca0d36163a.slice/crio-570d6330695bbbadb13874581b714b6e325a50176d22484f06504a37b74b6155 WatchSource:0}: Error finding container 570d6330695bbbadb13874581b714b6e325a50176d22484f06504a37b74b6155: Status 404 returned error can't find the container with id 570d6330695bbbadb13874581b714b6e325a50176d22484f06504a37b74b6155
Jul 05 13:20:12.158384 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.158349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bj277" event={"ID":"de5fd667-43bc-4f86-8066-0250989bca1f","Type":"ContainerStarted","Data":"d2aad3ee675d4d7040256e905939f410347a33ff192b975ef0df735c0d0388b5"}
Jul 05 13:20:12.159458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.159430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv" event={"ID":"f07896df-7828-4395-922f-7dca0d36163a","Type":"ContainerStarted","Data":"570d6330695bbbadb13874581b714b6e325a50176d22484f06504a37b74b6155"}
Jul 05 13:20:12.161866 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.161848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:12.164068 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.164051    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f023722c-18c8-4068-ac88-735a927ebf12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4pcq5\" (UID: \"f023722c-18c8-4068-ac88-735a927ebf12\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:12.359363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.359333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"
Jul 05 13:20:12.562194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:12.562156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5"]
Jul 05 13:20:12.566654 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:20:12.566556    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf023722c_18c8_4068_ac88_735a927ebf12.slice/crio-dafa1b6e7a8c28389f465659d6c60f5c383284a56ef94cd5f9110a6250640da5 WatchSource:0}: Error finding container dafa1b6e7a8c28389f465659d6c60f5c383284a56ef94cd5f9110a6250640da5: Status 404 returned error can't find the container with id dafa1b6e7a8c28389f465659d6c60f5c383284a56ef94cd5f9110a6250640da5
Jul 05 13:20:13.167416 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:13.167367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5" event={"ID":"f023722c-18c8-4068-ac88-735a927ebf12","Type":"ContainerStarted","Data":"e1216a826ba170696b39240e95d80a39de848e31150991bb8d3c52f8f78a80a5"}
Jul 05 13:20:13.167588 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:13.167456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5" event={"ID":"f023722c-18c8-4068-ac88-735a927ebf12","Type":"ContainerStarted","Data":"f8d92e78e355b5838bbd14f548f580f08f1cd5b1d036579e90cf9311f530e845"}
Jul 05 13:20:13.167588 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:13.167492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5" event={"ID":"f023722c-18c8-4068-ac88-735a927ebf12","Type":"ContainerStarted","Data":"dafa1b6e7a8c28389f465659d6c60f5c383284a56ef94cd5f9110a6250640da5"}
Jul 05 13:20:14.172330 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.172293    2565 generic.go:356] "Generic (PLEG): container finished" podID="de5fd667-43bc-4f86-8066-0250989bca1f" containerID="fdee80bb25950eff1cfef32c19448ffcb174b817ac53cda21d7bdeea19926ff2" exitCode=0
Jul 05 13:20:14.172757 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.172382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bj277" event={"ID":"de5fd667-43bc-4f86-8066-0250989bca1f","Type":"ContainerDied","Data":"fdee80bb25950eff1cfef32c19448ffcb174b817ac53cda21d7bdeea19926ff2"}
Jul 05 13:20:14.174568 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.174541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv" event={"ID":"f07896df-7828-4395-922f-7dca0d36163a","Type":"ContainerStarted","Data":"d2de3d9b91449f4c0333bdf0b72f3e82f147add837f4ef7271baa7b766e8782f"}
Jul 05 13:20:14.174707 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.174600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv" event={"ID":"f07896df-7828-4395-922f-7dca0d36163a","Type":"ContainerStarted","Data":"d51271a500ba27e37931f1d8a4aa16586e60a1cc5acf049a7a3e3ddadc3db939"}
Jul 05 13:20:14.174707 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.174633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv" event={"ID":"f07896df-7828-4395-922f-7dca0d36163a","Type":"ContainerStarted","Data":"94e187b978988e5670f8db77bb0eb6a45403517a8966e5ff866c214acad0452e"}
Jul 05 13:20:14.176496 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.176476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5" event={"ID":"f023722c-18c8-4068-ac88-735a927ebf12","Type":"ContainerStarted","Data":"62b33d99a49942a6f17692f0aa79a9af2f79b5bb884f0dcb43daa8ac64ffd2ca"}
Jul 05 13:20:14.279388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.279328    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4pcq5" podStartSLOduration=2.346751398 podStartE2EDuration="3.279307907s" totalImagesPullingTime="932.556509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:14.277938964 +0000 UTC m=+292.714960688" watchObservedRunningTime="2026-07-05 13:20:14.279307907 +0000 UTC m=+292.716329633"
Jul 05 13:20:14.329717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:14.329641    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dz4jv" podStartSLOduration=1.72732833 podStartE2EDuration="3.329626547s" totalImagesPullingTime="1.602298217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:14.32935982 +0000 UTC m=+292.766381546" watchObservedRunningTime="2026-07-05 13:20:14.329626547 +0000 UTC m=+292.766648271"
Jul 05 13:20:15.183492 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:15.183452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bj277" event={"ID":"de5fd667-43bc-4f86-8066-0250989bca1f","Type":"ContainerStarted","Data":"e00e886e5b7f790015424970facc8ebe99d0a129f06626a4347b05719e83b666"}
Jul 05 13:20:15.183964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:15.183520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bj277" event={"ID":"de5fd667-43bc-4f86-8066-0250989bca1f","Type":"ContainerStarted","Data":"f48f26759a597f0c12b43303a08d83bcee1d9157daf3b110de411015903d1e16"}
Jul 05 13:20:16.406066 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.406009    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bj277" podStartSLOduration=3.706686402 podStartE2EDuration="5.405992906s" totalImagesPullingTime="1.618042749s" totalInitContainerRuntime="81.263755ms" isStatefulPod=true podCreationTimestamp="2026-07-05 13:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:15.223263005 +0000 UTC m=+293.660284743" watchObservedRunningTime="2026-07-05 13:20:16.405992906 +0000 UTC m=+294.843014631"
Jul 05 13:20:16.407332 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.407306    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d876fbd96-sbg6z"]
Jul 05 13:20:16.410469 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.410449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.425258 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.425239    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8qv9579f488u8\""
Jul 05 13:20:16.425370 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.425254    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 05 13:20:16.425370 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.425245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 05 13:20:16.425370 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.425244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 05 13:20:16.425370 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.425245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vw25c\""
Jul 05 13:20:16.425370 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.425318    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 05 13:20:16.438865 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.438843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d876fbd96-sbg6z"]
Jul 05 13:20:16.501963 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.501938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cf7d8d32-c9fe-4d13-9067-7728d6bee909-metrics-server-audit-profiles\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.502075 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.501972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-secret-metrics-server-tls\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.502075 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.501991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7d8d32-c9fe-4d13-9067-7728d6bee909-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.502075 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.502031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbw2\" (UniqueName: \"kubernetes.io/projected/cf7d8d32-c9fe-4d13-9067-7728d6bee909-kube-api-access-lkbw2\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.502075 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.502062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cf7d8d32-c9fe-4d13-9067-7728d6bee909-audit-log\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.502220 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.502100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-secret-metrics-server-client-certs\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.502220 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.502130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-client-ca-bundle\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603349 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-client-ca-bundle\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603485 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cf7d8d32-c9fe-4d13-9067-7728d6bee909-metrics-server-audit-profiles\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603485 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-secret-metrics-server-tls\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603485 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7d8d32-c9fe-4d13-9067-7728d6bee909-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbw2\" (UniqueName: \"kubernetes.io/projected/cf7d8d32-c9fe-4d13-9067-7728d6bee909-kube-api-access-lkbw2\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cf7d8d32-c9fe-4d13-9067-7728d6bee909-audit-log\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603822 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-secret-metrics-server-client-certs\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.603966 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.603945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cf7d8d32-c9fe-4d13-9067-7728d6bee909-audit-log\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.604280 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.604257    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7d8d32-c9fe-4d13-9067-7728d6bee909-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.604409 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.604391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cf7d8d32-c9fe-4d13-9067-7728d6bee909-metrics-server-audit-profiles\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.605945 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.605918    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-client-ca-bundle\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.606141 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.606118    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-secret-metrics-server-client-certs\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.606141 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.606130    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cf7d8d32-c9fe-4d13-9067-7728d6bee909-secret-metrics-server-tls\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.645209 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.645183    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbw2\" (UniqueName: \"kubernetes.io/projected/cf7d8d32-c9fe-4d13-9067-7728d6bee909-kube-api-access-lkbw2\") pod \"metrics-server-d876fbd96-sbg6z\" (UID: \"cf7d8d32-c9fe-4d13-9067-7728d6bee909\") " pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.719334 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.719274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:16.910530 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:16.910495    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d876fbd96-sbg6z"]
Jul 05 13:20:17.107941 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:20:17.107898    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-m8wgm" podUID="7cda9f2c-b7c7-421d-93a1-c99170d528c7"
Jul 05 13:20:17.195622 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:17.195592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z" event={"ID":"cf7d8d32-c9fe-4d13-9067-7728d6bee909","Type":"ContainerStarted","Data":"727a57e528dc807f63190ed1f85d4a32ab81c1c20d340cdd7ba7a154ae860e3c"}
Jul 05 13:20:18.522232 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.522144    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 13:20:18.525973 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.525948    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.532051 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.532029    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 05 13:20:18.532157 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.532084    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-476pufoqjt4ig\""
Jul 05 13:20:18.532517 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.532338    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 05 13:20:18.532517 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.532345    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 05 13:20:18.532517 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.532410    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 05 13:20:18.532851 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.532574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 05 13:20:18.533380 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.533361    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 05 13:20:18.533832 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.533816    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 05 13:20:18.534738 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.534722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fdjj7\""
Jul 05 13:20:18.534738 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.534733    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 05 13:20:18.534858 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.534735    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 05 13:20:18.535420 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.535393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 05 13:20:18.535764 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.535748    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 05 13:20:18.535990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.535974    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 05 13:20:18.540835 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.540817    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 05 13:20:18.543361 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.543344    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 05 13:20:18.563932 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.563910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 13:20:18.622763 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.622875 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/128b4a09-0fdf-43cc-9315-8fddff519f98-config-out\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.622875 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.622875 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6gd\" (UniqueName: \"kubernetes.io/projected/128b4a09-0fdf-43cc-9315-8fddff519f98-kube-api-access-hk6gd\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.622978 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.622978 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-web-config\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.622978 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/128b4a09-0fdf-43cc-9315-8fddff519f98-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.622978 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.622962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623102 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623159 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623191 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623264 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623264 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623321 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-config\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623321 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623321 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623418 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.623418 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.623343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724377 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724377 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-config\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/128b4a09-0fdf-43cc-9315-8fddff519f98-config-out\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6gd\" (UniqueName: \"kubernetes.io/projected/128b4a09-0fdf-43cc-9315-8fddff519f98-kube-api-access-hk6gd\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-web-config\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/128b4a09-0fdf-43cc-9315-8fddff519f98-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.724964 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.724939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.725846 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.725180    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.725846 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.725248    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.725846 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.725577    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.725996 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.725914    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.725996 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.725945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.726100 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.726037    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.726926 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.726896    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.729338 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.729128    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.729338 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.729299    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.729836 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.729796    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-web-config\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.729942 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.729910    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/128b4a09-0fdf-43cc-9315-8fddff519f98-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.730398 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.730358    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-config\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.730527 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.730503    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.730623 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.730597    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.730759 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.730718    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.730818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.730778    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.730889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.730866    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/128b4a09-0fdf-43cc-9315-8fddff519f98-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.731239 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.731220    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/128b4a09-0fdf-43cc-9315-8fddff519f98-config-out\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.732220 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.732195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/128b4a09-0fdf-43cc-9315-8fddff519f98-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.739259 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.739241    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6gd\" (UniqueName: \"kubernetes.io/projected/128b4a09-0fdf-43cc-9315-8fddff519f98-kube-api-access-hk6gd\") pod \"prometheus-k8s-0\" (UID: \"128b4a09-0fdf-43cc-9315-8fddff519f98\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.835954 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.835927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:18.982658 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:18.982626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 13:20:18.985364 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:20:18.985325    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128b4a09_0fdf_43cc_9315_8fddff519f98.slice/crio-afb8d7371064482f13ae08c57840cb27b9c38fbcbd18d956d01ccd3983b9ccd4 WatchSource:0}: Error finding container afb8d7371064482f13ae08c57840cb27b9c38fbcbd18d956d01ccd3983b9ccd4: Status 404 returned error can't find the container with id afb8d7371064482f13ae08c57840cb27b9c38fbcbd18d956d01ccd3983b9ccd4
Jul 05 13:20:19.153056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:19.152986    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvlkl"
Jul 05 13:20:19.204827 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:19.204790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z" event={"ID":"cf7d8d32-c9fe-4d13-9067-7728d6bee909","Type":"ContainerStarted","Data":"73bfc687f120f0a474e46cd8a13ef486c1e56fcc16491c3977a3ac98b5d9ac34"}
Jul 05 13:20:19.206217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:19.206183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerStarted","Data":"afb8d7371064482f13ae08c57840cb27b9c38fbcbd18d956d01ccd3983b9ccd4"}
Jul 05 13:20:19.238339 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:19.238293    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z" podStartSLOduration=1.93061219 podStartE2EDuration="3.238278388s" totalImagesPullingTime="1.307666198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:19.235826979 +0000 UTC m=+297.672848704" watchObservedRunningTime="2026-07-05 13:20:19.238278388 +0000 UTC m=+297.675300113"
Jul 05 13:20:20.020410 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:20.020376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:20:20.213075 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:20.212990    2565 generic.go:356] "Generic (PLEG): container finished" podID="128b4a09-0fdf-43cc-9315-8fddff519f98" containerID="516ae22a0e71bb9c9c3cab0cbb39363b6d750f1289e2c100c56386c09981400e" exitCode=0
Jul 05 13:20:20.213224 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:20.213077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerDied","Data":"516ae22a0e71bb9c9c3cab0cbb39363b6d750f1289e2c100c56386c09981400e"}
Jul 05 13:20:20.494265 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:20.494194    2565 patch_prober.go:28] interesting pod/image-registry-5849f668b-t9j28 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 05 13:20:20.494265 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:20.494242    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5849f668b-t9j28" podUID="5271c2f2-229b-4720-95bc-cd97206124df" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:20:21.929313 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:21.929284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:20:21.929763 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:21.929412    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:20:21.940547 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:21.940507    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 05 13:20:23.170191 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:23.170171    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:20:23.230224 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:23.230186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerStarted","Data":"3f261b23ad1d19633b3f10c3c6f0b9aede646c456f18bca4a9754648c78f8503"}
Jul 05 13:20:23.230423 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:23.230288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerStarted","Data":"8bcd898ff85217e2437962d8083c43fff0ed79e6b7200a44e5a4938a232bc28a"}
Jul 05 13:20:25.037116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.037052    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry" containerID="cri-o://f909c60a0dce5f3ca3706e0b2665aee063895f551553f2a63b6fd0f9645f20d8" gracePeriod=30
Jul 05 13:20:25.135893 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.135860    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5849f668b-t9j28"
Jul 05 13:20:25.249227 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.249192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerStarted","Data":"8c62b913bf9febf0cb39ce2679650d8380b5803decc504e1d491268d42186a16"}
Jul 05 13:20:25.249383 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.249302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerStarted","Data":"0ad0a2ec336869757a8386fd1965989b325ff3f2d4a6f5816eeb96a14698695b"}
Jul 05 13:20:25.249383 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.249343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerStarted","Data":"b2d4339207d6904b47db5901f28997ae2d41e644062bbba918beada97ab0983d"}
Jul 05 13:20:25.249383 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.249368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"128b4a09-0fdf-43cc-9315-8fddff519f98","Type":"ContainerStarted","Data":"f09ff04967b1298ab6b5b2b80831b9483c7080d6f133390287d02c8dca229b09"}
Jul 05 13:20:25.250911 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.250880    2565 generic.go:356] "Generic (PLEG): container finished" podID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerID="f909c60a0dce5f3ca3706e0b2665aee063895f551553f2a63b6fd0f9645f20d8" exitCode=0
Jul 05 13:20:25.251020 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.250959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" event={"ID":"8d0131df-7014-4ab3-b700-78663f0bd4e9","Type":"ContainerDied","Data":"f909c60a0dce5f3ca3706e0b2665aee063895f551553f2a63b6fd0f9645f20d8"}
Jul 05 13:20:25.288788 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.288736    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:20:25.301454 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.301403    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.005758503 podStartE2EDuration="7.30138403s" totalImagesPullingTime="5.278263968s" totalInitContainerRuntime="17.361559ms" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:25.301282373 +0000 UTC m=+303.738304098" watchObservedRunningTime="2026-07-05 13:20:25.30138403 +0000 UTC m=+303.738405755"
Jul 05 13:20:25.392845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.392811    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d0131df-7014-4ab3-b700-78663f0bd4e9-ca-trust-extracted\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.392845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.392847    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-trusted-ca\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.393065 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.392870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-image-registry-private-configuration\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.393065 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.392895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m554k\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-kube-api-access-m554k\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.393065 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.392910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-certificates\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.393065 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.393027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-bound-sa-token\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.393065 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.393064    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.393311 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.393092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-installation-pull-secrets\") pod \"8d0131df-7014-4ab3-b700-78663f0bd4e9\" (UID: \"8d0131df-7014-4ab3-b700-78663f0bd4e9\") "
Jul 05 13:20:25.393365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.393324    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:20:25.393819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.393792    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-trusted-ca\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:25.393961 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.393863    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:20:25.395713 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.395624    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:20:25.395713 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.395624    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:20:25.396016 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.395972    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:20:25.396221 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.396180    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:20:25.397903 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.397881    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-kube-api-access-m554k" (OuterVolumeSpecName: "kube-api-access-m554k") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "kube-api-access-m554k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:20:25.403044 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.403020    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0131df-7014-4ab3-b700-78663f0bd4e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8d0131df-7014-4ab3-b700-78663f0bd4e9" (UID: "8d0131df-7014-4ab3-b700-78663f0bd4e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:20:25.495226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.495196    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-bound-sa-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:25.495226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.495221    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-tls\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:25.495226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.495230    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-installation-pull-secrets\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:25.495399 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.495239    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d0131df-7014-4ab3-b700-78663f0bd4e9-ca-trust-extracted\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:25.495399 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.495249    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d0131df-7014-4ab3-b700-78663f0bd4e9-image-registry-private-configuration\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:25.495399 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.495258    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m554k\" (UniqueName: \"kubernetes.io/projected/8d0131df-7014-4ab3-b700-78663f0bd4e9-kube-api-access-m554k\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:25.495399 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:25.495266    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d0131df-7014-4ab3-b700-78663f0bd4e9-registry-certificates\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:20:26.256112 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:26.256089    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"
Jul 05 13:20:26.256507 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:26.256122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff6fbccc6-2bn6p" event={"ID":"8d0131df-7014-4ab3-b700-78663f0bd4e9","Type":"ContainerDied","Data":"e3f1648bd1f5400c9e84328fbf5ec0e51cb7e7a09b28aa2ff12066812bff9d57"}
Jul 05 13:20:26.256507 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:26.256179    2565 scope.go:117] "RemoveContainer" containerID="f909c60a0dce5f3ca3706e0b2665aee063895f551553f2a63b6fd0f9645f20d8"
Jul 05 13:20:26.328154 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:26.328129    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"]
Jul 05 13:20:26.332966 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:26.332942    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7ff6fbccc6-2bn6p"]
Jul 05 13:20:28.111514 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:28.111479    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" path="/var/lib/kubelet/pods/8d0131df-7014-4ab3-b700-78663f0bd4e9/volumes"
Jul 05 13:20:28.836991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:28.836956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:20:31.106678 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:31.106648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:20:36.720422 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:36.720384    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:36.720829 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:36.720447    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:56.724536 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:56.724508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:20:56.728519 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:20:56.728491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d876fbd96-sbg6z"
Jul 05 13:21:18.836848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:18.836768    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:21:18.852263 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:18.852235    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:21:19.479110 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:19.479082    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 13:21:34.891516 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:34.891474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:21:34.893823 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:34.893802    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cda9f2c-b7c7-421d-93a1-c99170d528c7-metrics-certs\") pod \"network-metrics-daemon-m8wgm\" (UID: \"7cda9f2c-b7c7-421d-93a1-c99170d528c7\") " pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:21:35.009945 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:35.009914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgr78\""
Jul 05 13:21:35.017937 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:35.017914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8wgm"
Jul 05 13:21:35.147031 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:35.146956    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m8wgm"]
Jul 05 13:21:35.150417 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:21:35.150387    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cda9f2c_b7c7_421d_93a1_c99170d528c7.slice/crio-776637931c2c2e7d98f5c1226d6d824bb43129d74eda0f5537c6ef4017093ebb WatchSource:0}: Error finding container 776637931c2c2e7d98f5c1226d6d824bb43129d74eda0f5537c6ef4017093ebb: Status 404 returned error can't find the container with id 776637931c2c2e7d98f5c1226d6d824bb43129d74eda0f5537c6ef4017093ebb
Jul 05 13:21:35.525513 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:35.525433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m8wgm" event={"ID":"7cda9f2c-b7c7-421d-93a1-c99170d528c7","Type":"ContainerStarted","Data":"776637931c2c2e7d98f5c1226d6d824bb43129d74eda0f5537c6ef4017093ebb"}
Jul 05 13:21:36.530807 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:36.530772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m8wgm" event={"ID":"7cda9f2c-b7c7-421d-93a1-c99170d528c7","Type":"ContainerStarted","Data":"75fd5e96f0b55acb9c09340f303dd15805a752787cfc819b6be634a6ddfc3c20"}
Jul 05 13:21:36.531200 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:36.530827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m8wgm" event={"ID":"7cda9f2c-b7c7-421d-93a1-c99170d528c7","Type":"ContainerStarted","Data":"7d572b5856f0c36200c0ba983bfcf87241258eae3d8d7f3cfd9d79b1f18969e0"}
Jul 05 13:21:36.547222 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:21:36.547174    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m8wgm" podStartSLOduration=373.65287009 podStartE2EDuration="6m14.547158779s" totalImagesPullingTime="894.288689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:21:36.545004774 +0000 UTC m=+374.982026498" watchObservedRunningTime="2026-07-05 13:21:36.547158779 +0000 UTC m=+374.984180544"
Jul 05 13:23:27.935483 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.935453    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"]
Jul 05 13:23:27.935983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.935755    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry"
Jul 05 13:23:27.935983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.935767    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry"
Jul 05 13:23:27.935983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.935819    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0131df-7014-4ab3-b700-78663f0bd4e9" containerName="registry"
Jul 05 13:23:27.938973 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.938956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:27.943724 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.943650    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 05 13:23:27.943878 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.943740    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dk7w4\""
Jul 05 13:23:27.943878 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.943814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 05 13:23:27.943878 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.943870    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 05 13:23:27.944129 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.944112    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 05 13:23:27.987359 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:27.987334    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"]
Jul 05 13:23:28.034728 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.034699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b01f223-9f50-425b-a84b-3012b344d699-manifests\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.034728 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.034728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b01f223-9f50-425b-a84b-3012b344d699-webhook-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.034949 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.034752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b01f223-9f50-425b-a84b-3012b344d699-tmp\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.034949 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.034769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b01f223-9f50-425b-a84b-3012b344d699-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.034949 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.034871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6jd8\" (UniqueName: \"kubernetes.io/projected/8b01f223-9f50-425b-a84b-3012b344d699-kube-api-access-h6jd8\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.135386 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.135351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b01f223-9f50-425b-a84b-3012b344d699-manifests\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.135386 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.135386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b01f223-9f50-425b-a84b-3012b344d699-webhook-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.135590 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.135413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b01f223-9f50-425b-a84b-3012b344d699-tmp\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.135590 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.135576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b01f223-9f50-425b-a84b-3012b344d699-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.135710 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.135692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6jd8\" (UniqueName: \"kubernetes.io/projected/8b01f223-9f50-425b-a84b-3012b344d699-kube-api-access-h6jd8\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.135941 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.135921    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b01f223-9f50-425b-a84b-3012b344d699-manifests\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.137762 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.137743    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b01f223-9f50-425b-a84b-3012b344d699-tmp\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.137908 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.137890    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b01f223-9f50-425b-a84b-3012b344d699-webhook-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.137971 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.137954    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b01f223-9f50-425b-a84b-3012b344d699-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.144132 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.144111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6jd8\" (UniqueName: \"kubernetes.io/projected/8b01f223-9f50-425b-a84b-3012b344d699-kube-api-access-h6jd8\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-jc4nt\" (UID: \"8b01f223-9f50-425b-a84b-3012b344d699\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.248917 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.248842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:28.392853 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.392731    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"]
Jul 05 13:23:28.395896 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:23:28.395867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b01f223_9f50_425b_a84b_3012b344d699.slice/crio-9ed87d93c7c3282732bc1fd05a0c56a438aa806e6961d733a1848d7a3790754b WatchSource:0}: Error finding container 9ed87d93c7c3282732bc1fd05a0c56a438aa806e6961d733a1848d7a3790754b: Status 404 returned error can't find the container with id 9ed87d93c7c3282732bc1fd05a0c56a438aa806e6961d733a1848d7a3790754b
Jul 05 13:23:28.933256 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:28.933213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt" event={"ID":"8b01f223-9f50-425b-a84b-3012b344d699","Type":"ContainerStarted","Data":"9ed87d93c7c3282732bc1fd05a0c56a438aa806e6961d733a1848d7a3790754b"}
Jul 05 13:23:31.946479 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:31.946442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt" event={"ID":"8b01f223-9f50-425b-a84b-3012b344d699","Type":"ContainerStarted","Data":"ab3fb54c418aed406bc7a6e314746fb6d7c6d4159b88fabf59744dfb509c5533"}
Jul 05 13:23:32.952091 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:32.952056    2565 generic.go:356] "Generic (PLEG): container finished" podID="8b01f223-9f50-425b-a84b-3012b344d699" containerID="ab3fb54c418aed406bc7a6e314746fb6d7c6d4159b88fabf59744dfb509c5533" exitCode=0
Jul 05 13:23:32.952468 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:32.952126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt" event={"ID":"8b01f223-9f50-425b-a84b-3012b344d699","Type":"ContainerDied","Data":"ab3fb54c418aed406bc7a6e314746fb6d7c6d4159b88fabf59744dfb509c5533"}
Jul 05 13:23:33.958269 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:33.958229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt" event={"ID":"8b01f223-9f50-425b-a84b-3012b344d699","Type":"ContainerStarted","Data":"35f59a523c6e30602412976557c86accbf9d39106e7ed672352396ad521a7027"}
Jul 05 13:23:33.958757 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:33.958355    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:33.996926 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:33.996869    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt" podStartSLOduration=2.8545130309999998 podStartE2EDuration="6.996848335s" totalImagesPullingTime="3.119407441s" totalInitContainerRuntime="1.022927863s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:33.995297741 +0000 UTC m=+492.432319468" watchObservedRunningTime="2026-07-05 13:23:33.996848335 +0000 UTC m=+492.433870060"
Jul 05 13:23:44.966064 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:44.966035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-jc4nt"
Jul 05 13:23:57.103470 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.103409    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"]
Jul 05 13:23:57.108660 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.108637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.113168 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.113149    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 05 13:23:57.114196 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.114178    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sjwvg\""
Jul 05 13:23:57.114321 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.114206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 05 13:23:57.114321 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.114238    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:23:57.114460 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.114322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 05 13:23:57.114460 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.114413    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 05 13:23:57.149897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.149870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"]
Jul 05 13:23:57.286038 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.286007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfhv9\" (UniqueName: \"kubernetes.io/projected/90bc5333-f4ae-4888-aff2-2b2433181fdd-kube-api-access-cfhv9\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.286211 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.286060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/90bc5333-f4ae-4888-aff2-2b2433181fdd-manager-config\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.286211 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.286085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90bc5333-f4ae-4888-aff2-2b2433181fdd-cert\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.286211 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.286141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90bc5333-f4ae-4888-aff2-2b2433181fdd-metrics-cert\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.387180 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.387090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfhv9\" (UniqueName: \"kubernetes.io/projected/90bc5333-f4ae-4888-aff2-2b2433181fdd-kube-api-access-cfhv9\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.387180 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.387154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/90bc5333-f4ae-4888-aff2-2b2433181fdd-manager-config\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.387180 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.387179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90bc5333-f4ae-4888-aff2-2b2433181fdd-cert\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.387180 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.387193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90bc5333-f4ae-4888-aff2-2b2433181fdd-metrics-cert\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.387939 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.387916    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/90bc5333-f4ae-4888-aff2-2b2433181fdd-manager-config\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.389532 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.389506    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90bc5333-f4ae-4888-aff2-2b2433181fdd-cert\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.389622 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.389567    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90bc5333-f4ae-4888-aff2-2b2433181fdd-metrics-cert\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.398168 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.398144    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfhv9\" (UniqueName: \"kubernetes.io/projected/90bc5333-f4ae-4888-aff2-2b2433181fdd-kube-api-access-cfhv9\") pod \"lws-controller-manager-687b6f4bf4-7qpjh\" (UID: \"90bc5333-f4ae-4888-aff2-2b2433181fdd\") " pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.418170 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.418144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:23:57.603244 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:57.603211    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"]
Jul 05 13:23:57.607572 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:23:57.607547    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bc5333_f4ae_4888_aff2_2b2433181fdd.slice/crio-99a3abe80151468ee37a9331f2fc55f3fbebf7ef5864f9b40be25e030197db54 WatchSource:0}: Error finding container 99a3abe80151468ee37a9331f2fc55f3fbebf7ef5864f9b40be25e030197db54: Status 404 returned error can't find the container with id 99a3abe80151468ee37a9331f2fc55f3fbebf7ef5864f9b40be25e030197db54
Jul 05 13:23:58.064839 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:23:58.064803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh" event={"ID":"90bc5333-f4ae-4888-aff2-2b2433181fdd","Type":"ContainerStarted","Data":"99a3abe80151468ee37a9331f2fc55f3fbebf7ef5864f9b40be25e030197db54"}
Jul 05 13:24:01.080621 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.080579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh" event={"ID":"90bc5333-f4ae-4888-aff2-2b2433181fdd","Type":"ContainerStarted","Data":"9816a41045aa05f0d81c5ce206c801b6d3f46cfb2c9087f16dddcf31ebb548bf"}
Jul 05 13:24:01.081037 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.080711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:24:01.128488 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.128441    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh" podStartSLOduration=1.2486838630000001 podStartE2EDuration="4.128424987s" totalImagesPullingTime="2.879741124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:01.12644424 +0000 UTC m=+519.563465966" watchObservedRunningTime="2026-07-05 13:24:01.128424987 +0000 UTC m=+519.565446748"
Jul 05 13:24:01.536557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.536526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"]
Jul 05 13:24:01.539808 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.539789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.545341 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.545319    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 05 13:24:01.545447 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.545383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tl7dm\""
Jul 05 13:24:01.616341 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.616310    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"]
Jul 05 13:24:01.727606 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.727606 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.727874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25rfr\" (UniqueName: \"kubernetes.io/projected/27fe2677-b1da-4535-84a2-a7bff2e42434-kube-api-access-25rfr\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.727874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.727874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.727874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.727874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.728057 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fe2677-b1da-4535-84a2-a7bff2e42434-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.728057 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.727943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.828842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.828756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.828842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.828811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fe2677-b1da-4535-84a2-a7bff2e42434-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829021 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.828847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829021 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.828869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829021 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.828992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25rfr\" (UniqueName: \"kubernetes.io/projected/27fe2677-b1da-4535-84a2-a7bff2e42434-kube-api-access-25rfr\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829386 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829362    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829445 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829498 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829608 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fe2677-b1da-4535-84a2-a7bff2e42434-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.829654 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.829628    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.831097 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.831066    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.831223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.831199    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.958077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.958043    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fe2677-b1da-4535-84a2-a7bff2e42434-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:01.988244 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:01.988215    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25rfr\" (UniqueName: \"kubernetes.io/projected/27fe2677-b1da-4535-84a2-a7bff2e42434-kube-api-access-25rfr\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hg5tz\" (UID: \"27fe2677-b1da-4535-84a2-a7bff2e42434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:02.150278 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:02.150186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:02.478603 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:02.478517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"]
Jul 05 13:24:02.496919 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:24:02.496888    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fe2677_b1da_4535_84a2_a7bff2e42434.slice/crio-ed8b3f1922e0e6b36130c4e481cf60b074e8c92a2002742fc5392bb412eed196 WatchSource:0}: Error finding container ed8b3f1922e0e6b36130c4e481cf60b074e8c92a2002742fc5392bb412eed196: Status 404 returned error can't find the container with id ed8b3f1922e0e6b36130c4e481cf60b074e8c92a2002742fc5392bb412eed196
Jul 05 13:24:03.088915 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:03.088872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz" event={"ID":"27fe2677-b1da-4535-84a2-a7bff2e42434","Type":"ContainerStarted","Data":"ed8b3f1922e0e6b36130c4e481cf60b074e8c92a2002742fc5392bb412eed196"}
Jul 05 13:24:05.597745 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.597703    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"]
Jul 05 13:24:05.604882 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.604726    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"]
Jul 05 13:24:05.605048 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.604970    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:05.610791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.610758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:05.638009 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.637736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 05 13:24:05.639197 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.638908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 05 13:24:05.639197 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.638908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h6z9r\""
Jul 05 13:24:05.639197 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.638912    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t22df\""
Jul 05 13:24:05.639582 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.639560    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"]
Jul 05 13:24:05.654337 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.654285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"]
Jul 05 13:24:05.672078 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.672050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8wq5\" (UniqueName: \"kubernetes.io/projected/a8faef00-c7d3-4928-818a-dd38439fa319-kube-api-access-n8wq5\") pod \"kserve-controller-manager-d6f4b65b8-lwd42\" (UID: \"a8faef00-c7d3-4928-818a-dd38439fa319\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:05.672215 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.672083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8faef00-c7d3-4928-818a-dd38439fa319-cert\") pod \"kserve-controller-manager-d6f4b65b8-lwd42\" (UID: \"a8faef00-c7d3-4928-818a-dd38439fa319\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:05.672215 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.672159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxwzn\" (UniqueName: \"kubernetes.io/projected/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-kube-api-access-lxwzn\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:05.672215 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.672201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:05.772800 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.772746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8faef00-c7d3-4928-818a-dd38439fa319-cert\") pod \"kserve-controller-manager-d6f4b65b8-lwd42\" (UID: \"a8faef00-c7d3-4928-818a-dd38439fa319\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:05.772976 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.772854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxwzn\" (UniqueName: \"kubernetes.io/projected/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-kube-api-access-lxwzn\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:05.772976 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.772927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:05.773107 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.773003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8wq5\" (UniqueName: \"kubernetes.io/projected/a8faef00-c7d3-4928-818a-dd38439fa319-kube-api-access-n8wq5\") pod \"kserve-controller-manager-d6f4b65b8-lwd42\" (UID: \"a8faef00-c7d3-4928-818a-dd38439fa319\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:05.773312 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:05.773233    2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 05 13:24:05.773436 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:05.773342    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert podName:fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e nodeName:}" failed. No retries permitted until 2026-07-05 13:24:06.273321263 +0000 UTC m=+524.710342983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert") pod "llmisvc-controller-manager-777c6bd7d5-v66zn" (UID: "fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e") : secret "llmisvc-webhook-server-cert" not found
Jul 05 13:24:05.775637 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.775606    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8faef00-c7d3-4928-818a-dd38439fa319-cert\") pod \"kserve-controller-manager-d6f4b65b8-lwd42\" (UID: \"a8faef00-c7d3-4928-818a-dd38439fa319\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:05.810116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.810086    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxwzn\" (UniqueName: \"kubernetes.io/projected/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-kube-api-access-lxwzn\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:05.819940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.819913    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8wq5\" (UniqueName: \"kubernetes.io/projected/a8faef00-c7d3-4928-818a-dd38439fa319-kube-api-access-n8wq5\") pod \"kserve-controller-manager-d6f4b65b8-lwd42\" (UID: \"a8faef00-c7d3-4928-818a-dd38439fa319\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:05.879924 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.879878    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:24:05.880069 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.879963    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:24:05.880069 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.880011    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:24:05.926373 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:05.926341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:06.112890 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:06.112861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz" event={"ID":"27fe2677-b1da-4535-84a2-a7bff2e42434","Type":"ContainerStarted","Data":"11659c99b8286f07e4717d5c26e8feb318f98803bfe648c862563eb3b46d11cc"}
Jul 05 13:24:06.150602 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:06.150518    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:06.151889 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:06.151862    2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 05 13:24:06.152010 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:06.151920    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz" podUID="27fe2677-b1da-4535-84a2-a7bff2e42434" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 05 13:24:06.174708 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:06.174646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"]
Jul 05 13:24:06.180245 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:24:06.180217    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8faef00_c7d3_4928_818a_dd38439fa319.slice/crio-cc00b3cdf86361061a29b487b514a48f2ba121812c282658a4f544c261688162 WatchSource:0}: Error finding container cc00b3cdf86361061a29b487b514a48f2ba121812c282658a4f544c261688162: Status 404 returned error can't find the container with id cc00b3cdf86361061a29b487b514a48f2ba121812c282658a4f544c261688162
Jul 05 13:24:06.198128 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:06.198071    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz" podStartSLOduration=1.817348752 podStartE2EDuration="5.1980491s" totalImagesPullingTime="3.380700348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:06.197484598 +0000 UTC m=+524.634506324" watchObservedRunningTime="2026-07-05 13:24:06.1980491 +0000 UTC m=+524.635070826"
Jul 05 13:24:06.277548 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:06.277511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:06.277744 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:06.277659    2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 05 13:24:06.277744 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:06.277741    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert podName:fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e nodeName:}" failed. No retries permitted until 2026-07-05 13:24:07.277727121 +0000 UTC m=+525.714748825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert") pod "llmisvc-controller-manager-777c6bd7d5-v66zn" (UID: "fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e") : secret "llmisvc-webhook-server-cert" not found
Jul 05 13:24:07.111938 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:07.111901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42" event={"ID":"a8faef00-c7d3-4928-818a-dd38439fa319","Type":"ContainerStarted","Data":"cc00b3cdf86361061a29b487b514a48f2ba121812c282658a4f544c261688162"}
Jul 05 13:24:07.154957 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:07.154926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:07.285583 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:07.285549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:07.288473 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:07.288448    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-v66zn\" (UID: \"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:07.419442 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:07.419354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:07.606812 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:07.606782    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"]
Jul 05 13:24:07.609277 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:24:07.609252    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa6d2a3d_c1c2_4679_9eaf_42ef0710a94e.slice/crio-76972e31dad96d7b807fe9e41fe5deda68ccae7eba46f1374ceaed4f1def5d0f WatchSource:0}: Error finding container 76972e31dad96d7b807fe9e41fe5deda68ccae7eba46f1374ceaed4f1def5d0f: Status 404 returned error can't find the container with id 76972e31dad96d7b807fe9e41fe5deda68ccae7eba46f1374ceaed4f1def5d0f
Jul 05 13:24:08.119316 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:08.119277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn" event={"ID":"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e","Type":"ContainerStarted","Data":"76972e31dad96d7b807fe9e41fe5deda68ccae7eba46f1374ceaed4f1def5d0f"}
Jul 05 13:24:08.119782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:08.119534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:08.120759 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:08.120738    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hg5tz"
Jul 05 13:24:09.125909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:09.125848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42" event={"ID":"a8faef00-c7d3-4928-818a-dd38439fa319","Type":"ContainerStarted","Data":"7aa379f06e7d344102ed7a530f275129fe841f4e52d9753964a3b5b7fb392f1b"}
Jul 05 13:24:09.126405 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:09.126103    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:09.189762 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:09.189695    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42" podStartSLOduration=1.8784624189999999 podStartE2EDuration="4.189660294s" totalImagesPullingTime="2.311197875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:09.188451305 +0000 UTC m=+527.625473033" watchObservedRunningTime="2026-07-05 13:24:09.189660294 +0000 UTC m=+527.626682000"
Jul 05 13:24:09.566197 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:09.566154    2565 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:4744ace31f426a693743a7132d1303e857e8a1ddc5508ce010eb584066b7044b: fetching blob: authentication required; artifact err: provided artifact is a container image" image="quay.io/opendatahub/odh-kserve-llmisvc-controller:odh-v3.5-EA2"
Jul 05 13:24:09.566381 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:09.566283    2565 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod llmisvc-controller-manager-777c6bd7d5-v66zn_opendatahub(fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:4744ace31f426a693743a7132d1303e857e8a1ddc5508ce010eb584066b7044b: fetching blob: authentication required; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 05 13:24:09.566381 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:09.566329    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:4744ace31f426a693743a7132d1303e857e8a1ddc5508ce010eb584066b7044b: fetching blob: authentication required; artifact err: provided artifact is a container image\"" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn" podUID="fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e"
Jul 05 13:24:10.130785 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:24:10.130749    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/odh-kserve-llmisvc-controller:odh-v3.5-EA2\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:4744ace31f426a693743a7132d1303e857e8a1ddc5508ce010eb584066b7044b: fetching blob: authentication required; artifact err: provided artifact is a container image\"" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn" podUID="fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e"
Jul 05 13:24:12.086846 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:12.086817    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-687b6f4bf4-7qpjh"
Jul 05 13:24:28.204207 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:28.204175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn" event={"ID":"fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e","Type":"ContainerStarted","Data":"091b01fe6ed01f27871320bac05eaf09a1cf26ff60ff19b617ebc845957fe543"}
Jul 05 13:24:28.204638 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:28.204374    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:24:28.242222 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:28.242174    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn" podStartSLOduration=3.498223891 podStartE2EDuration="23.242158531s" totalImagesPullingTime="19.74393464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-05 13:24:28.240623846 +0000 UTC m=+546.677645576" watchObservedRunningTime="2026-07-05 13:24:28.242158531 +0000 UTC m=+546.679180256"
Jul 05 13:24:40.135565 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:40.135532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lwd42"
Jul 05 13:24:59.210073 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:24:59.210045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-v66zn"
Jul 05 13:25:21.960031 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:21.960003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:25:21.961291 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:21.961268    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:25:56.050187 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.050109    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"]
Jul 05 13:25:56.053031 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.053016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"
Jul 05 13:25:56.060510 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.060492    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 05 13:25:56.061455 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.061440    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 05 13:25:56.061525 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.061450    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nbdj6\""
Jul 05 13:25:56.090035 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.090010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"]
Jul 05 13:25:56.145342 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.145310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqxpq\" (UniqueName: \"kubernetes.io/projected/c68f93b3-636b-4419-867e-c75423e0a3e5-kube-api-access-qqxpq\") pod \"authorino-operator-75cc8d5cb7-gfdrq\" (UID: \"c68f93b3-636b-4419-867e-c75423e0a3e5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"
Jul 05 13:25:56.246367 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.246327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqxpq\" (UniqueName: \"kubernetes.io/projected/c68f93b3-636b-4419-867e-c75423e0a3e5-kube-api-access-qqxpq\") pod \"authorino-operator-75cc8d5cb7-gfdrq\" (UID: \"c68f93b3-636b-4419-867e-c75423e0a3e5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"
Jul 05 13:25:56.259559 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.259530    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqxpq\" (UniqueName: \"kubernetes.io/projected/c68f93b3-636b-4419-867e-c75423e0a3e5-kube-api-access-qqxpq\") pod \"authorino-operator-75cc8d5cb7-gfdrq\" (UID: \"c68f93b3-636b-4419-867e-c75423e0a3e5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"
Jul 05 13:25:56.362622 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.362547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"
Jul 05 13:25:56.548166 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.548130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"]
Jul 05 13:25:56.552701 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:25:56.552652    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68f93b3_636b_4419_867e_c75423e0a3e5.slice/crio-4c5322bdef79458b04ffe8f2655f9f2121f99139a560e4ddb65c7cf5f103458f WatchSource:0}: Error finding container 4c5322bdef79458b04ffe8f2655f9f2121f99139a560e4ddb65c7cf5f103458f: Status 404 returned error can't find the container with id 4c5322bdef79458b04ffe8f2655f9f2121f99139a560e4ddb65c7cf5f103458f
Jul 05 13:25:56.554705 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.554689    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:25:56.564197 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:56.564168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq" event={"ID":"c68f93b3-636b-4419-867e-c75423e0a3e5","Type":"ContainerStarted","Data":"4c5322bdef79458b04ffe8f2655f9f2121f99139a560e4ddb65c7cf5f103458f"}
Jul 05 13:25:59.579852 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:59.579813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq" event={"ID":"c68f93b3-636b-4419-867e-c75423e0a3e5","Type":"ContainerStarted","Data":"c6019ee3d1a0979c51eaeefac614c904024536185900752fbc6428f2c1385a48"}
Jul 05 13:25:59.580219 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:59.580049    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"
Jul 05 13:25:59.672060 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:25:59.672007    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq" podStartSLOduration=2.500375691 podStartE2EDuration="4.671989764s" totalImagesPullingTime="2.171614073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:59.670308999 +0000 UTC m=+638.107330725" watchObservedRunningTime="2026-07-05 13:25:59.671989764 +0000 UTC m=+638.109011489"
Jul 05 13:26:10.586633 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:10.586599    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfdrq"
Jul 05 13:26:42.750994 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.750960    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"]
Jul 05 13:26:42.757361 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.757339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.764641 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.764615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2c5r5\""
Jul 05 13:26:42.774587 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.774554    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"]
Jul 05 13:26:42.845314 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnm4l\" (UniqueName: \"kubernetes.io/projected/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-kube-api-access-lnm4l\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845494 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845494 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845494 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845626 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845626 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845626 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845596    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.845791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.845733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.946765 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.946726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.946936 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.946779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnm4l\" (UniqueName: \"kubernetes.io/projected/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-kube-api-access-lnm4l\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.946936 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.946810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.946936 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.946829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.946936 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.946865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947113 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947113 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947113 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947113 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947318 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947187    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947318 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947442 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947418    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947500 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947474    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.947767 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.947748    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.949174 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.949158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.949448 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.949429    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.955737 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.955706    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:42.956426 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:42.956402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnm4l\" (UniqueName: \"kubernetes.io/projected/9e47e2e9-b8f9-4f75-bb0e-136666767ca8-kube-api-access-lnm4l\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjwjd\" (UID: \"9e47e2e9-b8f9-4f75-bb0e-136666767ca8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:43.067716 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.067682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:43.226955 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.226932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"]
Jul 05 13:26:43.228699 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:26:43.228650    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e47e2e9_b8f9_4f75_bb0e_136666767ca8.slice/crio-d9dd5c54e7ef9fca064d169f45f38e9a67ea924b683a582c975302d8d888ac05 WatchSource:0}: Error finding container d9dd5c54e7ef9fca064d169f45f38e9a67ea924b683a582c975302d8d888ac05: Status 404 returned error can't find the container with id d9dd5c54e7ef9fca064d169f45f38e9a67ea924b683a582c975302d8d888ac05
Jul 05 13:26:43.231215 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.231184    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:26:43.231303 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.231244    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:26:43.231303 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.231272    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:26:43.773810 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.773770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" event={"ID":"9e47e2e9-b8f9-4f75-bb0e-136666767ca8","Type":"ContainerStarted","Data":"f6f6bd507c94ff451e8e41fbf4fb581d0d13094553d97d87f64419798b3f3757"}
Jul 05 13:26:43.774198 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.773866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" event={"ID":"9e47e2e9-b8f9-4f75-bb0e-136666767ca8","Type":"ContainerStarted","Data":"d9dd5c54e7ef9fca064d169f45f38e9a67ea924b683a582c975302d8d888ac05"}
Jul 05 13:26:43.798634 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:43.798589    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" podStartSLOduration=1.7985748799999999 podStartE2EDuration="1.79857488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:43.796587741 +0000 UTC m=+682.233609469" watchObservedRunningTime="2026-07-05 13:26:43.79857488 +0000 UTC m=+682.235596604"
Jul 05 13:26:44.068607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:44.068572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:44.073360 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:44.073332    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:44.778974 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:44.778946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:44.780009 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:44.779993    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:26:45.738445 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.738412    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:26:45.741910 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.741894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:45.746522 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.746486    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 05 13:26:45.746693 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.746536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vkw6q\""
Jul 05 13:26:45.767980 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.767955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:26:45.824923 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.824895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:26:45.871874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.871843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/296ef30e-a7dd-431d-9651-c5629a35c23a-config-file\") pod \"limitador-limitador-54d6d988d5-qrnhs\" (UID: \"296ef30e-a7dd-431d-9651-c5629a35c23a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:45.872025 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.871921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vq6d\" (UniqueName: \"kubernetes.io/projected/296ef30e-a7dd-431d-9651-c5629a35c23a-kube-api-access-7vq6d\") pod \"limitador-limitador-54d6d988d5-qrnhs\" (UID: \"296ef30e-a7dd-431d-9651-c5629a35c23a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:45.972958 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.972926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vq6d\" (UniqueName: \"kubernetes.io/projected/296ef30e-a7dd-431d-9651-c5629a35c23a-kube-api-access-7vq6d\") pod \"limitador-limitador-54d6d988d5-qrnhs\" (UID: \"296ef30e-a7dd-431d-9651-c5629a35c23a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:45.973158 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.973009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/296ef30e-a7dd-431d-9651-c5629a35c23a-config-file\") pod \"limitador-limitador-54d6d988d5-qrnhs\" (UID: \"296ef30e-a7dd-431d-9651-c5629a35c23a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:45.973621 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.973596    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/296ef30e-a7dd-431d-9651-c5629a35c23a-config-file\") pod \"limitador-limitador-54d6d988d5-qrnhs\" (UID: \"296ef30e-a7dd-431d-9651-c5629a35c23a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:45.989836 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:45.989784    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vq6d\" (UniqueName: \"kubernetes.io/projected/296ef30e-a7dd-431d-9651-c5629a35c23a-kube-api-access-7vq6d\") pod \"limitador-limitador-54d6d988d5-qrnhs\" (UID: \"296ef30e-a7dd-431d-9651-c5629a35c23a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:46.053172 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:46.053141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:46.198183 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:46.197995    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:26:46.201694 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:26:46.201639    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296ef30e_a7dd_431d_9651_c5629a35c23a.slice/crio-550cc0c90a3b6b0d9481d405cfdc2ba0b347a9fdcd83b904278061fc1a0e8a8e WatchSource:0}: Error finding container 550cc0c90a3b6b0d9481d405cfdc2ba0b347a9fdcd83b904278061fc1a0e8a8e: Status 404 returned error can't find the container with id 550cc0c90a3b6b0d9481d405cfdc2ba0b347a9fdcd83b904278061fc1a0e8a8e
Jul 05 13:26:46.796217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:46.796147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs" event={"ID":"296ef30e-a7dd-431d-9651-c5629a35c23a","Type":"ContainerStarted","Data":"550cc0c90a3b6b0d9481d405cfdc2ba0b347a9fdcd83b904278061fc1a0e8a8e"}
Jul 05 13:26:48.806421 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:48.806382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs" event={"ID":"296ef30e-a7dd-431d-9651-c5629a35c23a","Type":"ContainerStarted","Data":"6616e16f9fc11eff1c5a5523ada80d37fb156765c8af5cba993e49b9c7dc3ab8"}
Jul 05 13:26:48.806914 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:48.806547    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:26:48.830556 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:48.830459    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs" podStartSLOduration=1.473233897 podStartE2EDuration="3.830442466s" totalImagesPullingTime="2.357208569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:48.826841852 +0000 UTC m=+687.263863576" watchObservedRunningTime="2026-07-05 13:26:48.830442466 +0000 UTC m=+687.267464187"
Jul 05 13:26:59.812444 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:26:59.812412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"
Jul 05 13:28:03.560992 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:03.560959    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:28:11.165483 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:11.165451    2565 generic.go:356] "Generic (PLEG): container finished" podID="9e47e2e9-b8f9-4f75-bb0e-136666767ca8" containerID="f6f6bd507c94ff451e8e41fbf4fb581d0d13094553d97d87f64419798b3f3757" exitCode=0
Jul 05 13:28:11.165854 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:11.165495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" event={"ID":"9e47e2e9-b8f9-4f75-bb0e-136666767ca8","Type":"ContainerDied","Data":"f6f6bd507c94ff451e8e41fbf4fb581d0d13094553d97d87f64419798b3f3757"}
Jul 05 13:28:11.165895 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:11.165859    2565 scope.go:117] "RemoveContainer" containerID="f6f6bd507c94ff451e8e41fbf4fb581d0d13094553d97d87f64419798b3f3757"
Jul 05 13:28:11.166885 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:11.166851    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:28:11.167001 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:11.166935    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:28:11.167001 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:11.166985    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:28:12.170413 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:12.170377    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" event={"ID":"9e47e2e9-b8f9-4f75-bb0e-136666767ca8","Type":"ContainerStarted","Data":"9b6ca3d0ea719481e8444123320de7b9f6be6e135f014346320090bd6d1fdddd"}
Jul 05 13:28:13.068541 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:13.068500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:28:13.069737 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:13.069705    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 05 13:28:13.069853 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:13.069761    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" podUID="9e47e2e9-b8f9-4f75-bb0e-136666767ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 05 13:28:14.068550 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:14.068517    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 05 13:28:14.069034 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:14.068579    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" podUID="9e47e2e9-b8f9-4f75-bb0e-136666767ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 05 13:28:14.779455 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:14.779416    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:28:15.068253 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:15.068164    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjwjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 05 13:28:15.068253 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:15.068228    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd" podUID="9e47e2e9-b8f9-4f75-bb0e-136666767ca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 05 13:28:16.071876 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:16.071844    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:28:16.072724 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:16.072703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjwjd"
Jul 05 13:28:21.428544 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:21.428511    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:28:27.033042 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:27.033009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:28:35.736041 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:35.736007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:28:41.532123 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:28:41.532092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:29:01.432877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:01.432791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:29:14.364631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.364595    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"]
Jul 05 13:29:14.366943 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.366922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.369327 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.369306    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 05 13:29:14.369519 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.369498    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sxwzc\""
Jul 05 13:29:14.369596 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.369520    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 05 13:29:14.370381 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.370363    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 05 13:29:14.376328 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.376306    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"]
Jul 05 13:29:14.502434 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.502400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.502434 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.502434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.502629 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.502466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.502629 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.502486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9vrc\" (UniqueName: \"kubernetes.io/projected/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-kube-api-access-b9vrc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.502629 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.502507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.502629 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.502609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604013 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.603974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vrc\" (UniqueName: \"kubernetes.io/projected/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-kube-api-access-b9vrc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604194 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604466 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604430    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604523 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604474    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.604523 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.604492    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.606746 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.606713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.607227 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.607204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.613164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.613125    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9vrc\" (UniqueName: \"kubernetes.io/projected/2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029-kube-api-access-b9vrc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5\" (UID: \"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.677130 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.677057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:14.810551 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:14.810481    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"]
Jul 05 13:29:14.812852 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:29:14.812818    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dfd0b7c_eb7f_42ec_b4bb_c3fb31462029.slice/crio-3f26fece6d5d89c1d09dd2e9248212e7b2646b32e1db42455bbd0bf66eb1a3da WatchSource:0}: Error finding container 3f26fece6d5d89c1d09dd2e9248212e7b2646b32e1db42455bbd0bf66eb1a3da: Status 404 returned error can't find the container with id 3f26fece6d5d89c1d09dd2e9248212e7b2646b32e1db42455bbd0bf66eb1a3da
Jul 05 13:29:15.443857 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:15.443820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5" event={"ID":"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029","Type":"ContainerStarted","Data":"3f26fece6d5d89c1d09dd2e9248212e7b2646b32e1db42455bbd0bf66eb1a3da"}
Jul 05 13:29:16.449377 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:16.449343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5" event={"ID":"2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029","Type":"ContainerStarted","Data":"f953ef9fe24e309187c48fbdf814970c53a74f34cb3628a1b1684369b2d1b069"}
Jul 05 13:29:16.470066 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:16.470015    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5" podStartSLOduration=1.5196541099999998 podStartE2EDuration="2.469999735s" totalImagesPullingTime="950.345625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:29:16.469186523 +0000 UTC m=+834.906208252" watchObservedRunningTime="2026-07-05 13:29:16.469999735 +0000 UTC m=+834.907021459"
Jul 05 13:29:16.930004 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:16.929972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:29:24.678096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:24.678059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:24.678551 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:24.678111    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:24.690462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:24.690432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:29:25.503265 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:29:25.503239    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5"
Jul 05 13:30:21.989749 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:30:21.989659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:30:21.992859 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:30:21.992836    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:31:04.435069 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:31:04.435027    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:31:14.531088 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:31:14.531055    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:31:25.326806 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:31:25.326772    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:31:35.430718 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:31:35.430679    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:31:45.328838 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:31:45.328752    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:32:14.639566 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:32:14.639530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:32:23.922765 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:32:23.922731    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:32:58.428288 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:32:58.428247    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:33:05.936828 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:33:05.936797    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:33:16.325320 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:33:16.325239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:33:22.626080 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:33:22.626044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:33:31.238078 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:33:31.238038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:33:40.930354 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:33:40.930319    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:33:51.869745 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:33:51.869711    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:34:01.832308 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:34:01.832266    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:34:26.953934 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:34:26.953898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:34:36.931098 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:34:36.931064    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:34:59.335956 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:34:59.335878    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:35:10.426600 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:35:10.426564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:35:22.016118 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:35:22.016089    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:35:22.020986 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:35:22.020966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:35:27.137330 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:35:27.137287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:35:36.131540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:35:36.131509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:35:45.525405 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:35:45.525374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:35:54.838973 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:35:54.838939    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:36:03.542377 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:36:03.542344    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:37:52.437338 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:37:52.437260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:38:03.839999 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:38:03.839967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:38:12.344008 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:38:12.343972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:38:23.940820 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:38:23.940787    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:38:35.637720 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:38:35.637686    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:38:46.136162 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:38:46.136126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:38:54.933940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:38:54.933895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:39:05.435404 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:39:05.435369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:39:15.830661 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:39:15.830578    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:39:26.941744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:39:26.941706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:39:38.146468 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:39:38.146435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:40:00.727163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:00.727131    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:40:09.333256 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:09.333218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:40:18.634736 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:18.634698    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:40:22.043748 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:22.043716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:40:22.048560 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:22.048534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:40:31.230235 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:31.230194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:40:40.331011 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:40.330976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:40:48.176018 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:48.175938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:40:57.330217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:40:57.330182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:41:06.529171 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:41:06.529130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:41:18.233329 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:41:18.233292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:41:27.334655 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:41:27.334622    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:41:36.729839 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:41:36.729807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:41:50.538155 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:41:50.538122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:42:04.935456 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:42:04.935418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:42:14.238554 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:42:14.238470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:42:23.441115 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:42:23.441078    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:42:38.553728 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:42:38.553691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:42:51.130753 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:42:51.130717    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:43:02.835502 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:02.835463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:43:13.829795 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:13.829755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:43:27.633562 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:27.633520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:43:36.432424 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:36.432388    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:43:46.278199 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.278169    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"]
Jul 05 13:43:46.281778 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.281756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.285248 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.285226    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-82ec44a3-openshift-default-dockercfg-hvmtt\""
Jul 05 13:43:46.320192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.320160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"]
Jul 05 13:43:46.381860 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.381798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-token\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382109 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-envoy\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382261 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-data\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382387 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-certs\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382387 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qk4\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-kube-api-access-r5qk4\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382501 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-socket\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382501 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-podinfo\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382501 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff0f4111-b153-464a-afe0-1c4629fb0458-istiod-ca-cert\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.382743 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.382520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-credential-socket\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.440562 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.440530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:43:46.483382 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-credential-socket\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-token\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-envoy\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-data\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-certs\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qk4\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-kube-api-access-r5qk4\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-socket\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-podinfo\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff0f4111-b153-464a-afe0-1c4629fb0458-istiod-ca-cert\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483893 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483846    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-credential-socket\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.483972 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.483947    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-socket\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.484037 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.484016    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-certs\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.484232 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.484212    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-data\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.484294 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.484278    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff0f4111-b153-464a-afe0-1c4629fb0458-istiod-ca-cert\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.485630 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.485612    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-envoy\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.486024 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.486006    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-podinfo\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.491973 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.491947    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-token\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.492213 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.492191    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qk4\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-kube-api-access-r5qk4\") pod \"e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") " pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.591470 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.591438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:46.741867 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.741843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"]
Jul 05 13:43:46.744289 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:43:46.744266    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0f4111_b153_464a_afe0_1c4629fb0458.slice/crio-cb065d24bdad91c35dc35aa0346c33c2b62efd552946e151b45ca76cab50c77c WatchSource:0}: Error finding container cb065d24bdad91c35dc35aa0346c33c2b62efd552946e151b45ca76cab50c77c: Status 404 returned error can't find the container with id cb065d24bdad91c35dc35aa0346c33c2b62efd552946e151b45ca76cab50c77c
Jul 05 13:43:46.746463 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.746431    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:43:46.746553 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.746496    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:43:46.746553 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:46.746522    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:43:47.326188 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:47.326147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f" event={"ID":"ff0f4111-b153-464a-afe0-1c4629fb0458","Type":"ContainerStarted","Data":"eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751"}
Jul 05 13:43:47.326557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:47.326211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f" event={"ID":"ff0f4111-b153-464a-afe0-1c4629fb0458","Type":"ContainerStarted","Data":"cb065d24bdad91c35dc35aa0346c33c2b62efd552946e151b45ca76cab50c77c"}
Jul 05 13:43:47.362862 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:47.362811    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f" podStartSLOduration=1.362794193 podStartE2EDuration="1.362794193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:43:47.362000256 +0000 UTC m=+1705.799021982" watchObservedRunningTime="2026-07-05 13:43:47.362794193 +0000 UTC m=+1705.799815908"
Jul 05 13:43:47.592258 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:47.592174    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:47.597396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:47.597372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:48.331107 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:48.331076    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:48.332138 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:48.332114    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:52.827354 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:52.827321    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"]
Jul 05 13:43:52.827786 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:52.827525    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f" podUID="ff0f4111-b153-464a-afe0-1c4629fb0458" containerName="istio-proxy" containerID="cri-o://eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751" gracePeriod=30
Jul 05 13:43:59.181029 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.180958    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:59.189171 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.189146    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"]
Jul 05 13:43:59.189549 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.189533    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0f4111-b153-464a-afe0-1c4629fb0458" containerName="istio-proxy"
Jul 05 13:43:59.189600 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.189552    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0f4111-b153-464a-afe0-1c4629fb0458" containerName="istio-proxy"
Jul 05 13:43:59.189634 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.189618    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff0f4111-b153-464a-afe0-1c4629fb0458" containerName="istio-proxy"
Jul 05 13:43:59.192333 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.192311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.195028 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.195002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-986e3717-openshift-default-dockercfg-2m4qb\""
Jul 05 13:43:59.210253 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.210226    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"]
Jul 05 13:43:59.307006 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.306976    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-podinfo\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.307192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-socket\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.307192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307074    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff0f4111-b153-464a-afe0-1c4629fb0458-istiod-ca-cert\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.307192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-credential-socket\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.307192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307158    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5qk4\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-kube-api-access-r5qk4\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.307727 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307699    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-certs\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.307868 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307780    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-data\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.307868 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307804    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:43:59.307868 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-token\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.308025 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-envoy\") pod \"ff0f4111-b153-464a-afe0-1c4629fb0458\" (UID: \"ff0f4111-b153-464a-afe0-1c4629fb0458\") "
Jul 05 13:43:59.308025 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.307902    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff0f4111-b153-464a-afe0-1c4629fb0458-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:43:59.308116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308028    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:43:59.308116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308044    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:43:59.308582 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-token\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.308717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istiod-ca-cert\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.308717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48p7z\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-kube-api-access-48p7z\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.308844 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-socket\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.308905 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308845    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:43:59.308905 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-data\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.309013 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-certs\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.309013 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.308991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-podinfo\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.309123 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.309027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-envoy\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.309123 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.309085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-credential-socket\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.309223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.309174    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.309223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.309189    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff0f4111-b153-464a-afe0-1c4629fb0458-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.309223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.309204    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.309223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.309222    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.309421 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.309235    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.314034 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.310566    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:43:59.316009 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.315987    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:43:59.316092 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.316001    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:43:59.316805 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.316783    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-kube-api-access-r5qk4" (OuterVolumeSpecName: "kube-api-access-r5qk4") pod "ff0f4111-b153-464a-afe0-1c4629fb0458" (UID: "ff0f4111-b153-464a-afe0-1c4629fb0458"). InnerVolumeSpecName "kube-api-access-r5qk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:43:59.380429 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.380404    2565 generic.go:356] "Generic (PLEG): container finished" podID="ff0f4111-b153-464a-afe0-1c4629fb0458" containerID="eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751" exitCode=0
Jul 05 13:43:59.380537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.380476    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"
Jul 05 13:43:59.380537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.380488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f" event={"ID":"ff0f4111-b153-464a-afe0-1c4629fb0458","Type":"ContainerDied","Data":"eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751"}
Jul 05 13:43:59.380646 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.380562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f" event={"ID":"ff0f4111-b153-464a-afe0-1c4629fb0458","Type":"ContainerDied","Data":"cb065d24bdad91c35dc35aa0346c33c2b62efd552946e151b45ca76cab50c77c"}
Jul 05 13:43:59.380646 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.380584    2565 scope.go:117] "RemoveContainer" containerID="eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751"
Jul 05 13:43:59.389569 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.389551    2565 scope.go:117] "RemoveContainer" containerID="eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751"
Jul 05 13:43:59.389900 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:43:59.389877    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751\": container with ID starting with eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751 not found: ID does not exist" containerID="eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751"
Jul 05 13:43:59.389984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.389904    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751"} err="failed to get container status \"eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751\": rpc error: code = NotFound desc = could not find container \"eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751\": container with ID starting with eeef790e43ae987aa89a45cd512c92df79e792462e5562434f7490acfde03751 not found: ID does not exist"
Jul 05 13:43:59.402823 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.402800    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"]
Jul 05 13:43:59.407053 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.407029    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-82ec44a3-openshift-default-6d59799547-grj4f"]
Jul 05 13:43:59.409730 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.409711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-data\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.409810 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.409758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-certs\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.409810 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.409805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-podinfo\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.409917 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.409833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-envoy\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.409917 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.409884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-credential-socket\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410048 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-token\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410167 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istiod-ca-cert\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410167 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410157    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-data\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410297 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410181    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-certs\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410297 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410239    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-credential-socket\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410297 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48p7z\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-kube-api-access-48p7z\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-socket\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410386    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.410458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410401    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.410458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410414    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff0f4111-b153-464a-afe0-1c4629fb0458-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.410458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410428    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5qk4\" (UniqueName: \"kubernetes.io/projected/ff0f4111-b153-464a-afe0-1c4629fb0458-kube-api-access-r5qk4\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:43:59.410738 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410597    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-socket\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.410738 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.410639    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istiod-ca-cert\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.412030 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.412010    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-envoy\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.412239 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.412224    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-podinfo\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.419059 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.419036    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-token\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.419223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.419204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48p7z\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-kube-api-access-48p7z\") pod \"e2e-ait-986e3717-openshift-default-677557cf95-ppnnn\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") " pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.504188 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.504159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:43:59.634769 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.634738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"]
Jul 05 13:43:59.637961 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:43:59.637935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d24c2f_916a_4db8_94fc_95d28785d2ef.slice/crio-0d1bc70eca67da214c927b92408346792fa08b86f777c6578ddf211f62ef6328 WatchSource:0}: Error finding container 0d1bc70eca67da214c927b92408346792fa08b86f777c6578ddf211f62ef6328: Status 404 returned error can't find the container with id 0d1bc70eca67da214c927b92408346792fa08b86f777c6578ddf211f62ef6328
Jul 05 13:43:59.639911 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.639879    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:43:59.639979 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.639944    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:43:59.640012 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:43:59.639980    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:44:00.112773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:00.112740    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff0f4111-b153-464a-afe0-1c4629fb0458" path="/var/lib/kubelet/pods/ff0f4111-b153-464a-afe0-1c4629fb0458/volumes"
Jul 05 13:44:00.388610 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:00.388525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" event={"ID":"c6d24c2f-916a-4db8-94fc-95d28785d2ef","Type":"ContainerStarted","Data":"dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac"}
Jul 05 13:44:00.388610 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:00.388586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" event={"ID":"c6d24c2f-916a-4db8-94fc-95d28785d2ef","Type":"ContainerStarted","Data":"0d1bc70eca67da214c927b92408346792fa08b86f777c6578ddf211f62ef6328"}
Jul 05 13:44:00.422093 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:00.422038    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" podStartSLOduration=1.422022718 podStartE2EDuration="1.422022718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:44:00.421866827 +0000 UTC m=+1718.858888553" watchObservedRunningTime="2026-07-05 13:44:00.422022718 +0000 UTC m=+1718.859044463"
Jul 05 13:44:00.504340 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:00.504303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:44:00.509080 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:00.509055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:44:01.393945 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:01.393914    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:44:01.394993 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:01.394970    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:44:03.078553 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:03.078517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:44:11.443243 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:11.443208    2565 generic.go:356] "Generic (PLEG): container finished" podID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerID="dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac" exitCode=0
Jul 05 13:44:11.443694 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:11.443281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" event={"ID":"c6d24c2f-916a-4db8-94fc-95d28785d2ef","Type":"ContainerDied","Data":"dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac"}
Jul 05 13:44:11.443694 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:11.443685    2565 scope.go:117] "RemoveContainer" containerID="dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac"
Jul 05 13:44:11.444755 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:11.444726    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:44:11.444829 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:11.444811    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:44:11.444875 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:11.444861    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:44:11.886870 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:11.886837    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"]
Jul 05 13:44:12.448688 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:12.448632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" event={"ID":"c6d24c2f-916a-4db8-94fc-95d28785d2ef","Type":"ContainerStarted","Data":"7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65"}
Jul 05 13:44:12.449106 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:12.448704    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerName="istio-proxy" containerID="cri-o://7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65" gracePeriod=30
Jul 05 13:44:14.432148 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:14.432106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:44:16.394196 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:16.394165    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:44:17.705554 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.705528    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:44:17.769318 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769258    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-credential-socket\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769318 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-token\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-data\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769361    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-certs\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48p7z\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-kube-api-access-48p7z\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-socket\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769415    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-envoy\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769444    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-podinfo\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769487 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istiod-ca-cert\") pod \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\" (UID: \"c6d24c2f-916a-4db8-94fc-95d28785d2ef\") "
Jul 05 13:44:17.769848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769542    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:17.769848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769730    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:17.769848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769767    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:17.769848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769799    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.770046 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.769897    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:44:17.770368 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.770346    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:17.771622 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.771597    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:44:17.771768 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.771702    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:17.771968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.771938    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:44:17.772064 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.771986    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-kube-api-access-48p7z" (OuterVolumeSpecName: "kube-api-access-48p7z") pod "c6d24c2f-916a-4db8-94fc-95d28785d2ef" (UID: "c6d24c2f-916a-4db8-94fc-95d28785d2ef"). InnerVolumeSpecName "kube-api-access-48p7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:44:17.870676 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870635    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.870676 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870660    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.870830 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870690    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.870830 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870699    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48p7z\" (UniqueName: \"kubernetes.io/projected/c6d24c2f-916a-4db8-94fc-95d28785d2ef-kube-api-access-48p7z\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.870830 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870708    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.870830 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870717    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.870830 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870724    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:17.870830 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:17.870732    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6d24c2f-916a-4db8-94fc-95d28785d2ef-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:18.246295 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.246048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"]
Jul 05 13:44:18.246580 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.246563    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerName="istio-proxy"
Jul 05 13:44:18.246698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.246583    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerName="istio-proxy"
Jul 05 13:44:18.246797 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.246781    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerName="istio-proxy"
Jul 05 13:44:18.249250 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.249228    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.252080 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.251989    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7b43b0ed-openshift-default-dockercfg-gvp8f\""
Jul 05 13:44:18.266004 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.265980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"]
Jul 05 13:44:18.279632 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-data\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.279773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bdc29c-7362-477d-a25f-664db1c469da-istio-podinfo\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.279773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-socket\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.279773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flb6d\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-kube-api-access-flb6d\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.279773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bdc29c-7362-477d-a25f-664db1c469da-istiod-ca-cert\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.279983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-credential-socket\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.279983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-istio-token\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.279983 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.279948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-envoy\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.280092 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.280022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-certs\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.380912 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.380829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-envoy\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.380912 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.380871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-certs\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381143 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.380991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-data\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381143 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bdc29c-7362-477d-a25f-664db1c469da-istio-podinfo\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381143 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-socket\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381143 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flb6d\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-kube-api-access-flb6d\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381143 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bdc29c-7362-477d-a25f-664db1c469da-istiod-ca-cert\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381397 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-credential-socket\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381397 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-istio-token\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381397 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-certs\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381740 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381556    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-socket\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381740 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-data\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.381740 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.381626    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-credential-socket\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.382091 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.382066    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bdc29c-7362-477d-a25f-664db1c469da-istiod-ca-cert\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.383245 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.383225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-envoy\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.383510 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.383493    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bdc29c-7362-477d-a25f-664db1c469da-istio-podinfo\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.392653 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.392629    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-istio-token\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.393634 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.393610    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flb6d\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-kube-api-access-flb6d\") pod \"e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") " pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.476402 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.476372    2565 generic.go:356] "Generic (PLEG): container finished" podID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerID="7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65" exitCode=0
Jul 05 13:44:18.476516 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.476426    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"
Jul 05 13:44:18.476516 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.476449    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" event={"ID":"c6d24c2f-916a-4db8-94fc-95d28785d2ef","Type":"ContainerDied","Data":"7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65"}
Jul 05 13:44:18.476516 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.476503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn" event={"ID":"c6d24c2f-916a-4db8-94fc-95d28785d2ef","Type":"ContainerDied","Data":"0d1bc70eca67da214c927b92408346792fa08b86f777c6578ddf211f62ef6328"}
Jul 05 13:44:18.476637 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.476534    2565 scope.go:117] "RemoveContainer" containerID="7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65"
Jul 05 13:44:18.485622 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.485606    2565 scope.go:117] "RemoveContainer" containerID="dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac"
Jul 05 13:44:18.492763 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.492746    2565 scope.go:117] "RemoveContainer" containerID="7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65"
Jul 05 13:44:18.493008 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:44:18.492991    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65\": container with ID starting with 7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65 not found: ID does not exist" containerID="7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65"
Jul 05 13:44:18.493078 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.493019    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65"} err="failed to get container status \"7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65\": rpc error: code = NotFound desc = could not find container \"7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65\": container with ID starting with 7acbcba521432a3ffd968fc1fe9ead99c84df6887d2448e19aeed3fc78bcad65 not found: ID does not exist"
Jul 05 13:44:18.493078 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.493045    2565 scope.go:117] "RemoveContainer" containerID="dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac"
Jul 05 13:44:18.493289 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:44:18.493272    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac\": container with ID starting with dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac not found: ID does not exist" containerID="dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac"
Jul 05 13:44:18.493353 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.493298    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac"} err="failed to get container status \"dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac\": rpc error: code = NotFound desc = could not find container \"dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac\": container with ID starting with dad2e56b3fd8abe163d8c44490a10416b8a966f8dac07df93f1d590bfaca3dac not found: ID does not exist"
Jul 05 13:44:18.496249 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.496228    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"]
Jul 05 13:44:18.506134 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.506114    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-986e3717-openshift-default-677557cf95-ppnnn"]
Jul 05 13:44:18.561639 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.561605    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:18.715206 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.715183    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"]
Jul 05 13:44:18.717492 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:44:18.717460    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bdc29c_7362_477d_a25f_664db1c469da.slice/crio-b98a841e86cc9f07b0bee217fcafa4557e56da616e6068d1f184072bb93acbb0 WatchSource:0}: Error finding container b98a841e86cc9f07b0bee217fcafa4557e56da616e6068d1f184072bb93acbb0: Status 404 returned error can't find the container with id b98a841e86cc9f07b0bee217fcafa4557e56da616e6068d1f184072bb93acbb0
Jul 05 13:44:18.719697 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.719642    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:44:18.719797 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.719728    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:44:18.719797 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:18.719760    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:44:19.483589 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:19.483554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz" event={"ID":"02bdc29c-7362-477d-a25f-664db1c469da","Type":"ContainerStarted","Data":"9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994"}
Jul 05 13:44:19.483768 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:19.483633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz" event={"ID":"02bdc29c-7362-477d-a25f-664db1c469da","Type":"ContainerStarted","Data":"b98a841e86cc9f07b0bee217fcafa4557e56da616e6068d1f184072bb93acbb0"}
Jul 05 13:44:19.517887 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:19.517838    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz" podStartSLOduration=1.5178243120000001 podStartE2EDuration="1.517824312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:44:19.516461887 +0000 UTC m=+1737.953483611" watchObservedRunningTime="2026-07-05 13:44:19.517824312 +0000 UTC m=+1737.954846037"
Jul 05 13:44:19.562211 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:19.562185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:19.566869 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:19.566850    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:20.111725 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:20.111696    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" path="/var/lib/kubelet/pods/c6d24c2f-916a-4db8-94fc-95d28785d2ef/volumes"
Jul 05 13:44:20.489023 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:20.488944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:20.489857 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:20.489842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:24.193641 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:24.193597    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"]
Jul 05 13:44:24.194187 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:24.193790    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz" podUID="02bdc29c-7362-477d-a25f-664db1c469da" containerName="istio-proxy" containerID="cri-o://9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994" gracePeriod=30
Jul 05 13:44:29.451125 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.451064    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:29.529943 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.529913    2565 generic.go:356] "Generic (PLEG): container finished" podID="02bdc29c-7362-477d-a25f-664db1c469da" containerID="9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994" exitCode=0
Jul 05 13:44:29.530127 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.529967    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"
Jul 05 13:44:29.530127 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.530009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz" event={"ID":"02bdc29c-7362-477d-a25f-664db1c469da","Type":"ContainerDied","Data":"9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994"}
Jul 05 13:44:29.530127 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.530069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz" event={"ID":"02bdc29c-7362-477d-a25f-664db1c469da","Type":"ContainerDied","Data":"b98a841e86cc9f07b0bee217fcafa4557e56da616e6068d1f184072bb93acbb0"}
Jul 05 13:44:29.530127 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.530126    2565 scope.go:117] "RemoveContainer" containerID="9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994"
Jul 05 13:44:29.538512 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.538496    2565 scope.go:117] "RemoveContainer" containerID="9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994"
Jul 05 13:44:29.538797 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:44:29.538772    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994\": container with ID starting with 9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994 not found: ID does not exist" containerID="9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994"
Jul 05 13:44:29.538872 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.538806    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994"} err="failed to get container status \"9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994\": rpc error: code = NotFound desc = could not find container \"9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994\": container with ID starting with 9b46323f518dcde04921a70177844496f4d21ba35e646f95a9f5be335dadd994 not found: ID does not exist"
Jul 05 13:44:29.583637 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-data\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583748 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583682    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bdc29c-7362-477d-a25f-664db1c469da-istiod-ca-cert\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583748 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-istio-token\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583748 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583722    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-envoy\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583860 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bdc29c-7362-477d-a25f-664db1c469da-istio-podinfo\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583860 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583811    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-socket\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583860 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583831    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-certs\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-credential-socket\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.583991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583860    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-data" (OuterVolumeSpecName: "istio-data") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:29.583991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.583889    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flb6d\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-kube-api-access-flb6d\") pod \"02bdc29c-7362-477d-a25f-664db1c469da\" (UID: \"02bdc29c-7362-477d-a25f-664db1c469da\") "
Jul 05 13:44:29.584128 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584026    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02bdc29c-7362-477d-a25f-664db1c469da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:44:29.584212 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584128    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:29.584212 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584148    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:29.584303 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584275    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:29.584346 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584282    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.584346 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584325    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bdc29c-7362-477d-a25f-664db1c469da-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.584346 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584339    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.584463 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.584352    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.586408 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.586379    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-istio-token" (OuterVolumeSpecName: "istio-token") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:44:29.586408 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.586387    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-kube-api-access-flb6d" (OuterVolumeSpecName: "kube-api-access-flb6d") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "kube-api-access-flb6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:44:29.586543 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.586408    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:44:29.586543 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.586428    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02bdc29c-7362-477d-a25f-664db1c469da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02bdc29c-7362-477d-a25f-664db1c469da" (UID: "02bdc29c-7362-477d-a25f-664db1c469da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:44:29.684991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.684958    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.684991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.684986    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.684991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.684998    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bdc29c-7362-477d-a25f-664db1c469da-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.685286 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.685012    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bdc29c-7362-477d-a25f-664db1c469da-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.685286 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.685023    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flb6d\" (UniqueName: \"kubernetes.io/projected/02bdc29c-7362-477d-a25f-664db1c469da-kube-api-access-flb6d\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:44:29.854718 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.854689    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"]
Jul 05 13:44:29.857471 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:29.857447    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7b43b0ed-openshift-default-66d544dd79-wt6kz"]
Jul 05 13:44:30.112867 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:44:30.112793    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02bdc29c-7362-477d-a25f-664db1c469da" path="/var/lib/kubelet/pods/02bdc29c-7362-477d-a25f-664db1c469da/volumes"
Jul 05 13:45:22.070294 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:45:22.070268    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:45:22.077234 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:45:22.077214    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:45:54.735222 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:45:54.735190    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:46:04.442773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:04.442737    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:46:07.393961 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.393930    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"]
Jul 05 13:46:07.394419 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.394396    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02bdc29c-7362-477d-a25f-664db1c469da" containerName="istio-proxy"
Jul 05 13:46:07.394419 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.394416    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02bdc29c-7362-477d-a25f-664db1c469da" containerName="istio-proxy"
Jul 05 13:46:07.394541 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.394429    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerName="istio-proxy"
Jul 05 13:46:07.394541 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.394435    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerName="istio-proxy"
Jul 05 13:46:07.394541 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.394489    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02bdc29c-7362-477d-a25f-664db1c469da" containerName="istio-proxy"
Jul 05 13:46:07.394541 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.394497    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d24c2f-916a-4db8-94fc-95d28785d2ef" containerName="istio-proxy"
Jul 05 13:46:07.397723 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.397704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.400243 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.400202    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5fbdd8c5-openshift-default-dockercfg-82vm9\""
Jul 05 13:46:07.410214 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.410189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"]
Jul 05 13:46:07.509786 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.509752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-data\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.509968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.509793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-socket\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.509968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.509817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-token\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.509968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.509892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-credential-socket\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.509968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.509940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92eafd49-bb92-4b87-82bb-3203f0b48080-istiod-ca-cert\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.510186 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.509969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-podinfo\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.510186 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.510000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-envoy\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.510186 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.510027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-certs\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.510186 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.510083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2klw\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-kube-api-access-l2klw\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611343 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-credential-socket\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611523 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92eafd49-bb92-4b87-82bb-3203f0b48080-istiod-ca-cert\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611523 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-podinfo\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611647 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-envoy\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611647 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-certs\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611647 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2klw\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-kube-api-access-l2klw\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611647 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-data\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-socket\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-token\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.611897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611795    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-credential-socket\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.612067 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.611997    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-data\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.612130 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.612076    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92eafd49-bb92-4b87-82bb-3203f0b48080-istiod-ca-cert\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.612130 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.612077    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-socket\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.612236 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.612216    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-certs\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.613849 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.613833    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-envoy\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.613973 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.613958    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-podinfo\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.620733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.620712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-token\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.621806 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.621787    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2klw\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-kube-api-access-l2klw\") pod \"e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") " pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.709285 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.709229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:07.846760 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.846736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"]
Jul 05 13:46:07.851075 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:46:07.851047    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92eafd49_bb92_4b87_82bb_3203f0b48080.slice/crio-442e2497a08e9191f650a5b422d270bcb622ca99c970c47120cc757b93bd3c90 WatchSource:0}: Error finding container 442e2497a08e9191f650a5b422d270bcb622ca99c970c47120cc757b93bd3c90: Status 404 returned error can't find the container with id 442e2497a08e9191f650a5b422d270bcb622ca99c970c47120cc757b93bd3c90
Jul 05 13:46:07.852826 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.852786    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:07.852913 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.852871    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:07.852951 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.852912    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:07.969341 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.969254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" event={"ID":"92eafd49-bb92-4b87-82bb-3203f0b48080","Type":"ContainerStarted","Data":"8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60"}
Jul 05 13:46:07.969341 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.969317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" event={"ID":"92eafd49-bb92-4b87-82bb-3203f0b48080","Type":"ContainerStarted","Data":"442e2497a08e9191f650a5b422d270bcb622ca99c970c47120cc757b93bd3c90"}
Jul 05 13:46:07.992874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:07.992815    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" podStartSLOduration=0.992794931 podStartE2EDuration="992.794931ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:46:07.990847931 +0000 UTC m=+1846.427869655" watchObservedRunningTime="2026-07-05 13:46:07.992794931 +0000 UTC m=+1846.429816658"
Jul 05 13:46:08.710111 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:08.710076    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:08.714852 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:08.714829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:08.974050 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:08.973970    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:08.975005 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:08.974984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:13.462103 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:13.462066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:46:21.039905 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:21.039874    2565 generic.go:356] "Generic (PLEG): container finished" podID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerID="8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60" exitCode=0
Jul 05 13:46:21.040286 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:21.039928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" event={"ID":"92eafd49-bb92-4b87-82bb-3203f0b48080","Type":"ContainerDied","Data":"8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60"}
Jul 05 13:46:21.040344 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:21.040327    2565 scope.go:117] "RemoveContainer" containerID="8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60"
Jul 05 13:46:21.041317 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:21.041288    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:21.041378 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:21.041352    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:21.041413 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:21.041383    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:22.047561 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:22.047527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" event={"ID":"92eafd49-bb92-4b87-82bb-3203f0b48080","Type":"ContainerStarted","Data":"1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1"}
Jul 05 13:46:22.711154 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:22.711117    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:22.711592 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:22.711562    2565 patch_prober.go:28] interesting pod/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 05 13:46:22.711851 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:22.711822    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 05 13:46:23.710515 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:23.710462    2565 patch_prober.go:28] interesting pod/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 05 13:46:23.711197 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:23.711164    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 05 13:46:23.973990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:23.973896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:24.710207 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:24.710168    2565 patch_prober.go:28] interesting pod/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 05 13:46:24.710499 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:24.710471    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 05 13:46:25.710581 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:25.710540    2565 patch_prober.go:28] interesting pod/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 05 13:46:25.711284 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:25.711249    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 05 13:46:26.633838 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:26.633804    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:46:26.713084 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:26.713050    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:26.714015 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:26.713997    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:28.989417 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:28.989375    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"]
Jul 05 13:46:28.989924 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:28.989720    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy" containerID="cri-o://1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1" gracePeriod=30
Jul 05 13:46:34.250751 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.250683    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:34.281164 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281136    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-data\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281173    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-credential-socket\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-envoy\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92eafd49-bb92-4b87-82bb-3203f0b48080-istiod-ca-cert\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281285    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-certs\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281312    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-socket\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281389    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-podinfo\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281417    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-token\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281457    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2klw\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-kube-api-access-l2klw\") pod \"92eafd49-bb92-4b87-82bb-3203f0b48080\" (UID: \"92eafd49-bb92-4b87-82bb-3203f0b48080\") "
Jul 05 13:46:34.281598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281486    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:46:34.281598 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281583    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:46:34.281903 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281694    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:46:34.281903 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281803    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.281903 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281821    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.281903 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.281834    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.282101 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.282058    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-data" (OuterVolumeSpecName: "istio-data") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:46:34.282101 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.282062    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92eafd49-bb92-4b87-82bb-3203f0b48080-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:46:34.283753 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.283722    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-token" (OuterVolumeSpecName: "istio-token") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:46:34.283884 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.283763    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-kube-api-access-l2klw" (OuterVolumeSpecName: "kube-api-access-l2klw") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "kube-api-access-l2klw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:46:34.284004 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.283977    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:46:34.284099 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.284026    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92eafd49-bb92-4b87-82bb-3203f0b48080" (UID: "92eafd49-bb92-4b87-82bb-3203f0b48080"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:46:34.382791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.382754    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.382791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.382784    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.382791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.382793    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92eafd49-bb92-4b87-82bb-3203f0b48080-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.382791 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.382801    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.383060 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.382809    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.383060 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:34.382817    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2klw\" (UniqueName: \"kubernetes.io/projected/92eafd49-bb92-4b87-82bb-3203f0b48080-kube-api-access-l2klw\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:46:35.106456 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.106421    2565 generic.go:356] "Generic (PLEG): container finished" podID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerID="1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1" exitCode=0
Jul 05 13:46:35.106456 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.106460    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"
Jul 05 13:46:35.106733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.106493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" event={"ID":"92eafd49-bb92-4b87-82bb-3203f0b48080","Type":"ContainerDied","Data":"1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1"}
Jul 05 13:46:35.106733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.106545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5" event={"ID":"92eafd49-bb92-4b87-82bb-3203f0b48080","Type":"ContainerDied","Data":"442e2497a08e9191f650a5b422d270bcb622ca99c970c47120cc757b93bd3c90"}
Jul 05 13:46:35.106733 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.106569    2565 scope.go:117] "RemoveContainer" containerID="1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1"
Jul 05 13:46:35.116202 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.116033    2565 scope.go:117] "RemoveContainer" containerID="8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60"
Jul 05 13:46:35.123772 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.123753    2565 scope.go:117] "RemoveContainer" containerID="1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1"
Jul 05 13:46:35.124016 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:46:35.123996    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1\": container with ID starting with 1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1 not found: ID does not exist" containerID="1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1"
Jul 05 13:46:35.124066 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.124024    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1"} err="failed to get container status \"1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1\": rpc error: code = NotFound desc = could not find container \"1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1\": container with ID starting with 1279a2e4d71ee92c683268dee15cddf6a9b0f5923711f50e884d1b7aca3ec3a1 not found: ID does not exist"
Jul 05 13:46:35.124066 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.124041    2565 scope.go:117] "RemoveContainer" containerID="8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60"
Jul 05 13:46:35.124282 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:46:35.124263    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60\": container with ID starting with 8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60 not found: ID does not exist" containerID="8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60"
Jul 05 13:46:35.124319 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.124289    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60"} err="failed to get container status \"8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60\": rpc error: code = NotFound desc = could not find container \"8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60\": container with ID starting with 8ea483be304115148294cecaab61dd1ee295b102758e5e1af34f857b68c39f60 not found: ID does not exist"
Jul 05 13:46:35.136127 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.136093    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"]
Jul 05 13:46:35.147163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:35.147141    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5fbdd8c5-openshift-default-bc676bc75-z8gg5"]
Jul 05 13:46:36.112966 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:36.112928    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" path="/var/lib/kubelet/pods/92eafd49-bb92-4b87-82bb-3203f0b48080/volumes"
Jul 05 13:46:49.471869 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.471782    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"]
Jul 05 13:46:49.472309 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.472280    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy"
Jul 05 13:46:49.472309 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.472297    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy"
Jul 05 13:46:49.472430 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.472417    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy"
Jul 05 13:46:49.475278 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.475253    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.479105 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.479085    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6522870d-openshift-default-dockercfg-dznbm\""
Jul 05 13:46:49.515755 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.515718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-data\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.515909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.515763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-socket\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.515909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.515785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-token\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.515909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.515842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istiod-ca-cert\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.515909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.515875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5t68\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-kube-api-access-v5t68\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.516070 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.515947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-credential-socket\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.516070 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.515988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-envoy\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.516070 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.516006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-podinfo\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.516070 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.516033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-certs\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617483 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-credential-socket\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617660 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-envoy\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617660 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-podinfo\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617660 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-certs\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617660 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-data\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-socket\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-token\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istiod-ca-cert\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.617897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.617799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5t68\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-kube-api-access-v5t68\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.618088 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.618072    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-credential-socket\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.618414 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.618377    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-socket\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.618545 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.618424    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-data\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.618545 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.618435    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-certs\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.618693 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.618580    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istiod-ca-cert\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.620089 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.620060    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-envoy\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.620233 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.620214    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-podinfo\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.634633 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.634603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"]
Jul 05 13:46:49.637537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.637519    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-token\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.641739 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.641717    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5t68\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-kube-api-access-v5t68\") pod \"e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") " pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.786308 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.786280    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:49.949638 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.949613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"]
Jul 05 13:46:49.951809 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:46:49.951780    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1fd7e5_6c1b_4e9e_a019_0b1e50f7bfd4.slice/crio-c3cc516f8a622ed2d36d8cde4c9631a1b2bf144165725b94f0c7bd5107ae3d82 WatchSource:0}: Error finding container c3cc516f8a622ed2d36d8cde4c9631a1b2bf144165725b94f0c7bd5107ae3d82: Status 404 returned error can't find the container with id c3cc516f8a622ed2d36d8cde4c9631a1b2bf144165725b94f0c7bd5107ae3d82
Jul 05 13:46:49.953898 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.953864    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:49.953981 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.953933    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:49.953981 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:49.953963    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:46:50.180027 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:50.179933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" event={"ID":"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4","Type":"ContainerStarted","Data":"0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443"}
Jul 05 13:46:50.180027 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:50.179999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" event={"ID":"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4","Type":"ContainerStarted","Data":"c3cc516f8a622ed2d36d8cde4c9631a1b2bf144165725b94f0c7bd5107ae3d82"}
Jul 05 13:46:50.231578 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:50.231528    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" podStartSLOduration=1.231512062 podStartE2EDuration="1.231512062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:46:50.231146317 +0000 UTC m=+1888.668168043" watchObservedRunningTime="2026-07-05 13:46:50.231512062 +0000 UTC m=+1888.668533993"
Jul 05 13:46:50.786748 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:50.786714    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:51.791016 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:51.790984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:52.189469 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:52.189390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:52.190484 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:52.190466    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:46:55.044815 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:46:55.044781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:47:03.254524 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:03.254489    2565 generic.go:356] "Generic (PLEG): container finished" podID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerID="0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443" exitCode=0
Jul 05 13:47:03.254967 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:03.254561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" event={"ID":"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4","Type":"ContainerDied","Data":"0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443"}
Jul 05 13:47:03.254967 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:03.254962    2565 scope.go:117] "RemoveContainer" containerID="0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443"
Jul 05 13:47:03.255932 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:03.255903    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:47:03.256033 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:03.255962    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:47:03.256033 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:03.255991    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:47:04.183014 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.182982    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"]
Jul 05 13:47:04.183391 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.183371    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy"
Jul 05 13:47:04.183391 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.183389    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy"
Jul 05 13:47:04.183566 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.183458    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92eafd49-bb92-4b87-82bb-3203f0b48080" containerName="istio-proxy"
Jul 05 13:47:04.185299 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.185285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.187833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.187813    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6522870d\"/\"openshift-service-ca.crt\""
Jul 05 13:47:04.188727 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.188709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6522870d\"/\"default-dockercfg-cwzkm\""
Jul 05 13:47:04.188918 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.188806    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6522870d\"/\"e2e-lifecycle-model-6522870d-kserve-self-signed-certs\""
Jul 05 13:47:04.189012 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.188811    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6522870d\"/\"kube-root-ca.crt\""
Jul 05 13:47:04.212572 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.212537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"]
Jul 05 13:47:04.261133 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.261101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" event={"ID":"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4","Type":"ContainerStarted","Data":"586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9"}
Jul 05 13:47:04.267761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.267740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-dshm\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.267869 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.267768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-tmp-dir\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.267869 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.267787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x7pn\" (UniqueName: \"kubernetes.io/projected/57469a6c-0caf-4d05-a360-1ea506fe5f69-kube-api-access-6x7pn\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.267947 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.267908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57469a6c-0caf-4d05-a360-1ea506fe5f69-tls-certs\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.267947 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.267931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-home\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.268058 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.268031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-model-cache\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369246 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-dshm\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369442 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-tmp-dir\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369442 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x7pn\" (UniqueName: \"kubernetes.io/projected/57469a6c-0caf-4d05-a360-1ea506fe5f69-kube-api-access-6x7pn\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369587 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57469a6c-0caf-4d05-a360-1ea506fe5f69-tls-certs\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369587 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-home\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369745 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-model-cache\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369745 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369725    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-tmp-dir\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369929 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-home\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.369991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.369979    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-model-cache\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.371552 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.371531    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-dshm\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.371873 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.371858    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57469a6c-0caf-4d05-a360-1ea506fe5f69-tls-certs\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.381124 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.381104    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x7pn\" (UniqueName: \"kubernetes.io/projected/57469a6c-0caf-4d05-a360-1ea506fe5f69-kube-api-access-6x7pn\") pod \"e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") " pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.510778 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.510406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:04.669521 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.669491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"]
Jul 05 13:47:04.671461 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:47:04.671427    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57469a6c_0caf_4d05_a360_1ea506fe5f69.slice/crio-97ee43b476ea6ed109f631e0ca749bf1d19c62c16c3cd913c1daee43bf0a305e WatchSource:0}: Error finding container 97ee43b476ea6ed109f631e0ca749bf1d19c62c16c3cd913c1daee43bf0a305e: Status 404 returned error can't find the container with id 97ee43b476ea6ed109f631e0ca749bf1d19c62c16c3cd913c1daee43bf0a305e
Jul 05 13:47:04.787187 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.787155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:47:04.787952 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.787931    2565 patch_prober.go:28] interesting pod/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 05 13:47:04.788033 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:04.787974    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 05 13:47:05.267922 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:05.267819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn" event={"ID":"57469a6c-0caf-4d05-a360-1ea506fe5f69","Type":"ContainerStarted","Data":"562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10"}
Jul 05 13:47:05.267922 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:05.267863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn" event={"ID":"57469a6c-0caf-4d05-a360-1ea506fe5f69","Type":"ContainerStarted","Data":"97ee43b476ea6ed109f631e0ca749bf1d19c62c16c3cd913c1daee43bf0a305e"}
Jul 05 13:47:05.289602 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:05.289548    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn" podStartSLOduration=1.289534228 podStartE2EDuration="1.289534228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:47:05.287363921 +0000 UTC m=+1903.724385624" watchObservedRunningTime="2026-07-05 13:47:05.289534228 +0000 UTC m=+1903.726555953"
Jul 05 13:47:05.787394 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:05.787352    2565 patch_prober.go:28] interesting pod/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 05 13:47:05.787564 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:05.787424    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 05 13:47:06.787302 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:06.787263    2565 patch_prober.go:28] interesting pod/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 05 13:47:06.787728 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:06.787328    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 05 13:47:07.190341 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:07.190256    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:47:07.787424 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:07.787387    2565 patch_prober.go:28] interesting pod/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 05 13:47:07.787846 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:07.787442    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 05 13:47:08.432297 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:08.432264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:47:08.791126 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:08.791099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:47:08.792167 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:08.792145    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:47:14.511490 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:14.511461    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:14.511883 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:14.511511    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:14.524026 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:14.524005    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:15.322428 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:15.322398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:21.742923 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:21.742887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:47:30.932943 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:30.932902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:47:35.597969 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:35.597931    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"]
Jul 05 13:47:40.241803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:40.241769    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:47:50.617796 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.617751    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn" podUID="57469a6c-0caf-4d05-a360-1ea506fe5f69" containerName="main" containerID="cri-o://562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10" gracePeriod=45
Jul 05 13:47:50.867225 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.867196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:50.996392 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996299    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-dshm\") pod \"57469a6c-0caf-4d05-a360-1ea506fe5f69\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") "
Jul 05 13:47:50.996392 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996354    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-tmp-dir\") pod \"57469a6c-0caf-4d05-a360-1ea506fe5f69\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") "
Jul 05 13:47:50.996613 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996442    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57469a6c-0caf-4d05-a360-1ea506fe5f69-tls-certs\") pod \"57469a6c-0caf-4d05-a360-1ea506fe5f69\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") "
Jul 05 13:47:50.996613 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996464    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-model-cache\") pod \"57469a6c-0caf-4d05-a360-1ea506fe5f69\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") "
Jul 05 13:47:50.996613 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996491    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x7pn\" (UniqueName: \"kubernetes.io/projected/57469a6c-0caf-4d05-a360-1ea506fe5f69-kube-api-access-6x7pn\") pod \"57469a6c-0caf-4d05-a360-1ea506fe5f69\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") "
Jul 05 13:47:50.996613 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996530    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-home\") pod \"57469a6c-0caf-4d05-a360-1ea506fe5f69\" (UID: \"57469a6c-0caf-4d05-a360-1ea506fe5f69\") "
Jul 05 13:47:50.996613 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996592    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57469a6c-0caf-4d05-a360-1ea506fe5f69" (UID: "57469a6c-0caf-4d05-a360-1ea506fe5f69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:47:50.996869 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996744    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-model-cache" (OuterVolumeSpecName: "model-cache") pod "57469a6c-0caf-4d05-a360-1ea506fe5f69" (UID: "57469a6c-0caf-4d05-a360-1ea506fe5f69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:47:50.996931 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996919    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-tmp-dir\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:47:50.996981 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996942    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-model-cache\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:47:50.996981 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.996949    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-home" (OuterVolumeSpecName: "home") pod "57469a6c-0caf-4d05-a360-1ea506fe5f69" (UID: "57469a6c-0caf-4d05-a360-1ea506fe5f69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:47:50.998436 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.998415    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-dshm" (OuterVolumeSpecName: "dshm") pod "57469a6c-0caf-4d05-a360-1ea506fe5f69" (UID: "57469a6c-0caf-4d05-a360-1ea506fe5f69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:47:50.998535 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.998499    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57469a6c-0caf-4d05-a360-1ea506fe5f69-kube-api-access-6x7pn" (OuterVolumeSpecName: "kube-api-access-6x7pn") pod "57469a6c-0caf-4d05-a360-1ea506fe5f69" (UID: "57469a6c-0caf-4d05-a360-1ea506fe5f69"). InnerVolumeSpecName "kube-api-access-6x7pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:47:50.998593 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:50.998578    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57469a6c-0caf-4d05-a360-1ea506fe5f69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57469a6c-0caf-4d05-a360-1ea506fe5f69" (UID: "57469a6c-0caf-4d05-a360-1ea506fe5f69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:47:51.097478 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.097447    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57469a6c-0caf-4d05-a360-1ea506fe5f69-tls-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:47:51.097478 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.097474    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x7pn\" (UniqueName: \"kubernetes.io/projected/57469a6c-0caf-4d05-a360-1ea506fe5f69-kube-api-access-6x7pn\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:47:51.097478 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.097483    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-home\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:47:51.097730 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.097491    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57469a6c-0caf-4d05-a360-1ea506fe5f69-dshm\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:47:51.473536 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.473506    2565 generic.go:356] "Generic (PLEG): container finished" podID="57469a6c-0caf-4d05-a360-1ea506fe5f69" containerID="562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10" exitCode=0
Jul 05 13:47:51.473754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.473550    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"
Jul 05 13:47:51.473754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.473586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn" event={"ID":"57469a6c-0caf-4d05-a360-1ea506fe5f69","Type":"ContainerDied","Data":"562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10"}
Jul 05 13:47:51.473754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.473634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn" event={"ID":"57469a6c-0caf-4d05-a360-1ea506fe5f69","Type":"ContainerDied","Data":"97ee43b476ea6ed109f631e0ca749bf1d19c62c16c3cd913c1daee43bf0a305e"}
Jul 05 13:47:51.473754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.473657    2565 scope.go:117] "RemoveContainer" containerID="562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10"
Jul 05 13:47:51.483229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.483215    2565 scope.go:117] "RemoveContainer" containerID="562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10"
Jul 05 13:47:51.483474 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:47:51.483455    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10\": container with ID starting with 562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10 not found: ID does not exist" containerID="562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10"
Jul 05 13:47:51.483514 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.483481    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10"} err="failed to get container status \"562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10\": rpc error: code = NotFound desc = could not find container \"562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10\": container with ID starting with 562b9d7ba13b2a0150255519b984387739b5cc493811bb1e87357c2dd03ebb10 not found: ID does not exist"
Jul 05 13:47:51.496028 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.496001    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"]
Jul 05 13:47:51.499215 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:51.499196    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6522870d/e2e-lifecycle-model-6522870d-kserve-c4dbc9f87-8ctbn"]
Jul 05 13:47:52.113154 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:47:52.113113    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57469a6c-0caf-4d05-a360-1ea506fe5f69" path="/var/lib/kubelet/pods/57469a6c-0caf-4d05-a360-1ea506fe5f69/volumes"
Jul 05 13:48:15.329092 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:15.328998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:48:19.923463 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:19.923425    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"]
Jul 05 13:48:19.923890 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:19.923637    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy" containerID="cri-o://586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9" gracePeriod=30
Jul 05 13:48:23.794055 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:23.794014    2565 patch_prober.go:28] interesting pod/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 13:48:23.794439 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:23.794075    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:48:24.461930 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:24.461892    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:48:25.171216 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.171182    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:48:25.304530 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304495    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-socket\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.304530 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304530    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istiod-ca-cert\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.304818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304561    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-token\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.304818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304587    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-podinfo\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.304818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-credential-socket\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.304818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304736    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-certs\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.304818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304769    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-data\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.304818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5t68\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-kube-api-access-v5t68\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.305119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304833    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-envoy\") pod \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\" (UID: \"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4\") "
Jul 05 13:48:25.305119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304882    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:48:25.305119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304955    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:48:25.305119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.304987    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:48:25.305119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.305003    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:48:25.305462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.305179    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.305462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.305198    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.305462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.305210    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.305462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.305223    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.305916 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.305886    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:48:25.306906 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.306876    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:48:25.307032 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.307008    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:48:25.307101 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.307049    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:48:25.307309 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.307290    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-kube-api-access-v5t68" (OuterVolumeSpecName: "kube-api-access-v5t68") pod "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" (UID: "af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4"). InnerVolumeSpecName "kube-api-access-v5t68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:48:25.406165 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.406129    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.406165 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.406158    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.406165 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.406167    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5t68\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-kube-api-access-v5t68\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.406165 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.406176    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.406436 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.406185    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:48:25.629163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.629069    2565 generic.go:356] "Generic (PLEG): container finished" podID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerID="586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9" exitCode=0
Jul 05 13:48:25.629163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.629125    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"
Jul 05 13:48:25.629393 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.629120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" event={"ID":"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4","Type":"ContainerDied","Data":"586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9"}
Jul 05 13:48:25.629393 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.629248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk" event={"ID":"af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4","Type":"ContainerDied","Data":"c3cc516f8a622ed2d36d8cde4c9631a1b2bf144165725b94f0c7bd5107ae3d82"}
Jul 05 13:48:25.629393 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.629282    2565 scope.go:117] "RemoveContainer" containerID="586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9"
Jul 05 13:48:25.639010 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.638992    2565 scope.go:117] "RemoveContainer" containerID="0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443"
Jul 05 13:48:25.646892 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.646875    2565 scope.go:117] "RemoveContainer" containerID="586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9"
Jul 05 13:48:25.647134 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:48:25.647117    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9\": container with ID starting with 586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9 not found: ID does not exist" containerID="586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9"
Jul 05 13:48:25.647183 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.647140    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9"} err="failed to get container status \"586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9\": rpc error: code = NotFound desc = could not find container \"586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9\": container with ID starting with 586d3ab4a1f73f396f1b284c20662308cb5d12825d24422716d677c99fcc33c9 not found: ID does not exist"
Jul 05 13:48:25.647183 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.647158    2565 scope.go:117] "RemoveContainer" containerID="0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443"
Jul 05 13:48:25.647386 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:48:25.647370    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443\": container with ID starting with 0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443 not found: ID does not exist" containerID="0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443"
Jul 05 13:48:25.647438 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.647390    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443"} err="failed to get container status \"0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443\": rpc error: code = NotFound desc = could not find container \"0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443\": container with ID starting with 0419a57dcfd23a9f7d854415741d142384d2bc71c51ab2972c76ee2b83127443 not found: ID does not exist"
Jul 05 13:48:25.668304 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.668279    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"]
Jul 05 13:48:25.677021 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:25.676989    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6522870d-openshift-default-8749d8bcf-cvzfk"]
Jul 05 13:48:26.111800 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:26.111770    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" path="/var/lib/kubelet/pods/af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4/volumes"
Jul 05 13:48:37.962293 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:48:37.962255    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:49:16.849849 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.849812    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"]
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850142    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57469a6c-0caf-4d05-a360-1ea506fe5f69" containerName="main"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850153    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57469a6c-0caf-4d05-a360-1ea506fe5f69" containerName="main"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850169    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850175    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850181    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850187    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850258    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850264    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="57469a6c-0caf-4d05-a360-1ea506fe5f69" containerName="main"
Jul 05 13:49:16.850412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.850270    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1fd7e5-6c1b-4e9e-a019-0b1e50f7bfd4" containerName="istio-proxy"
Jul 05 13:49:16.853342 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.853320    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.856843 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.856819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-84bdd7-openshift-default-dockercfg-lmw8p\""
Jul 05 13:49:16.970422 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-podinfo\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.970422 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srl4h\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-kube-api-access-srl4h\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.970696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-socket\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.970696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-token\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.970696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-credential-socket\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.970696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-certs\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.970696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-envoy\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.970696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-data\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:16.971002 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:16.970729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istiod-ca-cert\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.032300 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.032261    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"]
Jul 05 13:49:17.071316 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-data\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071316 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istiod-ca-cert\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071549 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-podinfo\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071549 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srl4h\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-kube-api-access-srl4h\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071549 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-socket\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071549 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-token\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071549 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-credential-socket\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071836 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-certs\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071836 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-envoy\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.071836 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071766    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-data\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.072002 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.071838    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-socket\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.072147 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.072126    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-credential-socket\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.072214 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.072197    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-certs\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.072270 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.072245    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istiod-ca-cert\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.074309 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.074287    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-envoy\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.074418 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.074400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-podinfo\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.088003 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.087976    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srl4h\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-kube-api-access-srl4h\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.199647 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.199583    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-token\") pod \"e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") " pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.463453 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.463359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:17.619593 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.619569    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"]
Jul 05 13:49:17.621968 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:49:17.621937    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb6756b_e81a_489d_b1a4_aa6b139bd038.slice/crio-2755edfda56d37171da830a9d9574e9122c350d7ecfdabdabb685dc6c0719565 WatchSource:0}: Error finding container 2755edfda56d37171da830a9d9574e9122c350d7ecfdabdabb685dc6c0719565: Status 404 returned error can't find the container with id 2755edfda56d37171da830a9d9574e9122c350d7ecfdabdabb685dc6c0719565
Jul 05 13:49:17.624114 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.624080    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:17.624184 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.624146    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:17.624184 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.624174    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:17.863019 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.862983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" event={"ID":"cdb6756b-e81a-489d-b1a4-aa6b139bd038","Type":"ContainerStarted","Data":"904bd8475915d7749d64573158883f152fbc5817193a5a76959a05b47405e819"}
Jul 05 13:49:17.863507 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:17.863050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" event={"ID":"cdb6756b-e81a-489d-b1a4-aa6b139bd038","Type":"ContainerStarted","Data":"2755edfda56d37171da830a9d9574e9122c350d7ecfdabdabb685dc6c0719565"}
Jul 05 13:49:18.464097 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:18.464062    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:18.468982 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:18.468955    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:18.516002 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:18.515951    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" podStartSLOduration=2.515935156 podStartE2EDuration="2.515935156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:49:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:49:17.919415658 +0000 UTC m=+2036.356437383" watchObservedRunningTime="2026-07-05 13:49:18.515935156 +0000 UTC m=+2036.952956882"
Jul 05 13:49:18.867927 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:18.867891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:18.868749 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:18.868730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:25.226911 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.226873    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"]
Jul 05 13:49:25.231972 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.231947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.234517 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.234496    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9521b3-openshift-default-dockercfg-rtk2d\""
Jul 05 13:49:25.246537 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.246514    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"]
Jul 05 13:49:25.349895 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.349851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istiod-ca-cert\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.349895 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.349900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-socket\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.350137 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.349924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-data\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.350137 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.349968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-certs\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.350137 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.350083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj8mv\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-kube-api-access-fj8mv\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.350310 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.350147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-credential-socket\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.350310 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.350194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-podinfo\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.350310 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.350261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-token\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.350310 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.350290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-envoy\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.450993 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.450958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-credential-socket\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.450993 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.450997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-podinfo\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451206 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-token\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451206 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-envoy\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451317 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istiod-ca-cert\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451394 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-socket\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451394 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-data\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-certs\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451414    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-credential-socket\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451603 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj8mv\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-kube-api-access-fj8mv\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451741 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-socket\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.451876 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.451849    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-certs\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.452070 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.452049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-data\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.452145 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.452065    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istiod-ca-cert\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.453436 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.453414    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-envoy\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.453641 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.453623    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-podinfo\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.462608 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.462589    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj8mv\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-kube-api-access-fj8mv\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.465009 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.464983    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-token\") pod \"e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") " pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.542431 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.542398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:25.822459 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.822420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"]
Jul 05 13:49:25.823076 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:49:25.823049    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953e43ba_8e95_4838_aa6d_6e72b83c7e30.slice/crio-9f6e96e4fbe77fe937dc49609a0e82321a4fc3a5baf159c10f0366c09b383e7e WatchSource:0}: Error finding container 9f6e96e4fbe77fe937dc49609a0e82321a4fc3a5baf159c10f0366c09b383e7e: Status 404 returned error can't find the container with id 9f6e96e4fbe77fe937dc49609a0e82321a4fc3a5baf159c10f0366c09b383e7e
Jul 05 13:49:25.825350 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.825316    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:25.825414 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.825382    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:25.825414 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.825409    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:25.900318 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.900287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" event={"ID":"953e43ba-8e95-4838-aa6d-6e72b83c7e30","Type":"ContainerStarted","Data":"e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d"}
Jul 05 13:49:25.900455 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.900345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" event={"ID":"953e43ba-8e95-4838-aa6d-6e72b83c7e30","Type":"ContainerStarted","Data":"9f6e96e4fbe77fe937dc49609a0e82321a4fc3a5baf159c10f0366c09b383e7e"}
Jul 05 13:49:25.930833 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:25.930766    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podStartSLOduration=0.930746607 podStartE2EDuration="930.746607ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:49:25.930569521 +0000 UTC m=+2044.367591247" watchObservedRunningTime="2026-07-05 13:49:25.930746607 +0000 UTC m=+2044.367768334"
Jul 05 13:49:26.542976 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:26.542947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:26.547649 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:26.547626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:26.908312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:26.908219    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:26.912798 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:26.912770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:27.589073 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:27.589040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:49:34.909927 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:34.909876    2565 patch_prober.go:28] interesting pod/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 05 13:49:34.910433 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:34.909972    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 05 13:49:35.953784 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:35.953753    2565 generic.go:356] "Generic (PLEG): container finished" podID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerID="904bd8475915d7749d64573158883f152fbc5817193a5a76959a05b47405e819" exitCode=0
Jul 05 13:49:35.954210 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:35.953829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" event={"ID":"cdb6756b-e81a-489d-b1a4-aa6b139bd038","Type":"ContainerDied","Data":"904bd8475915d7749d64573158883f152fbc5817193a5a76959a05b47405e819"}
Jul 05 13:49:35.954323 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:35.954299    2565 scope.go:117] "RemoveContainer" containerID="904bd8475915d7749d64573158883f152fbc5817193a5a76959a05b47405e819"
Jul 05 13:49:35.955573 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:35.955544    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:35.955655 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:35.955613    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:35.955715 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:35.955659    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:36.960684 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:36.960646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" event={"ID":"cdb6756b-e81a-489d-b1a4-aa6b139bd038","Type":"ContainerStarted","Data":"dc503439e4a862c9e6948f1b926c0c332e44bc7c1cb8905ba19127e89535e3d8"}
Jul 05 13:49:37.146702 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.143705    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"]
Jul 05 13:49:37.157005 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.156971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.160458 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.160437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-84bdd7\"/\"default-dockercfg-n97wg\""
Jul 05 13:49:37.160782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.160765    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-84bdd7\"/\"test-model-84bdd7-kserve-self-signed-certs\""
Jul 05 13:49:37.161881 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.160911    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-84bdd7\"/\"kube-root-ca.crt\""
Jul 05 13:49:37.161881 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.160913    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-84bdd7\"/\"openshift-service-ca.crt\""
Jul 05 13:49:37.168103 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.168074    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"]
Jul 05 13:49:37.273110 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.272997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldk2m\" (UniqueName: \"kubernetes.io/projected/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-kube-api-access-ldk2m\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.273110 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.273046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-home\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.273320 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.273161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-dshm\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.273320 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.273239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-model-cache\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.273320 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.273300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tls-certs\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.273320 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.273318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tmp-dir\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.373841 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.373808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldk2m\" (UniqueName: \"kubernetes.io/projected/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-kube-api-access-ldk2m\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.373841 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.373841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-home\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.374061 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.374021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-dshm\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.374126 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.374079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-model-cache\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.374126 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.374123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tls-certs\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.374231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.374141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tmp-dir\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.374231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.374157    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-home\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.374441 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.374426    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tmp-dir\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.374441 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.374429    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-model-cache\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.376288 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.376263    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-dshm\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.376520 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.376503    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tls-certs\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.383119 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.383095    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldk2m\" (UniqueName: \"kubernetes.io/projected/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-kube-api-access-ldk2m\") pod \"test-model-84bdd7-kserve-79b9b7465f-tm5fb\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") " pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.464685 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.464629    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:37.464876 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.464698    2565 patch_prober.go:28] interesting pod/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 05 13:49:37.464876 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.464763    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 05 13:49:37.467017 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.466995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:37.551505 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.551470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:49:37.724691 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.717248    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"]
Jul 05 13:49:37.967539 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.967504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb" event={"ID":"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548","Type":"ContainerStarted","Data":"d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a"}
Jul 05 13:49:37.967991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.967556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb" event={"ID":"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548","Type":"ContainerStarted","Data":"82dc8a3c3e8bf813c3721adb61760f1a2ca7e4fb526265d407ef0c9a0ecd5dcc"}
Jul 05 13:49:37.993267 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:37.993217    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb" podStartSLOduration=0.993172139 podStartE2EDuration="993.172139ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:49:37.990898751 +0000 UTC m=+2056.427920475" watchObservedRunningTime="2026-07-05 13:49:37.993172139 +0000 UTC m=+2056.430193865"
Jul 05 13:49:38.463864 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:38.463776    2565 patch_prober.go:28] interesting pod/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 05 13:49:38.463864 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:38.463846    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 05 13:49:39.464220 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:39.464181    2565 patch_prober.go:28] interesting pod/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 05 13:49:39.464752 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:39.464246    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 05 13:49:40.464015 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:40.463976    2565 patch_prober.go:28] interesting pod/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 05 13:49:40.464206 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:40.464054    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 05 13:49:41.468158 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.468129    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:41.469447 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.468506    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:41.469447 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.469292    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:49:41.909892 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.909852    2565 patch_prober.go:28] interesting pod/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 05 13:49:41.910085 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.909917    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 05 13:49:41.989532 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.989503    2565 generic.go:356] "Generic (PLEG): container finished" podID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerID="e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d" exitCode=0
Jul 05 13:49:41.989719 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.989578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" event={"ID":"953e43ba-8e95-4838-aa6d-6e72b83c7e30","Type":"ContainerDied","Data":"e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d"}
Jul 05 13:49:41.990084 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.990068    2565 scope.go:117] "RemoveContainer" containerID="e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d"
Jul 05 13:49:41.991069 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.991041    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:41.991161 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.991116    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:41.991161 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:41.991148    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:49:43.000645 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:43.000601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" event={"ID":"953e43ba-8e95-4838-aa6d-6e72b83c7e30","Type":"ContainerStarted","Data":"d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a"}
Jul 05 13:49:43.542777 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:43.542741    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:43.542996 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:43.542973    2565 patch_prober.go:28] interesting pod/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 05 13:49:43.543043 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:43.543024    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 05 13:49:44.543457 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:44.543423    2565 patch_prober.go:28] interesting pod/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 05 13:49:44.543843 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:44.543476    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 05 13:49:45.542971 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:45.542937    2565 patch_prober.go:28] interesting pod/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 05 13:49:45.543147 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:45.542990    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 05 13:49:46.543626 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:46.543587    2565 patch_prober.go:28] interesting pod/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 05 13:49:46.544036 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:46.543637    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 05 13:49:47.288479 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:47.288443    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:49:47.467252 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:47.467219    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:47.467445 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:47.467373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:47.479816 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:47.479791    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:49:47.547209 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:47.547130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:47.547653 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:47.547394    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:47.548197 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:47.548181    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:49:48.047828 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:49:48.047801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:50:00.358351 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:00.358314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:50:13.355475 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:13.355442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:50:22.099593 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:22.099562    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:50:22.107021 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:22.106997    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:50:36.401384 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:36.401351    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"]
Jul 05 13:50:40.553803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:40.553762    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:50:51.421608 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.421548    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb" podUID="f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" containerName="main" containerID="cri-o://d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a" gracePeriod=45
Jul 05 13:50:51.670206 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.670183    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:50:51.704163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-home\") pod \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") "
Jul 05 13:50:51.704291 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704188    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-dshm\") pod \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") "
Jul 05 13:50:51.704291 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-model-cache\") pod \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") "
Jul 05 13:50:51.704291 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldk2m\" (UniqueName: \"kubernetes.io/projected/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-kube-api-access-ldk2m\") pod \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") "
Jul 05 13:50:51.704460 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tmp-dir\") pod \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") "
Jul 05 13:50:51.704460 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704366    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-home" (OuterVolumeSpecName: "home") pod "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" (UID: "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:51.704576 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tls-certs\") pod \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\" (UID: \"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548\") "
Jul 05 13:50:51.704576 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704491    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-model-cache" (OuterVolumeSpecName: "model-cache") pod "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" (UID: "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:51.704693 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704573    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" (UID: "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:51.704826 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704811    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-model-cache\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:50:51.704909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704855    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tmp-dir\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:50:51.704909 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.704869    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-home\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:50:51.706617 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.706593    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" (UID: "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:50:51.706822 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.706801    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-dshm" (OuterVolumeSpecName: "dshm") pod "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" (UID: "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:51.706894 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.706818    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-kube-api-access-ldk2m" (OuterVolumeSpecName: "kube-api-access-ldk2m") pod "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" (UID: "f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548"). InnerVolumeSpecName "kube-api-access-ldk2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:50:51.806166 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.806130    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldk2m\" (UniqueName: \"kubernetes.io/projected/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-kube-api-access-ldk2m\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:50:51.806166 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.806165    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-tls-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:50:51.806166 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:51.806175    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548-dshm\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:50:52.334811 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.334778    2565 generic.go:356] "Generic (PLEG): container finished" podID="f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" containerID="d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a" exitCode=0
Jul 05 13:50:52.334948 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.334819    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"
Jul 05 13:50:52.334948 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.334828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb" event={"ID":"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548","Type":"ContainerDied","Data":"d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a"}
Jul 05 13:50:52.334948 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.334860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb" event={"ID":"f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548","Type":"ContainerDied","Data":"82dc8a3c3e8bf813c3721adb61760f1a2ca7e4fb526265d407ef0c9a0ecd5dcc"}
Jul 05 13:50:52.334948 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.334876    2565 scope.go:117] "RemoveContainer" containerID="d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a"
Jul 05 13:50:52.342888 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.342866    2565 scope.go:117] "RemoveContainer" containerID="d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a"
Jul 05 13:50:52.343123 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:50:52.343104    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a\": container with ID starting with d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a not found: ID does not exist" containerID="d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a"
Jul 05 13:50:52.343189 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.343129    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a"} err="failed to get container status \"d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a\": rpc error: code = NotFound desc = could not find container \"d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a\": container with ID starting with d606009827ce4fb9ae607782a91ed8cb3e271911632a4d918d51e2a8978c3e5a not found: ID does not exist"
Jul 05 13:50:52.375554 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.375499    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"]
Jul 05 13:50:52.389086 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:52.389061    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-84bdd7/test-model-84bdd7-kserve-79b9b7465f-tm5fb"]
Jul 05 13:50:54.112284 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:50:54.112248    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" path="/var/lib/kubelet/pods/f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548/volumes"
Jul 05 13:51:20.329397 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:20.329317    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"]
Jul 05 13:51:20.329914 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:20.329535    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy" containerID="cri-o://dc503439e4a862c9e6948f1b926c0c332e44bc7c1cb8905ba19127e89535e3d8" gracePeriod=30
Jul 05 13:51:24.544232 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:24.544198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:51:25.487915 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.487880    2565 generic.go:356] "Generic (PLEG): container finished" podID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerID="dc503439e4a862c9e6948f1b926c0c332e44bc7c1cb8905ba19127e89535e3d8" exitCode=0
Jul 05 13:51:25.488081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.487932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" event={"ID":"cdb6756b-e81a-489d-b1a4-aa6b139bd038","Type":"ContainerDied","Data":"dc503439e4a862c9e6948f1b926c0c332e44bc7c1cb8905ba19127e89535e3d8"}
Jul 05 13:51:25.488081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.487992    2565 scope.go:117] "RemoveContainer" containerID="904bd8475915d7749d64573158883f152fbc5817193a5a76959a05b47405e819"
Jul 05 13:51:25.598820 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.598766    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:51:25.630319 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630290    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srl4h\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-kube-api-access-srl4h\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630441 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630326    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istiod-ca-cert\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630441 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630361    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-podinfo\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-data\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630557 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-socket\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630697 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-certs\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630697 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-token\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630742    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-envoy\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630778    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-credential-socket\") pod \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\" (UID: \"cdb6756b-e81a-489d-b1a4-aa6b139bd038\") "
Jul 05 13:51:25.630819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630806    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:25.631076 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630735    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:51:25.631076 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.630884    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:25.631220 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.631185    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:25.632717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.632642    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.632717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.632690    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.632717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.632705    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.632926 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.632720    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.632926 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.632806    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-data" (OuterVolumeSpecName: "istio-data") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:25.633605 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.633578    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:51:25.633863 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.633843    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:25.634150 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.634089    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-kube-api-access-srl4h" (OuterVolumeSpecName: "kube-api-access-srl4h") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "kube-api-access-srl4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:51:25.634399 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.634370    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-token" (OuterVolumeSpecName: "istio-token") pod "cdb6756b-e81a-489d-b1a4-aa6b139bd038" (UID: "cdb6756b-e81a-489d-b1a4-aa6b139bd038"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:51:25.733686 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.733628    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.733686 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.733692    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.733882 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.733706    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srl4h\" (UniqueName: \"kubernetes.io/projected/cdb6756b-e81a-489d-b1a4-aa6b139bd038-kube-api-access-srl4h\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.733882 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.733720    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:25.733882 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:25.733730    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdb6756b-e81a-489d-b1a4-aa6b139bd038-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:26.493958 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:26.493876    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"
Jul 05 13:51:26.494120 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:26.493878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn" event={"ID":"cdb6756b-e81a-489d-b1a4-aa6b139bd038","Type":"ContainerDied","Data":"2755edfda56d37171da830a9d9574e9122c350d7ecfdabdabb685dc6c0719565"}
Jul 05 13:51:26.494120 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:26.494006    2565 scope.go:117] "RemoveContainer" containerID="dc503439e4a862c9e6948f1b926c0c332e44bc7c1cb8905ba19127e89535e3d8"
Jul 05 13:51:26.527520 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:26.527493    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"]
Jul 05 13:51:26.531122 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:26.531100    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-84bdd7-openshift-default-77f6b46cf5-xnldn"]
Jul 05 13:51:28.112327 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:28.112293    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" path="/var/lib/kubelet/pods/cdb6756b-e81a-489d-b1a4-aa6b139bd038/volumes"
Jul 05 13:51:28.606263 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:28.606228    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"]
Jul 05 13:51:28.606511 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:28.606482    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy" containerID="cri-o://d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a" gracePeriod=30
Jul 05 13:51:29.571874 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.571846    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"]
Jul 05 13:51:29.572231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572196    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy"
Jul 05 13:51:29.572231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572206    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy"
Jul 05 13:51:29.572231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572216    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" containerName="main"
Jul 05 13:51:29.572231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572221    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" containerName="main"
Jul 05 13:51:29.572231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572229    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy"
Jul 05 13:51:29.572231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572234    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy"
Jul 05 13:51:29.572461 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572292    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy"
Jul 05 13:51:29.572461 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572298    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f963acdc-3dc1-4e11-8fb7-ccfd5f6d8548" containerName="main"
Jul 05 13:51:29.572461 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.572308    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdb6756b-e81a-489d-b1a4-aa6b139bd038" containerName="istio-proxy"
Jul 05 13:51:29.575469 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.575449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.580829 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.580799    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e55a60-openshift-default-dockercfg-4fdf8\""
Jul 05 13:51:29.620781 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.620755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"]
Jul 05 13:51:29.667795 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.667766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgtb\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-kube-api-access-hsgtb\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.667984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.667803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-envoy\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.667984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.667847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-credential-socket\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.667984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.667891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470870c1-c341-4187-b60a-08d49fab4096-istio-podinfo\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.667984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.667931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-data\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.667984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.667967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-socket\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.668256 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.668015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-certs\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.668256 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.668045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470870c1-c341-4187-b60a-08d49fab4096-istiod-ca-cert\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.668256 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.668078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-istio-token\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769076 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-credential-socket\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769266 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470870c1-c341-4187-b60a-08d49fab4096-istio-podinfo\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769266 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-data\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769387 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-socket\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769387 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-certs\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769387 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470870c1-c341-4187-b60a-08d49fab4096-istiod-ca-cert\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-istio-token\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769474    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-credential-socket\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgtb\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-kube-api-access-hsgtb\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769740 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-envoy\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769803 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769785    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-data\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769859 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769810    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-certs\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.769859 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.769789    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-socket\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.770185 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.770164    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470870c1-c341-4187-b60a-08d49fab4096-istiod-ca-cert\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.771717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.771687    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-envoy\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.771717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.771702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470870c1-c341-4187-b60a-08d49fab4096-istio-podinfo\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.785313 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.785291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgtb\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-kube-api-access-hsgtb\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.786527 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.786505    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-istio-token\") pod \"e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") " pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:29.885943 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:29.885854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:30.030531 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:30.030506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"]
Jul 05 13:51:30.032139 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:51:30.032108    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470870c1_c341_4187_b60a_08d49fab4096.slice/crio-c77b405faa06a9e2f7e35c1f85dff392b3ec9556e232f8da4e9a6dab75aa46bf WatchSource:0}: Error finding container c77b405faa06a9e2f7e35c1f85dff392b3ec9556e232f8da4e9a6dab75aa46bf: Status 404 returned error can't find the container with id c77b405faa06a9e2f7e35c1f85dff392b3ec9556e232f8da4e9a6dab75aa46bf
Jul 05 13:51:30.034285 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:30.034254    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:30.034368 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:30.034317    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:30.034368 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:30.034347    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:30.514056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:30.514025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" event={"ID":"470870c1-c341-4187-b60a-08d49fab4096","Type":"ContainerStarted","Data":"82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2"}
Jul 05 13:51:30.514229 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:30.514075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" event={"ID":"470870c1-c341-4187-b60a-08d49fab4096","Type":"ContainerStarted","Data":"c77b405faa06a9e2f7e35c1f85dff392b3ec9556e232f8da4e9a6dab75aa46bf"}
Jul 05 13:51:30.886754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:30.886723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:31.891041 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:31.891011    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:31.921058 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:31.921007    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" podStartSLOduration=2.920992016 podStartE2EDuration="2.920992016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:51:30.541497538 +0000 UTC m=+2168.978519262" watchObservedRunningTime="2026-07-05 13:51:31.920992016 +0000 UTC m=+2170.358013741"
Jul 05 13:51:32.523035 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:32.523003    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:32.524041 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:32.524017    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:32.549920 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:32.549885    2565 patch_prober.go:28] interesting pod/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 13:51:32.550068 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:32.549952    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:51:33.861930 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.861905    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:51:33.909879 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.909808    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-token\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910034 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.909877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-certs\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910034 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.909909    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-credential-socket\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910034 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.909991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj8mv\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-kube-api-access-fj8mv\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910034 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910016    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-socket\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910262 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910041    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-data\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910262 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910069    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-envoy\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910262 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istiod-ca-cert\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910262 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-podinfo\") pod \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\" (UID: \"953e43ba-8e95-4838-aa6d-6e72b83c7e30\") "
Jul 05 13:51:33.910262 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910235    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:33.910521 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910289    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:33.910521 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910307    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:33.910631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910596    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:33.910631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910615    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:33.910631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910628    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:33.910860 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910823    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-data" (OuterVolumeSpecName: "istio-data") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:33.910947 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.910908    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:51:33.912602 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.912577    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-token" (OuterVolumeSpecName: "istio-token") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:51:33.912760 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.912736    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:51:33.912760 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.912747    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-kube-api-access-fj8mv" (OuterVolumeSpecName: "kube-api-access-fj8mv") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "kube-api-access-fj8mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:51:33.912911 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:33.912751    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "953e43ba-8e95-4838-aa6d-6e72b83c7e30" (UID: "953e43ba-8e95-4838-aa6d-6e72b83c7e30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:51:34.012106 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.012069    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:34.012106 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.012101    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj8mv\" (UniqueName: \"kubernetes.io/projected/953e43ba-8e95-4838-aa6d-6e72b83c7e30-kube-api-access-fj8mv\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:34.012106 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.012110    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:34.012312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.012118    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:34.012312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.012126    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:34.012312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.012133    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953e43ba-8e95-4838-aa6d-6e72b83c7e30-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:51:34.532725 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.532685    2565 generic.go:356] "Generic (PLEG): container finished" podID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerID="d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a" exitCode=0
Jul 05 13:51:34.532725 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.532727    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"
Jul 05 13:51:34.532968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.532758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" event={"ID":"953e43ba-8e95-4838-aa6d-6e72b83c7e30","Type":"ContainerDied","Data":"d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a"}
Jul 05 13:51:34.532968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.532815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8" event={"ID":"953e43ba-8e95-4838-aa6d-6e72b83c7e30","Type":"ContainerDied","Data":"9f6e96e4fbe77fe937dc49609a0e82321a4fc3a5baf159c10f0366c09b383e7e"}
Jul 05 13:51:34.532968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.532841    2565 scope.go:117] "RemoveContainer" containerID="d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a"
Jul 05 13:51:34.540766 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.540751    2565 scope.go:117] "RemoveContainer" containerID="e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d"
Jul 05 13:51:34.548417 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.548399    2565 scope.go:117] "RemoveContainer" containerID="d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a"
Jul 05 13:51:34.548697 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:51:34.548677    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a\": container with ID starting with d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a not found: ID does not exist" containerID="d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a"
Jul 05 13:51:34.548747 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.548706    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a"} err="failed to get container status \"d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a\": rpc error: code = NotFound desc = could not find container \"d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a\": container with ID starting with d8a041661534e9308446e5a90986e871e5997bc8461fc597aa9bebced572830a not found: ID does not exist"
Jul 05 13:51:34.548747 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.548721    2565 scope.go:117] "RemoveContainer" containerID="e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d"
Jul 05 13:51:34.548947 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:51:34.548929    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d\": container with ID starting with e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d not found: ID does not exist" containerID="e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d"
Jul 05 13:51:34.548989 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.548951    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d"} err="failed to get container status \"e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d\": rpc error: code = NotFound desc = could not find container \"e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d\": container with ID starting with e1368e9294f31b0b5c1ae1acdb4fb949a494aa42cd886fffc868c1b00a10921d not found: ID does not exist"
Jul 05 13:51:34.558650 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.558629    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"]
Jul 05 13:51:34.564720 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:34.564701    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9521b3-openshift-default-c646c6bc5-wk6m8"]
Jul 05 13:51:36.112171 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:36.112138    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" path="/var/lib/kubelet/pods/953e43ba-8e95-4838-aa6d-6e72b83c7e30/volumes"
Jul 05 13:51:37.246761 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.246724    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:51:37.879192 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.879158    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"]
Jul 05 13:51:37.879552 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.879538    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy"
Jul 05 13:51:37.879552 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.879552    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy"
Jul 05 13:51:37.879724 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.879565    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy"
Jul 05 13:51:37.879724 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.879571    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy"
Jul 05 13:51:37.879724 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.879638    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy"
Jul 05 13:51:37.879724 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.879650    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="953e43ba-8e95-4838-aa6d-6e72b83c7e30" containerName="istio-proxy"
Jul 05 13:51:37.884325 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.884304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.887175 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.887149    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-853a17-openshift-default-dockercfg-bhxdl\""
Jul 05 13:51:37.911690 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.906700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"]
Jul 05 13:51:37.949245 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-credential-socket\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949429 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-certs\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949429 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-socket\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949429 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpsqv\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-kube-api-access-zpsqv\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949429 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-envoy\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949429 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06786dad-e77f-4801-b6df-06a8b7efec31-istiod-ca-cert\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949705 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-data\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949705 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-istio-token\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:37.949705 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:37.949494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06786dad-e77f-4801-b6df-06a8b7efec31-istio-podinfo\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.050873 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.050831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-data\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.050873 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.050876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-istio-token\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051142 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.050979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06786dad-e77f-4801-b6df-06a8b7efec31-istio-podinfo\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051142 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-credential-socket\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051142 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-certs\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-socket\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpsqv\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-kube-api-access-zpsqv\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-envoy\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051312 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06786dad-e77f-4801-b6df-06a8b7efec31-istiod-ca-cert\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051547 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051307    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-data\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051547 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051387    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-credential-socket\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051547 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-certs\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.051547 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051531    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-socket\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.052000 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.051981    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06786dad-e77f-4801-b6df-06a8b7efec31-istiod-ca-cert\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.053446 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.053421    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-envoy\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.053749 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.053732    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06786dad-e77f-4801-b6df-06a8b7efec31-istio-podinfo\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.062845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.062827    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpsqv\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-kube-api-access-zpsqv\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.064799 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.064780    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-istio-token\") pod \"e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") " pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.204632 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.204288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:38.416968 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.414478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"]
Jul 05 13:51:38.423619 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:51:38.423527    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06786dad_e77f_4801_b6df_06a8b7efec31.slice/crio-a6ae497f0b853d0a5103ecab232e27eef0ff9302d10861c5a86f9ed24a64237e WatchSource:0}: Error finding container a6ae497f0b853d0a5103ecab232e27eef0ff9302d10861c5a86f9ed24a64237e: Status 404 returned error can't find the container with id a6ae497f0b853d0a5103ecab232e27eef0ff9302d10861c5a86f9ed24a64237e
Jul 05 13:51:38.430678 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.429825    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:38.430678 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.429916    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:38.430678 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.429958    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:38.560681 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.560628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" event={"ID":"06786dad-e77f-4801-b6df-06a8b7efec31","Type":"ContainerStarted","Data":"ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9"}
Jul 05 13:51:38.560848 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.560702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" event={"ID":"06786dad-e77f-4801-b6df-06a8b7efec31","Type":"ContainerStarted","Data":"a6ae497f0b853d0a5103ecab232e27eef0ff9302d10861c5a86f9ed24a64237e"}
Jul 05 13:51:38.587569 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:38.587521    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" podStartSLOduration=1.58750533 podStartE2EDuration="1.58750533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:51:38.584792483 +0000 UTC m=+2177.021814206" watchObservedRunningTime="2026-07-05 13:51:38.58750533 +0000 UTC m=+2177.024527055"
Jul 05 13:51:39.206317 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:39.206279    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:39.206953 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:39.206919    2565 patch_prober.go:28] interesting pod/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 05 13:51:39.207071 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:39.206978    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 05 13:51:40.213238 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:40.213203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:40.569731 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:40.569705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:40.570899 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:40.570877    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:45.595745 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:45.595710    2565 generic.go:356] "Generic (PLEG): container finished" podID="470870c1-c341-4187-b60a-08d49fab4096" containerID="82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2" exitCode=0
Jul 05 13:51:45.596150 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:45.595760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" event={"ID":"470870c1-c341-4187-b60a-08d49fab4096","Type":"ContainerDied","Data":"82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2"}
Jul 05 13:51:45.596193 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:45.596164    2565 scope.go:117] "RemoveContainer" containerID="82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2"
Jul 05 13:51:45.597295 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:45.597264    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:45.597374 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:45.597355    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:45.597416 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:45.597401    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:46.161932 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:46.161902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:51:46.605017 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:46.604973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" event={"ID":"470870c1-c341-4187-b60a-08d49fab4096","Type":"ContainerStarted","Data":"36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9"}
Jul 05 13:51:46.886056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:46.885962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:46.887199 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:46.887167    2565 patch_prober.go:28] interesting pod/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 05 13:51:46.887323 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:46.887248    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 05 13:51:47.523090 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:47.523048    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:47.886893 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:47.886856    2565 patch_prober.go:28] interesting pod/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 05 13:51:47.887380 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:47.886919    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 05 13:51:48.886945 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:48.886909    2565 patch_prober.go:28] interesting pod/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 05 13:51:48.887299 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:48.886973    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 05 13:51:49.886972 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:49.886934    2565 patch_prober.go:28] interesting pod/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 05 13:51:49.887423 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:49.886996    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 05 13:51:50.890360 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:50.890331    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:50.891325 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:50.891306    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:51:54.653116 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:54.653083    2565 generic.go:356] "Generic (PLEG): container finished" podID="06786dad-e77f-4801-b6df-06a8b7efec31" containerID="ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9" exitCode=0
Jul 05 13:51:54.653545 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:54.653148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" event={"ID":"06786dad-e77f-4801-b6df-06a8b7efec31","Type":"ContainerDied","Data":"ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9"}
Jul 05 13:51:54.653545 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:54.653501    2565 scope.go:117] "RemoveContainer" containerID="ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9"
Jul 05 13:51:54.654608 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:54.654574    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:54.654690 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:54.654647    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:54.654742 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:54.654707    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:51:55.570511 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:55.570480    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:55.660529 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:55.660491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" event={"ID":"06786dad-e77f-4801-b6df-06a8b7efec31","Type":"ContainerStarted","Data":"bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000"}
Jul 05 13:51:56.205483 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:56.205444    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:51:56.206688 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:56.206637    2565 patch_prober.go:28] interesting pod/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 05 13:51:56.206847 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:56.206718    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 05 13:51:57.205709 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:57.205650    2565 patch_prober.go:28] interesting pod/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 05 13:51:57.206207 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:57.205739    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 05 13:51:58.205408 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:58.205366    2565 patch_prober.go:28] interesting pod/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 05 13:51:58.205614 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:58.205430    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 05 13:51:59.205398 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:59.205361    2565 patch_prober.go:28] interesting pod/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 05 13:51:59.206007 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:59.205966    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 05 13:51:59.841678 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:59.841634    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"]
Jul 05 13:51:59.841936 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:51:59.841901    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy" containerID="cri-o://36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9" gracePeriod=30
Jul 05 13:52:00.209270 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:00.209190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:52:00.209698 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:00.209491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:52:00.210223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:00.210207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:52:00.428007 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:00.427967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:52:05.112017 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.111960    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:52:05.214915 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.214888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-istio-token\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.214934    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-envoy\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.214972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-socket\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-data\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsgtb\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-kube-api-access-hsgtb\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215290 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-credential-socket\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215290 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-certs\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215290 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215173    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470870c1-c341-4187-b60a-08d49fab4096-istiod-ca-cert\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215290 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215210    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470870c1-c341-4187-b60a-08d49fab4096-istio-podinfo\") pod \"470870c1-c341-4187-b60a-08d49fab4096\" (UID: \"470870c1-c341-4187-b60a-08d49fab4096\") "
Jul 05 13:52:05.215494 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215304    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:05.215600 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215571    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:05.215685 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215587    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.215844 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215813    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:05.215991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215962    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-data" (OuterVolumeSpecName: "istio-data") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:05.215991 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.215982    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470870c1-c341-4187-b60a-08d49fab4096-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:52:05.217322 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.217299    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:05.217412 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.217354    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-kube-api-access-hsgtb" (OuterVolumeSpecName: "kube-api-access-hsgtb") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "kube-api-access-hsgtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:52:05.217631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.217599    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-istio-token" (OuterVolumeSpecName: "istio-token") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:52:05.217631 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.217615    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/470870c1-c341-4187-b60a-08d49fab4096-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "470870c1-c341-4187-b60a-08d49fab4096" (UID: "470870c1-c341-4187-b60a-08d49fab4096"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:52:05.316362 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316327    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.316362 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316360    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.316581 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316373    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsgtb\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-kube-api-access-hsgtb\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.316581 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316388    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.316581 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316401    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470870c1-c341-4187-b60a-08d49fab4096-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.316581 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316413    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470870c1-c341-4187-b60a-08d49fab4096-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.316581 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316423    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470870c1-c341-4187-b60a-08d49fab4096-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.316581 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.316433    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470870c1-c341-4187-b60a-08d49fab4096-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:05.709230 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.709194    2565 generic.go:356] "Generic (PLEG): container finished" podID="470870c1-c341-4187-b60a-08d49fab4096" containerID="36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9" exitCode=0
Jul 05 13:52:05.709432 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.709245    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"
Jul 05 13:52:05.709432 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.709280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" event={"ID":"470870c1-c341-4187-b60a-08d49fab4096","Type":"ContainerDied","Data":"36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9"}
Jul 05 13:52:05.709432 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.709401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62" event={"ID":"470870c1-c341-4187-b60a-08d49fab4096","Type":"ContainerDied","Data":"c77b405faa06a9e2f7e35c1f85dff392b3ec9556e232f8da4e9a6dab75aa46bf"}
Jul 05 13:52:05.709601 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.709434    2565 scope.go:117] "RemoveContainer" containerID="36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9"
Jul 05 13:52:05.718363 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.718348    2565 scope.go:117] "RemoveContainer" containerID="82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2"
Jul 05 13:52:05.725935 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.725919    2565 scope.go:117] "RemoveContainer" containerID="36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9"
Jul 05 13:52:05.726194 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:52:05.726173    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9\": container with ID starting with 36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9 not found: ID does not exist" containerID="36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9"
Jul 05 13:52:05.726270 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.726208    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9"} err="failed to get container status \"36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9\": rpc error: code = NotFound desc = could not find container \"36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9\": container with ID starting with 36f2d4711ba6275db7ab2df25e1a09c20e0f27d334411d01c2822e22c282aaa9 not found: ID does not exist"
Jul 05 13:52:05.726270 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.726231    2565 scope.go:117] "RemoveContainer" containerID="82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2"
Jul 05 13:52:05.726476 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:52:05.726459    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2\": container with ID starting with 82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2 not found: ID does not exist" containerID="82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2"
Jul 05 13:52:05.726515 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.726483    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2"} err="failed to get container status \"82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2\": rpc error: code = NotFound desc = could not find container \"82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2\": container with ID starting with 82357e28e1a2312ea1ec391b54b361c55c7384885a30680bbb98846b722a1af2 not found: ID does not exist"
Jul 05 13:52:05.730575 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.730552    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"]
Jul 05 13:52:05.734808 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:05.734781    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e55a60-openshift-default-58f6957d8c-5tt62"]
Jul 05 13:52:06.112517 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:06.112477    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470870c1-c341-4187-b60a-08d49fab4096" path="/var/lib/kubelet/pods/470870c1-c341-4187-b60a-08d49fab4096/volumes"
Jul 05 13:52:06.638933 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:06.638902    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"]
Jul 05 13:52:06.639124 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:06.639102    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy" containerID="cri-o://bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000" gracePeriod=30
Jul 05 13:52:07.492872 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.492837    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"]
Jul 05 13:52:07.493365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.493328    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy"
Jul 05 13:52:07.493365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.493343    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy"
Jul 05 13:52:07.493481 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.493427    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy"
Jul 05 13:52:07.498215 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.498195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.500618 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.500594    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-94581b-openshift-default-dockercfg-ccb98\""
Jul 05 13:52:07.510888 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.510866    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"]
Jul 05 13:52:07.536921 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.536895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-credential-socket\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.536928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-token\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.536964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-podinfo\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.537002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-envoy\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537056 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.537025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-certs\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537203 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.537072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00fc4d3-79e8-4c38-9b4c-865885193459-istiod-ca-cert\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537203 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.537105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-data\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537203 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.537128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9f5m\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-kube-api-access-w9f5m\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.537203 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.537158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-socket\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638031 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9f5m\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-kube-api-access-w9f5m\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-socket\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-credential-socket\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-token\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-podinfo\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-envoy\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-certs\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00fc4d3-79e8-4c38-9b4c-865885193459-istiod-ca-cert\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638506 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-data\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.638930 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638906    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-socket\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.639093 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.639070    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00fc4d3-79e8-4c38-9b4c-865885193459-istiod-ca-cert\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.639181 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.638981    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-certs\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.639272 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.639249    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-credential-socket\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.639358 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.639215    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-data\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.641153 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.641129    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-envoy\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.641298 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.641285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-podinfo\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.647048 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.647024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-token\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.647238 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.647218    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9f5m\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-kube-api-access-w9f5m\") pod \"e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") " pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.808823 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.808796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:07.948993 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.948967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"]
Jul 05 13:52:07.951570 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:52:07.951539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00fc4d3_79e8_4c38_9b4c_865885193459.slice/crio-8dbbdaa943c9d4cc26207bb0e03f9d25feeddd7108ad36fdb5798b48b1264cd9 WatchSource:0}: Error finding container 8dbbdaa943c9d4cc26207bb0e03f9d25feeddd7108ad36fdb5798b48b1264cd9: Status 404 returned error can't find the container with id 8dbbdaa943c9d4cc26207bb0e03f9d25feeddd7108ad36fdb5798b48b1264cd9
Jul 05 13:52:07.954296 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.954266    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:07.954367 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.954332    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:07.954367 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:07.954360    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:08.735436 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:08.735399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" event={"ID":"c00fc4d3-79e8-4c38-9b4c-865885193459","Type":"ContainerStarted","Data":"9785e9de9c14c2bdb6ddb5229061bc9962f91d3a20753bac9970cb811a58fc99"}
Jul 05 13:52:08.736026 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:08.735492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" event={"ID":"c00fc4d3-79e8-4c38-9b4c-865885193459","Type":"ContainerStarted","Data":"8dbbdaa943c9d4cc26207bb0e03f9d25feeddd7108ad36fdb5798b48b1264cd9"}
Jul 05 13:52:08.758616 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:08.758569    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" podStartSLOduration=1.7585538299999999 podStartE2EDuration="1.75855383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:52:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:52:08.757647671 +0000 UTC m=+2207.194669409" watchObservedRunningTime="2026-07-05 13:52:08.75855383 +0000 UTC m=+2207.195575549"
Jul 05 13:52:08.809551 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:08.809515    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:09.329347 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:09.329313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:52:09.814483 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:09.814460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:10.744948 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:10.744917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:10.745900 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:10.745882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:11.902025 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.901966    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:52:11.980984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.980950    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-credential-socket\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981189 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-data\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981189 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06786dad-e77f-4801-b6df-06a8b7efec31-istio-podinfo\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981189 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981138    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-certs\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981334 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-envoy\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981334 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981222    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06786dad-e77f-4801-b6df-06a8b7efec31-istiod-ca-cert\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981334 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpsqv\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-kube-api-access-zpsqv\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981334 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-istio-token\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981822 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981340    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-socket\") pod \"06786dad-e77f-4801-b6df-06a8b7efec31\" (UID: \"06786dad-e77f-4801-b6df-06a8b7efec31\") "
Jul 05 13:52:11.981822 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981515    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:11.981822 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.981764    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:11.982093 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.982054    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:11.982276 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.982164    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:11.982276 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.982204    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06786dad-e77f-4801-b6df-06a8b7efec31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:52:11.982744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.982716    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-data" (OuterVolumeSpecName: "istio-data") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:11.984067 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.984036    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-istio-token" (OuterVolumeSpecName: "istio-token") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:52:11.984157 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.984091    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06786dad-e77f-4801-b6df-06a8b7efec31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:52:11.984157 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.984094    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:52:11.984232 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:11.984178    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-kube-api-access-zpsqv" (OuterVolumeSpecName: "kube-api-access-zpsqv") pod "06786dad-e77f-4801-b6df-06a8b7efec31" (UID: "06786dad-e77f-4801-b6df-06a8b7efec31"). InnerVolumeSpecName "kube-api-access-zpsqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:52:12.082707 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082652    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.082707 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082704    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06786dad-e77f-4801-b6df-06a8b7efec31-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.082707 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082712    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.082923 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082720    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.082923 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082728    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06786dad-e77f-4801-b6df-06a8b7efec31-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.082923 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082736    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpsqv\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-kube-api-access-zpsqv\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.082923 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082744    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06786dad-e77f-4801-b6df-06a8b7efec31-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.082923 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.082752    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06786dad-e77f-4801-b6df-06a8b7efec31-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:52:12.755972 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.755938    2565 generic.go:356] "Generic (PLEG): container finished" podID="06786dad-e77f-4801-b6df-06a8b7efec31" containerID="bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000" exitCode=0
Jul 05 13:52:12.756163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.755987    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"
Jul 05 13:52:12.756163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.756022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" event={"ID":"06786dad-e77f-4801-b6df-06a8b7efec31","Type":"ContainerDied","Data":"bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000"}
Jul 05 13:52:12.756163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.756085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n" event={"ID":"06786dad-e77f-4801-b6df-06a8b7efec31","Type":"ContainerDied","Data":"a6ae497f0b853d0a5103ecab232e27eef0ff9302d10861c5a86f9ed24a64237e"}
Jul 05 13:52:12.756163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.756126    2565 scope.go:117] "RemoveContainer" containerID="bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000"
Jul 05 13:52:12.764662 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.764641    2565 scope.go:117] "RemoveContainer" containerID="ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9"
Jul 05 13:52:12.772576 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.772524    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"]
Jul 05 13:52:12.772643 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.772605    2565 scope.go:117] "RemoveContainer" containerID="bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000"
Jul 05 13:52:12.772920 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:52:12.772896    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000\": container with ID starting with bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000 not found: ID does not exist" containerID="bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000"
Jul 05 13:52:12.772961 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.772930    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000"} err="failed to get container status \"bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000\": rpc error: code = NotFound desc = could not find container \"bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000\": container with ID starting with bad07042bef39e13933fad7b0a3a6404e5aecbdb10d57d2907da18bfd7858000 not found: ID does not exist"
Jul 05 13:52:12.772961 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.772947    2565 scope.go:117] "RemoveContainer" containerID="ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9"
Jul 05 13:52:12.773206 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:52:12.773189    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9\": container with ID starting with ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9 not found: ID does not exist" containerID="ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9"
Jul 05 13:52:12.773246 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.773211    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9"} err="failed to get container status \"ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9\": rpc error: code = NotFound desc = could not find container \"ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9\": container with ID starting with ff8d511bf7937bb456ea60946dd58a801ab2ac454dbde3e6b3d8f3010ff5c0a9 not found: ID does not exist"
Jul 05 13:52:12.778878 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:12.778857    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-853a17-openshift-default-5f856d5f6c-pwd4n"]
Jul 05 13:52:14.112415 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:14.112381    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" path="/var/lib/kubelet/pods/06786dad-e77f-4801-b6df-06a8b7efec31/volumes"
Jul 05 13:52:15.809954 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.809923    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"]
Jul 05 13:52:15.811195 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.811172    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy"
Jul 05 13:52:15.811365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.811353    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy"
Jul 05 13:52:15.811508 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.811495    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy"
Jul 05 13:52:15.811620 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.811609    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy"
Jul 05 13:52:15.811898 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.811885    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy"
Jul 05 13:52:15.812045 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.812031    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="470870c1-c341-4187-b60a-08d49fab4096" containerName="istio-proxy"
Jul 05 13:52:15.842155 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.842120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"]
Jul 05 13:52:15.842316 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.842246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.845681 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.845208    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-aa2b8d-openshift-default-dockercfg-jjw6q\""
Jul 05 13:52:15.923285 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85313363-2d50-4de0-8c34-16e43d0ed291-istiod-ca-cert\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923285 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-data\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923285 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-envoy\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923612 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-credential-socket\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923612 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85313363-2d50-4de0-8c34-16e43d0ed291-istio-podinfo\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923612 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc26v\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-kube-api-access-nc26v\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923612 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-istio-token\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923612 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-socket\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:15.923612 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:15.923595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-certs\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.024997 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.024962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85313363-2d50-4de0-8c34-16e43d0ed291-istiod-ca-cert\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.024997 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-data\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-envoy\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-credential-socket\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85313363-2d50-4de0-8c34-16e43d0ed291-istio-podinfo\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc26v\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-kube-api-access-nc26v\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-istio-token\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-socket\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025217 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-certs\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025553 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025536    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-certs\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.025783 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.025764    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-credential-socket\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.026248 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.026228    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-socket\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.026500 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.026483    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-data\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.026658 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.026640    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85313363-2d50-4de0-8c34-16e43d0ed291-istiod-ca-cert\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.028788 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.028767    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-envoy\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.029087 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.029072    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85313363-2d50-4de0-8c34-16e43d0ed291-istio-podinfo\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.034905 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.034869    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-istio-token\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.036077 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.036049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc26v\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-kube-api-access-nc26v\") pod \"e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") " pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.153443 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.153349    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:16.351793 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.351759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"]
Jul 05 13:52:16.354447 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:52:16.354419    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85313363_2d50_4de0_8c34_16e43d0ed291.slice/crio-c7a780b1f3b405973ee3f5a68b6e333a789e203a0f5d6e65e524c1b77ef3dae7 WatchSource:0}: Error finding container c7a780b1f3b405973ee3f5a68b6e333a789e203a0f5d6e65e524c1b77ef3dae7: Status 404 returned error can't find the container with id c7a780b1f3b405973ee3f5a68b6e333a789e203a0f5d6e65e524c1b77ef3dae7
Jul 05 13:52:16.357008 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.356967    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:16.357115 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.357059    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:16.357115 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.357105    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:16.779052 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.779018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" event={"ID":"85313363-2d50-4de0-8c34-16e43d0ed291","Type":"ContainerStarted","Data":"f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886"}
Jul 05 13:52:16.779214 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.779069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" event={"ID":"85313363-2d50-4de0-8c34-16e43d0ed291","Type":"ContainerStarted","Data":"c7a780b1f3b405973ee3f5a68b6e333a789e203a0f5d6e65e524c1b77ef3dae7"}
Jul 05 13:52:16.804471 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:16.804414    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" podStartSLOduration=1.804395264 podStartE2EDuration="1.804395264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:52:16.800606673 +0000 UTC m=+2215.237628399" watchObservedRunningTime="2026-07-05 13:52:16.804395264 +0000 UTC m=+2215.241416991"
Jul 05 13:52:17.154030 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:17.153944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:17.158512 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:17.158489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:17.783694 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:17.783653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:17.784773 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:17.784756    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:19.256460 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:19.256419    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:52:21.803359 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:21.803323    2565 generic.go:356] "Generic (PLEG): container finished" podID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerID="9785e9de9c14c2bdb6ddb5229061bc9962f91d3a20753bac9970cb811a58fc99" exitCode=0
Jul 05 13:52:21.803818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:21.803380    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" event={"ID":"c00fc4d3-79e8-4c38-9b4c-865885193459","Type":"ContainerDied","Data":"9785e9de9c14c2bdb6ddb5229061bc9962f91d3a20753bac9970cb811a58fc99"}
Jul 05 13:52:21.803818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:21.803765    2565 scope.go:117] "RemoveContainer" containerID="9785e9de9c14c2bdb6ddb5229061bc9962f91d3a20753bac9970cb811a58fc99"
Jul 05 13:52:21.804830 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:21.804798    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:21.804892 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:21.804876    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:21.804930 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:21.804912    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:22.813286 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:22.813241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" event={"ID":"c00fc4d3-79e8-4c38-9b4c-865885193459","Type":"ContainerStarted","Data":"fca15ed2ceb64c5d28b39a533593d43518793f99afd562266871fe6d81d85411"}
Jul 05 13:52:23.809942 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:23.809904    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:23.811033 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:23.810997    2565 patch_prober.go:28] interesting pod/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 05 13:52:23.811173 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:23.811054    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 05 13:52:24.809682 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:24.809623    2565 patch_prober.go:28] interesting pod/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 05 13:52:24.810186 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:24.809721    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 05 13:52:25.745275 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:25.745236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:25.809877 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:25.809842    2565 patch_prober.go:28] interesting pod/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 05 13:52:25.810440 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:25.810407    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 05 13:52:26.828290 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:26.828249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:26.829583 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:26.829561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:52:29.567422 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:29.567384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:52:33.215047 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.214799    2565 patch_prober.go:28] interesting pod/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:48928->10.134.0.40:15021: read: connection reset by peer" start-of-body=
Jul 05 13:52:33.215047 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.214866    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:48928->10.134.0.40:15021: read: connection reset by peer"
Jul 05 13:52:33.481026 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.480934    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"]
Jul 05 13:52:33.481322 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.481308    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy"
Jul 05 13:52:33.481365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.481326    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy"
Jul 05 13:52:33.481437 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.481426    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="06786dad-e77f-4801-b6df-06a8b7efec31" containerName="istio-proxy"
Jul 05 13:52:33.483477 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.483462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.489375 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.489349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94581b\"/\"default-dockercfg-5wdwp\""
Jul 05 13:52:33.489520 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.489385    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94581b\"/\"auth-test-model-94581b-kserve-self-signed-certs\""
Jul 05 13:52:33.489520 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.489430    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-94581b\"/\"kube-root-ca.crt\""
Jul 05 13:52:33.489520 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.489388    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-94581b\"/\"openshift-service-ca.crt\""
Jul 05 13:52:33.498992 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.498969    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"]
Jul 05 13:52:33.508368 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.508343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-model-cache\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.508508 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.508382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-home\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.508508 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.508406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2698j\" (UniqueName: \"kubernetes.io/projected/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-kube-api-access-2698j\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.508508 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.508487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-dshm\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.508701 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.508517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tls-certs\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.508701 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.508535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tmp-dir\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-model-cache\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-home\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2698j\" (UniqueName: \"kubernetes.io/projected/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-kube-api-access-2698j\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-dshm\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tls-certs\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609396 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tmp-dir\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609655 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-model-cache\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609753 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609686    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-home\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.609753 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.609713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tmp-dir\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.611696 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.611643    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-dshm\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.611916 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.611898    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tls-certs\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.620098 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.620075    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2698j\" (UniqueName: \"kubernetes.io/projected/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-kube-api-access-2698j\") pod \"auth-test-model-94581b-kserve-7ffc975899-gjmn5\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") " pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.792979 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.792942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:33.867203 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.867171    2565 generic.go:356] "Generic (PLEG): container finished" podID="85313363-2d50-4de0-8c34-16e43d0ed291" containerID="f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886" exitCode=0
Jul 05 13:52:33.867370 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.867242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" event={"ID":"85313363-2d50-4de0-8c34-16e43d0ed291","Type":"ContainerDied","Data":"f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886"}
Jul 05 13:52:33.867769 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.867753    2565 scope.go:117] "RemoveContainer" containerID="f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886"
Jul 05 13:52:33.868865 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.868837    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:33.868936 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.868919    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:33.868986 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.868971    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:52:33.939447 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:33.939421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"]
Jul 05 13:52:33.941786 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:52:33.941761    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3cd56f9_f645_4cf1_9fc7_6371bd1de34d.slice/crio-a98a997835882ecea90be7dfe75819264b767e901f1ab28794a1aea0edf0115f WatchSource:0}: Error finding container a98a997835882ecea90be7dfe75819264b767e901f1ab28794a1aea0edf0115f: Status 404 returned error can't find the container with id a98a997835882ecea90be7dfe75819264b767e901f1ab28794a1aea0edf0115f
Jul 05 13:52:34.874399 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:34.874367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" event={"ID":"85313363-2d50-4de0-8c34-16e43d0ed291","Type":"ContainerStarted","Data":"2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096"}
Jul 05 13:52:34.875832 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:34.875810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5" event={"ID":"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d","Type":"ContainerStarted","Data":"4d61ab8492cf42e9c8ac5eb9b1d6307cee56a2cb7ebab110609388f6a06ef7c3"}
Jul 05 13:52:34.875965 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:34.875841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5" event={"ID":"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d","Type":"ContainerStarted","Data":"a98a997835882ecea90be7dfe75819264b767e901f1ab28794a1aea0edf0115f"}
Jul 05 13:52:35.153823 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:35.153743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:35.154026 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:35.154007    2565 patch_prober.go:28] interesting pod/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 05 13:52:35.154082 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:35.154064    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 05 13:52:36.153936 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:36.153899    2565 patch_prober.go:28] interesting pod/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 05 13:52:36.154323 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:36.153953    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 05 13:52:37.153895 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:37.153861    2565 patch_prober.go:28] interesting pod/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 05 13:52:37.154071 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:37.153914    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 05 13:52:37.746348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:37.746299    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5" podStartSLOduration=4.7462833490000005 podStartE2EDuration="4.746283349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:52:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:52:34.960058982 +0000 UTC m=+2233.397080709" watchObservedRunningTime="2026-07-05 13:52:37.746283349 +0000 UTC m=+2236.183305096"
Jul 05 13:52:37.746699 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:37.746682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:52:38.154742 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:38.154704    2565 patch_prober.go:28] interesting pod/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 05 13:52:38.155143 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:38.154768    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 05 13:52:39.156927 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:39.156897    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:39.157374 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:39.157188    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:39.157758 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:39.157743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:52:43.793745 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:43.793707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:43.794168 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:43.793766    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:43.805870 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:43.805839    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:52:43.941729 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:52:43.941653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:53:09.745405 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:53:09.745367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:53:24.441625 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:53:24.441588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:53:42.122997 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:53:42.122960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:53:56.759329 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:53:56.759292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:54:13.429226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:54:13.429194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:54:30.329759 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:54:30.329658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:54:47.790709 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:54:47.790674    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:55:01.406960 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:01.406917    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"]
Jul 05 13:55:04.025544 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:04.025503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:55:09.667897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.667855    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"]
Jul 05 13:55:09.671609 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.671591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.674170 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.674150    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94581b\"/\"sub-test-model-94581b-kserve-self-signed-certs\""
Jul 05 13:55:09.681792 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.681770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"]
Jul 05 13:55:09.700992 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.700957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-model-cache\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.701126 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.701039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-dshm\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.701126 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.701081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tls-certs\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.701126 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.701115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-home\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.701302 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.701196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tmp-dir\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.701302 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.701249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkk8s\" (UniqueName: \"kubernetes.io/projected/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-kube-api-access-xkk8s\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802210 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-model-cache\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-dshm\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tls-certs\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-home\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802365 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tmp-dir\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802569 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkk8s\" (UniqueName: \"kubernetes.io/projected/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-kube-api-access-xkk8s\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802652 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802630    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-model-cache\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802843 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-home\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.802915 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.802862    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tmp-dir\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.804774 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.804731    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-dshm\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.804891 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.804824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tls-certs\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.812320 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.812293    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkk8s\" (UniqueName: \"kubernetes.io/projected/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-kube-api-access-xkk8s\") pod \"sub-test-model-94581b-kserve-585f9b5b7c-529zq\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") " pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:09.981125 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:09.981027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:10.118572 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:10.118551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"]
Jul 05 13:55:10.120647 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:55:10.120619    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52b2cb5c_a370_4d5e_a2cd_76ae2e439d2a.slice/crio-194f79bde2fecd72eeabe4ee75b3a8d38fff668839b72079081563ccbaf4b875 WatchSource:0}: Error finding container 194f79bde2fecd72eeabe4ee75b3a8d38fff668839b72079081563ccbaf4b875: Status 404 returned error can't find the container with id 194f79bde2fecd72eeabe4ee75b3a8d38fff668839b72079081563ccbaf4b875
Jul 05 13:55:10.599515 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:10.599484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq" event={"ID":"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a","Type":"ContainerStarted","Data":"8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c"}
Jul 05 13:55:10.599697 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:10.599525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq" event={"ID":"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a","Type":"ContainerStarted","Data":"194f79bde2fecd72eeabe4ee75b3a8d38fff668839b72079081563ccbaf4b875"}
Jul 05 13:55:10.618213 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:10.618170    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq" podStartSLOduration=1.618153531 podStartE2EDuration="1.618153531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:55:10.616808266 +0000 UTC m=+2389.053829992" watchObservedRunningTime="2026-07-05 13:55:10.618153531 +0000 UTC m=+2389.055175256"
Jul 05 13:55:16.427141 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.427102    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5" podUID="f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" containerName="main" containerID="cri-o://4d61ab8492cf42e9c8ac5eb9b1d6307cee56a2cb7ebab110609388f6a06ef7c3" gracePeriod=45
Jul 05 13:55:16.631227 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.631198    2565 generic.go:356] "Generic (PLEG): container finished" podID="f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" containerID="4d61ab8492cf42e9c8ac5eb9b1d6307cee56a2cb7ebab110609388f6a06ef7c3" exitCode=0
Jul 05 13:55:16.631372 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.631278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5" event={"ID":"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d","Type":"ContainerDied","Data":"4d61ab8492cf42e9c8ac5eb9b1d6307cee56a2cb7ebab110609388f6a06ef7c3"}
Jul 05 13:55:16.676163 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.676136    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:55:16.770596 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770527    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-dshm\") pod \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") "
Jul 05 13:55:16.770596 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770560    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-model-cache\") pod \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") "
Jul 05 13:55:16.770596 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770594    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-home\") pod \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") "
Jul 05 13:55:16.770849 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tls-certs\") pod \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") "
Jul 05 13:55:16.770849 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2698j\" (UniqueName: \"kubernetes.io/projected/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-kube-api-access-2698j\") pod \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") "
Jul 05 13:55:16.770849 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tmp-dir\") pod \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\" (UID: \"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d\") "
Jul 05 13:55:16.771008 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770850    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-home" (OuterVolumeSpecName: "home") pod "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" (UID: "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:16.771008 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.770858    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" (UID: "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:16.771121 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.771006    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-model-cache\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:55:16.771121 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.771060    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-home\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:55:16.771121 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.771076    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" (UID: "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:16.772770 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.772749    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" (UID: "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:55:16.772873 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.772832    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-kube-api-access-2698j" (OuterVolumeSpecName: "kube-api-access-2698j") pod "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" (UID: "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d"). InnerVolumeSpecName "kube-api-access-2698j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:55:16.772873 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.772840    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-dshm" (OuterVolumeSpecName: "dshm") pod "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" (UID: "f3cd56f9-f645-4cf1-9fc7-6371bd1de34d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:16.872275 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.872243    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-dshm\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:55:16.872275 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.872269    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tls-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:55:16.872422 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.872285    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2698j\" (UniqueName: \"kubernetes.io/projected/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-kube-api-access-2698j\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:55:16.872422 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:16.872295    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d-tmp-dir\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:55:17.638390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:17.638363    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"
Jul 05 13:55:17.638390 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:17.638376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5" event={"ID":"f3cd56f9-f645-4cf1-9fc7-6371bd1de34d","Type":"ContainerDied","Data":"a98a997835882ecea90be7dfe75819264b767e901f1ab28794a1aea0edf0115f"}
Jul 05 13:55:17.638894 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:17.638424    2565 scope.go:117] "RemoveContainer" containerID="4d61ab8492cf42e9c8ac5eb9b1d6307cee56a2cb7ebab110609388f6a06ef7c3"
Jul 05 13:55:17.659541 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:17.659514    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"]
Jul 05 13:55:17.663272 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:17.663244    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/auth-test-model-94581b-kserve-7ffc975899-gjmn5"]
Jul 05 13:55:18.114052 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:18.114015    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" path="/var/lib/kubelet/pods/f3cd56f9-f645-4cf1-9fc7-6371bd1de34d/volumes"
Jul 05 13:55:19.326785 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:19.326751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:55:19.981986 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:19.981949    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:19.982181 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:19.982001    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:19.994317 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:19.994290    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:20.663924 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:20.663899    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:55:22.127786 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:22.127759    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:55:22.135523 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:22.135504    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nj8l7_75f30836-9af3-4a95-a1d4-77d36c72d50a/ovn-acl-logging/0.log"
Jul 05 13:55:36.927871 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:36.927825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:55:55.132137 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:55:55.132055    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:56:08.272057 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:08.272017    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"]
Jul 05 13:56:12.232028 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:12.231994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:56:21.161578 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.161542    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"]
Jul 05 13:56:21.161961 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.161920    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" containerName="main"
Jul 05 13:56:21.161961 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.161932    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" containerName="main"
Jul 05 13:56:21.162034 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.162007    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3cd56f9-f645-4cf1-9fc7-6371bd1de34d" containerName="main"
Jul 05 13:56:21.164894 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.164873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.167730 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.167707    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94581b\"/\"rate-test-model-94581b-kserve-self-signed-certs\""
Jul 05 13:56:21.178002 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.177980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"]
Jul 05 13:56:21.199873 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.199841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tmp-dir\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.200015 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.199982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-model-cache\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.200069 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.200013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dn2j\" (UniqueName: \"kubernetes.io/projected/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-kube-api-access-7dn2j\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.200127 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.200092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-home\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.200183 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.200125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tls-certs\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.200231 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.200180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-dshm\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301276 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-model-cache\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301276 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dn2j\" (UniqueName: \"kubernetes.io/projected/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-kube-api-access-7dn2j\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301539 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-home\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301539 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tls-certs\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301539 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-dshm\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301539 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tmp-dir\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301817 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301778    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-model-cache\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301864 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301818    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tmp-dir\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.301864 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.301837    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-home\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.303651 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.303633    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-dshm\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.303852 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.303835    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tls-certs\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.309816 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.309791    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dn2j\" (UniqueName: \"kubernetes.io/projected/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-kube-api-access-7dn2j\") pod \"rate-test-model-94581b-kserve-7f5b88d767-w5kj9\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") " pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.474046 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.473964    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:21.605367 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.605343    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"]
Jul 05 13:56:21.607243 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:56:21.607216    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcea84a39_70ad_4cb1_b7aa_cda10bd77d47.slice/crio-2c0fefc691dd6fa687effc505655a068fd07c9a9ff199aa419da7965cc2bcd7b WatchSource:0}: Error finding container 2c0fefc691dd6fa687effc505655a068fd07c9a9ff199aa419da7965cc2bcd7b: Status 404 returned error can't find the container with id 2c0fefc691dd6fa687effc505655a068fd07c9a9ff199aa419da7965cc2bcd7b
Jul 05 13:56:21.938996 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.938962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9" event={"ID":"cea84a39-70ad-4cb1-b7aa-cda10bd77d47","Type":"ContainerStarted","Data":"3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1"}
Jul 05 13:56:21.938996 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.939001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9" event={"ID":"cea84a39-70ad-4cb1-b7aa-cda10bd77d47","Type":"ContainerStarted","Data":"2c0fefc691dd6fa687effc505655a068fd07c9a9ff199aa419da7965cc2bcd7b"}
Jul 05 13:56:21.957228 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:21.957184    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9" podStartSLOduration=0.957170073 podStartE2EDuration="957.170073ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:56:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:56:21.956135647 +0000 UTC m=+2460.393157373" watchObservedRunningTime="2026-07-05 13:56:21.957170073 +0000 UTC m=+2460.394191823"
Jul 05 13:56:23.291967 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.291920    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq" podUID="52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" containerName="main" containerID="cri-o://8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c" gracePeriod=45
Jul 05 13:56:23.540079 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.540056    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:56:23.624044 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.623958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-model-cache\") pod \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") "
Jul 05 13:56:23.624044 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624000    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tls-certs\") pod \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") "
Jul 05 13:56:23.624281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkk8s\" (UniqueName: \"kubernetes.io/projected/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-kube-api-access-xkk8s\") pod \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") "
Jul 05 13:56:23.624281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624104    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-home\") pod \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") "
Jul 05 13:56:23.624281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624204    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-model-cache" (OuterVolumeSpecName: "model-cache") pod "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" (UID: "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:23.624281 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-dshm\") pod \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") "
Jul 05 13:56:23.624484 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tmp-dir\") pod \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\" (UID: \"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a\") "
Jul 05 13:56:23.624484 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624335    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-home" (OuterVolumeSpecName: "home") pod "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" (UID: "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:23.624601 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624556    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" (UID: "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:23.624739 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624720    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tmp-dir\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:56:23.624818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624742    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-model-cache\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:56:23.624818 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.624757    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-home\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:56:23.626182 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.626159    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-dshm" (OuterVolumeSpecName: "dshm") pod "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" (UID: "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:23.626305 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.626217    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-kube-api-access-xkk8s" (OuterVolumeSpecName: "kube-api-access-xkk8s") pod "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" (UID: "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a"). InnerVolumeSpecName "kube-api-access-xkk8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:56:23.626305 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.626240    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" (UID: "52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:56:23.725933 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.725893    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-dshm\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:56:23.725933 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.725925    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-tls-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:56:23.725933 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.725935    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkk8s\" (UniqueName: \"kubernetes.io/projected/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a-kube-api-access-xkk8s\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:56:23.948951 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.948865    2565 generic.go:356] "Generic (PLEG): container finished" podID="52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" containerID="8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c" exitCode=0
Jul 05 13:56:23.948951 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.948906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq" event={"ID":"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a","Type":"ContainerDied","Data":"8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c"}
Jul 05 13:56:23.948951 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.948916    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"
Jul 05 13:56:23.948951 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.948934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq" event={"ID":"52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a","Type":"ContainerDied","Data":"194f79bde2fecd72eeabe4ee75b3a8d38fff668839b72079081563ccbaf4b875"}
Jul 05 13:56:23.948951 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.948950    2565 scope.go:117] "RemoveContainer" containerID="8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c"
Jul 05 13:56:23.959691 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.958883    2565 scope.go:117] "RemoveContainer" containerID="8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c"
Jul 05 13:56:23.959691 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:56:23.959184    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c\": container with ID starting with 8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c not found: ID does not exist" containerID="8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c"
Jul 05 13:56:23.959691 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.959220    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c"} err="failed to get container status \"8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c\": rpc error: code = NotFound desc = could not find container \"8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c\": container with ID starting with 8d728a016cebfe732dc6b4b524552cd1af521d818fb58dc3613354ae70a1250c not found: ID does not exist"
Jul 05 13:56:23.976583 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.976552    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"]
Jul 05 13:56:23.980856 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:23.980835    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/sub-test-model-94581b-kserve-585f9b5b7c-529zq"]
Jul 05 13:56:24.112455 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:24.112421    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" path="/var/lib/kubelet/pods/52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a/volumes"
Jul 05 13:56:24.638843 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:24.638809    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:56:31.475040 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:31.475002    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:31.475512 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:31.475097    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:31.487346 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:31.487322    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:31.997880 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:31.997847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:56:37.867359 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.867328    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"]
Jul 05 13:56:37.867745 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.867731    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" containerName="main"
Jul 05 13:56:37.867794 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.867747    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" containerName="main"
Jul 05 13:56:37.867837 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.867811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b2cb5c-a370-4d5e-a2cd-76ae2e439d2a" containerName="main"
Jul 05 13:56:37.870826 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.870809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:37.874920 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.874894    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"default-dockercfg-9lbgp\""
Jul 05 13:56:37.875021 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.874894    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"openshift-service-ca.crt\""
Jul 05 13:56:37.875021 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.874991    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"kube-root-ca.crt\""
Jul 05 13:56:37.875193 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.875176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"rate-test-model-aa2b8d-kserve-self-signed-certs\""
Jul 05 13:56:37.928922 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.928893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"]
Jul 05 13:56:37.966110 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.966082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-dshm\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:37.966226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.966117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-model-cache\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:37.966226 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.966200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-home\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:37.966310 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.966246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-tmp-dir\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:37.966310 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.966289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzbdl\" (UniqueName: \"kubernetes.io/projected/44236b71-a67d-4c57-a594-ab179fe44b8e-kube-api-access-xzbdl\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:37.966378 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:37.966358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44236b71-a67d-4c57-a594-ab179fe44b8e-tls-certs\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067287 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-dshm\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-model-cache\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-home\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-tmp-dir\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067462 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzbdl\" (UniqueName: \"kubernetes.io/projected/44236b71-a67d-4c57-a594-ab179fe44b8e-kube-api-access-xzbdl\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067621 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44236b71-a67d-4c57-a594-ab179fe44b8e-tls-certs\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067836 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-model-cache\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067953 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067846    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-home\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.067953 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.067877    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-tmp-dir\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.069717 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.069687    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-dshm\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.069858 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.069805    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44236b71-a67d-4c57-a594-ab179fe44b8e-tls-certs\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.076254 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.076232    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzbdl\" (UniqueName: \"kubernetes.io/projected/44236b71-a67d-4c57-a594-ab179fe44b8e-kube-api-access-xzbdl\") pod \"rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") " pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.180842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.180753    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:38.315482 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:38.315449    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"]
Jul 05 13:56:38.319035 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:56:38.319009    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44236b71_a67d_4c57_a594_ab179fe44b8e.slice/crio-20f62f860fb3583f199d4686036d6162a3cb88e86413a5b42c347e0074207cb1 WatchSource:0}: Error finding container 20f62f860fb3583f199d4686036d6162a3cb88e86413a5b42c347e0074207cb1: Status 404 returned error can't find the container with id 20f62f860fb3583f199d4686036d6162a3cb88e86413a5b42c347e0074207cb1
Jul 05 13:56:39.020395 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:39.020359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn" event={"ID":"44236b71-a67d-4c57-a594-ab179fe44b8e","Type":"ContainerStarted","Data":"a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa"}
Jul 05 13:56:39.020800 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:39.020407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn" event={"ID":"44236b71-a67d-4c57-a594-ab179fe44b8e","Type":"ContainerStarted","Data":"20f62f860fb3583f199d4686036d6162a3cb88e86413a5b42c347e0074207cb1"}
Jul 05 13:56:39.038078 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:39.038033    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn" podStartSLOduration=2.038019346 podStartE2EDuration="2.038019346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:56:39.036378578 +0000 UTC m=+2477.473400303" watchObservedRunningTime="2026-07-05 13:56:39.038019346 +0000 UTC m=+2477.475041071"
Jul 05 13:56:42.027790 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:42.027734    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:56:48.181024 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:48.180990    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:48.181470 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:48.181039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:48.193270 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:48.193246    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:56:49.077509 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:56:49.077484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:57:00.730263 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:00.730228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:57:14.664332 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:14.664254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:57:20.644061 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:20.643644    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"]
Jul 05 13:57:21.670509 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:21.670477    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"]
Jul 05 13:57:27.621866 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:27.621821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:57:35.663937 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:35.663892    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9" podUID="cea84a39-70ad-4cb1-b7aa-cda10bd77d47" containerName="main" containerID="cri-o://3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1" gracePeriod=45
Jul 05 13:57:35.920003 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:35.919940    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:57:36.023812 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.023778    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-home\") pod \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") "
Jul 05 13:57:36.023984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.023832    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-dshm\") pod \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") "
Jul 05 13:57:36.023984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.023864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dn2j\" (UniqueName: \"kubernetes.io/projected/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-kube-api-access-7dn2j\") pod \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") "
Jul 05 13:57:36.023984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.023933    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tls-certs\") pod \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") "
Jul 05 13:57:36.023984 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.023981    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tmp-dir\") pod \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") "
Jul 05 13:57:36.024187 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.024027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-model-cache\") pod \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\" (UID: \"cea84a39-70ad-4cb1-b7aa-cda10bd77d47\") "
Jul 05 13:57:36.024187 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.024098    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-home" (OuterVolumeSpecName: "home") pod "cea84a39-70ad-4cb1-b7aa-cda10bd77d47" (UID: "cea84a39-70ad-4cb1-b7aa-cda10bd77d47"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:36.024333 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.024305    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cea84a39-70ad-4cb1-b7aa-cda10bd77d47" (UID: "cea84a39-70ad-4cb1-b7aa-cda10bd77d47"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:36.024414 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.024328    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-model-cache" (OuterVolumeSpecName: "model-cache") pod "cea84a39-70ad-4cb1-b7aa-cda10bd77d47" (UID: "cea84a39-70ad-4cb1-b7aa-cda10bd77d47"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:36.024414 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.024362    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-home\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:36.026020 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.025996    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-dshm" (OuterVolumeSpecName: "dshm") pod "cea84a39-70ad-4cb1-b7aa-cda10bd77d47" (UID: "cea84a39-70ad-4cb1-b7aa-cda10bd77d47"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:36.026118 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.026074    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cea84a39-70ad-4cb1-b7aa-cda10bd77d47" (UID: "cea84a39-70ad-4cb1-b7aa-cda10bd77d47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:57:36.026185 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.026155    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-kube-api-access-7dn2j" (OuterVolumeSpecName: "kube-api-access-7dn2j") pod "cea84a39-70ad-4cb1-b7aa-cda10bd77d47" (UID: "cea84a39-70ad-4cb1-b7aa-cda10bd77d47"). InnerVolumeSpecName "kube-api-access-7dn2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:57:36.125845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.125821    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-dshm\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:36.125845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.125846    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dn2j\" (UniqueName: \"kubernetes.io/projected/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-kube-api-access-7dn2j\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:36.126009 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.125861    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tls-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:36.126009 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.125874    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-tmp-dir\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:36.126009 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.125885    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cea84a39-70ad-4cb1-b7aa-cda10bd77d47-model-cache\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:36.282513 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.282477    2565 generic.go:356] "Generic (PLEG): container finished" podID="cea84a39-70ad-4cb1-b7aa-cda10bd77d47" containerID="3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1" exitCode=0
Jul 05 13:57:36.282682 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.282520    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"
Jul 05 13:57:36.282682 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.282560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9" event={"ID":"cea84a39-70ad-4cb1-b7aa-cda10bd77d47","Type":"ContainerDied","Data":"3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1"}
Jul 05 13:57:36.282682 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.282608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9" event={"ID":"cea84a39-70ad-4cb1-b7aa-cda10bd77d47","Type":"ContainerDied","Data":"2c0fefc691dd6fa687effc505655a068fd07c9a9ff199aa419da7965cc2bcd7b"}
Jul 05 13:57:36.282682 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.282625    2565 scope.go:117] "RemoveContainer" containerID="3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1"
Jul 05 13:57:36.299419 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.299366    2565 scope.go:117] "RemoveContainer" containerID="3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1"
Jul 05 13:57:36.299797 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:57:36.299771    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1\": container with ID starting with 3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1 not found: ID does not exist" containerID="3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1"
Jul 05 13:57:36.299917 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.299800    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1"} err="failed to get container status \"3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1\": rpc error: code = NotFound desc = could not find container \"3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1\": container with ID starting with 3fd4dd5e1b2d2cd3c163b6ae54b05e9ae07817263432ac5d8a1a6315e7a21fb1 not found: ID does not exist"
Jul 05 13:57:36.303556 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.303533    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"]
Jul 05 13:57:36.310400 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.310378    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-94581b/rate-test-model-94581b-kserve-7f5b88d767-w5kj9"]
Jul 05 13:57:36.691230 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.691140    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn" podUID="44236b71-a67d-4c57-a594-ab179fe44b8e" containerName="main" containerID="cri-o://a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa" gracePeriod=45
Jul 05 13:57:36.941902 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:36.941837    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:57:37.035190 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035152    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-dshm\") pod \"44236b71-a67d-4c57-a594-ab179fe44b8e\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") "
Jul 05 13:57:37.035190 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-model-cache\") pod \"44236b71-a67d-4c57-a594-ab179fe44b8e\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") "
Jul 05 13:57:37.035463 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035220    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44236b71-a67d-4c57-a594-ab179fe44b8e-tls-certs\") pod \"44236b71-a67d-4c57-a594-ab179fe44b8e\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") "
Jul 05 13:57:37.035463 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035250    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-tmp-dir\") pod \"44236b71-a67d-4c57-a594-ab179fe44b8e\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") "
Jul 05 13:57:37.035463 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035282    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzbdl\" (UniqueName: \"kubernetes.io/projected/44236b71-a67d-4c57-a594-ab179fe44b8e-kube-api-access-xzbdl\") pod \"44236b71-a67d-4c57-a594-ab179fe44b8e\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") "
Jul 05 13:57:37.035463 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-home\") pod \"44236b71-a67d-4c57-a594-ab179fe44b8e\" (UID: \"44236b71-a67d-4c57-a594-ab179fe44b8e\") "
Jul 05 13:57:37.035720 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035526    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44236b71-a67d-4c57-a594-ab179fe44b8e" (UID: "44236b71-a67d-4c57-a594-ab179fe44b8e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:37.035720 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035537    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-model-cache" (OuterVolumeSpecName: "model-cache") pod "44236b71-a67d-4c57-a594-ab179fe44b8e" (UID: "44236b71-a67d-4c57-a594-ab179fe44b8e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:37.035720 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035697    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-home" (OuterVolumeSpecName: "home") pod "44236b71-a67d-4c57-a594-ab179fe44b8e" (UID: "44236b71-a67d-4c57-a594-ab179fe44b8e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:37.035888 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035793    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-home\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:37.035888 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035818    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-model-cache\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:37.035888 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.035834    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-tmp-dir\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:37.037607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.037586    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-dshm" (OuterVolumeSpecName: "dshm") pod "44236b71-a67d-4c57-a594-ab179fe44b8e" (UID: "44236b71-a67d-4c57-a594-ab179fe44b8e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:37.037607 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.037598    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44236b71-a67d-4c57-a594-ab179fe44b8e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44236b71-a67d-4c57-a594-ab179fe44b8e" (UID: "44236b71-a67d-4c57-a594-ab179fe44b8e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:57:37.037751 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.037615    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44236b71-a67d-4c57-a594-ab179fe44b8e-kube-api-access-xzbdl" (OuterVolumeSpecName: "kube-api-access-xzbdl") pod "44236b71-a67d-4c57-a594-ab179fe44b8e" (UID: "44236b71-a67d-4c57-a594-ab179fe44b8e"). InnerVolumeSpecName "kube-api-access-xzbdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:57:37.136353 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.136324    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44236b71-a67d-4c57-a594-ab179fe44b8e-dshm\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:37.136353 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.136348    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44236b71-a67d-4c57-a594-ab179fe44b8e-tls-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:37.136353 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.136357    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzbdl\" (UniqueName: \"kubernetes.io/projected/44236b71-a67d-4c57-a594-ab179fe44b8e-kube-api-access-xzbdl\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:57:37.289223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.289188    2565 generic.go:356] "Generic (PLEG): container finished" podID="44236b71-a67d-4c57-a594-ab179fe44b8e" containerID="a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa" exitCode=0
Jul 05 13:57:37.289223 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.289226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn" event={"ID":"44236b71-a67d-4c57-a594-ab179fe44b8e","Type":"ContainerDied","Data":"a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa"}
Jul 05 13:57:37.289480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.289232    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"
Jul 05 13:57:37.289480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.289250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn" event={"ID":"44236b71-a67d-4c57-a594-ab179fe44b8e","Type":"ContainerDied","Data":"20f62f860fb3583f199d4686036d6162a3cb88e86413a5b42c347e0074207cb1"}
Jul 05 13:57:37.289480 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.289266    2565 scope.go:117] "RemoveContainer" containerID="a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa"
Jul 05 13:57:37.298453 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.298433    2565 scope.go:117] "RemoveContainer" containerID="a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa"
Jul 05 13:57:37.298797 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:57:37.298777    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa\": container with ID starting with a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa not found: ID does not exist" containerID="a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa"
Jul 05 13:57:37.298872 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.298807    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa"} err="failed to get container status \"a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa\": rpc error: code = NotFound desc = could not find container \"a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa\": container with ID starting with a2329b9767a4443169e06ba8038ceba87f850d68483af0aec61e9c8cd01864aa not found: ID does not exist"
Jul 05 13:57:37.309388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.309362    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"]
Jul 05 13:57:37.314728 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:37.314699    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/rate-test-model-aa2b8d-kserve-68b86d976c-hh7fn"]
Jul 05 13:57:38.112816 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:38.112777    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44236b71-a67d-4c57-a594-ab179fe44b8e" path="/var/lib/kubelet/pods/44236b71-a67d-4c57-a594-ab179fe44b8e/volumes"
Jul 05 13:57:38.113230 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:57:38.113215    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cea84a39-70ad-4cb1-b7aa-cda10bd77d47" path="/var/lib/kubelet/pods/cea84a39-70ad-4cb1-b7aa-cda10bd77d47/volumes"
Jul 05 13:58:05.291326 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:05.291282    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"]
Jul 05 13:58:05.291981 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:05.291511    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy" containerID="cri-o://fca15ed2ceb64c5d28b39a533593d43518793f99afd562266871fe6d81d85411" gracePeriod=30
Jul 05 13:58:08.324038 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:08.324003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qrnhs"]
Jul 05 13:58:10.440660 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.440626    2565 generic.go:356] "Generic (PLEG): container finished" podID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerID="fca15ed2ceb64c5d28b39a533593d43518793f99afd562266871fe6d81d85411" exitCode=0
Jul 05 13:58:10.441140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.440693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" event={"ID":"c00fc4d3-79e8-4c38-9b4c-865885193459","Type":"ContainerDied","Data":"fca15ed2ceb64c5d28b39a533593d43518793f99afd562266871fe6d81d85411"}
Jul 05 13:58:10.441140 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.440754    2565 scope.go:117] "RemoveContainer" containerID="9785e9de9c14c2bdb6ddb5229061bc9962f91d3a20753bac9970cb811a58fc99"
Jul 05 13:58:10.545368 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.545339    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:58:10.650148 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-socket\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650148 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650104    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00fc4d3-79e8-4c38-9b4c-865885193459-istiod-ca-cert\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650148 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-credential-socket\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-data\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650183    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-token\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9f5m\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-kube-api-access-w9f5m\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650246    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-envoy\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650271    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-podinfo\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650294    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-certs\") pod \"c00fc4d3-79e8-4c38-9b4c-865885193459\" (UID: \"c00fc4d3-79e8-4c38-9b4c-865885193459\") "
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650369    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650450    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:10.650546 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650516    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00fc4d3-79e8-4c38-9b4c-865885193459-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:58:10.650990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650777    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:10.650990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650798    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.650990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650821    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c00fc4d3-79e8-4c38-9b4c-865885193459-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.650990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650837    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.650990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.650983    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-data" (OuterVolumeSpecName: "istio-data") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:10.653016 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.652990    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:58:10.653128 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.652995    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:10.653128 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.653018    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-kube-api-access-w9f5m" (OuterVolumeSpecName: "kube-api-access-w9f5m") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "kube-api-access-w9f5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:58:10.653128 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.653028    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-token" (OuterVolumeSpecName: "istio-token") pod "c00fc4d3-79e8-4c38-9b4c-865885193459" (UID: "c00fc4d3-79e8-4c38-9b4c-865885193459"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:58:10.751645 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.751614    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.751645 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.751640    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.751842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.751648    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.751842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.751697    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.751842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.751706    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:10.751842 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:10.751714    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9f5m\" (UniqueName: \"kubernetes.io/projected/c00fc4d3-79e8-4c38-9b4c-865885193459-kube-api-access-w9f5m\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:11.446196 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:11.446167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"
Jul 05 13:58:11.446606 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:11.446206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2" event={"ID":"c00fc4d3-79e8-4c38-9b4c-865885193459","Type":"ContainerDied","Data":"8dbbdaa943c9d4cc26207bb0e03f9d25feeddd7108ad36fdb5798b48b1264cd9"}
Jul 05 13:58:11.446606 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:11.446265    2565 scope.go:117] "RemoveContainer" containerID="fca15ed2ceb64c5d28b39a533593d43518793f99afd562266871fe6d81d85411"
Jul 05 13:58:11.467417 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:11.467393    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"]
Jul 05 13:58:11.473943 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:11.473917    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-94581b-openshift-default-5785c7bbc-n2qk2"]
Jul 05 13:58:12.113364 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:12.113329    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" path="/var/lib/kubelet/pods/c00fc4d3-79e8-4c38-9b4c-865885193459/volumes"
Jul 05 13:58:12.398113 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:12.398027    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"]
Jul 05 13:58:12.398266 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:12.398224    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy" containerID="cri-o://2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096" gracePeriod=30
Jul 05 13:58:17.462783 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.462751    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lwd42_a8faef00-c7d3-4928-818a-dd38439fa319/manager/0.log"
Jul 05 13:58:17.575362 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.575332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-v66zn_fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e/manager/0.log"
Jul 05 13:58:17.659578 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.659552    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:58:17.715940 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.715873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-envoy\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.715939    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-istio-token\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.715977    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-data\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716002    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-certs\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716081 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85313363-2d50-4de0-8c34-16e43d0ed291-istio-podinfo\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716352 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716128    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc26v\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-kube-api-access-nc26v\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716352 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716162    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-credential-socket\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716352 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-socket\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716352 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716229    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85313363-2d50-4de0-8c34-16e43d0ed291-istiod-ca-cert\") pod \"85313363-2d50-4de0-8c34-16e43d0ed291\" (UID: \"85313363-2d50-4de0-8c34-16e43d0ed291\") "
Jul 05 13:58:17.716352 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716321    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:17.716634 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716457    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:17.716634 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716593    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:17.716634 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716612    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85313363-2d50-4de0-8c34-16e43d0ed291-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:58:17.716819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716614    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-certs\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.716819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716655    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-credential-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.716922 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.716844    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-data" (OuterVolumeSpecName: "istio-data") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:17.718308 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.718286    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:58:17.718426 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.718411    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-kube-api-access-nc26v" (OuterVolumeSpecName: "kube-api-access-nc26v") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "kube-api-access-nc26v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:58:17.718541 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.718517    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-istio-token" (OuterVolumeSpecName: "istio-token") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:58:17.718640 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.718579    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85313363-2d50-4de0-8c34-16e43d0ed291-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85313363-2d50-4de0-8c34-16e43d0ed291" (UID: "85313363-2d50-4de0-8c34-16e43d0ed291"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 05 13:58:17.817222 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.817189    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-istio-token\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.817222 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.817216    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-data\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.817222 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.817225    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85313363-2d50-4de0-8c34-16e43d0ed291-istio-podinfo\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.817452 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.817236    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc26v\" (UniqueName: \"kubernetes.io/projected/85313363-2d50-4de0-8c34-16e43d0ed291-kube-api-access-nc26v\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.817452 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.817247    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-workload-socket\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.817452 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.817256    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85313363-2d50-4de0-8c34-16e43d0ed291-istiod-ca-cert\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:17.817452 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:17.817263    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85313363-2d50-4de0-8c34-16e43d0ed291-istio-envoy\") on node \"ip-10-0-134-75.ec2.internal\" DevicePath \"\""
Jul 05 13:58:18.369900 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.369825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-jc4nt_8b01f223-9f50-425b-a84b-3012b344d699/copy-manifests/0.log"
Jul 05 13:58:18.381858 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.381835    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-jc4nt_8b01f223-9f50-425b-a84b-3012b344d699/manager/0.log"
Jul 05 13:58:18.480118 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.480086    2565 generic.go:356] "Generic (PLEG): container finished" podID="85313363-2d50-4de0-8c34-16e43d0ed291" containerID="2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096" exitCode=0
Jul 05 13:58:18.480540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.480146    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"
Jul 05 13:58:18.480540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.480167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" event={"ID":"85313363-2d50-4de0-8c34-16e43d0ed291","Type":"ContainerDied","Data":"2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096"}
Jul 05 13:58:18.480540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.480221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf" event={"ID":"85313363-2d50-4de0-8c34-16e43d0ed291","Type":"ContainerDied","Data":"c7a780b1f3b405973ee3f5a68b6e333a789e203a0f5d6e65e524c1b77ef3dae7"}
Jul 05 13:58:18.480540 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.480243    2565 scope.go:117] "RemoveContainer" containerID="2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096"
Jul 05 13:58:18.488617 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.488597    2565 scope.go:117] "RemoveContainer" containerID="f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886"
Jul 05 13:58:18.496326 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.496306    2565 scope.go:117] "RemoveContainer" containerID="2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096"
Jul 05 13:58:18.496598 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:58:18.496577    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096\": container with ID starting with 2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096 not found: ID does not exist" containerID="2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096"
Jul 05 13:58:18.496782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.496610    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096"} err="failed to get container status \"2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096\": rpc error: code = NotFound desc = could not find container \"2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096\": container with ID starting with 2b13f10eb5ef4cfeb7ab36201ea157d59ed2bdf94260110e6f7bf9fe01f23096 not found: ID does not exist"
Jul 05 13:58:18.496782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.496634    2565 scope.go:117] "RemoveContainer" containerID="f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886"
Jul 05 13:58:18.496993 ip-10-0-134-75 kubenswrapper[2565]: E0705 13:58:18.496972    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886\": container with ID starting with f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886 not found: ID does not exist" containerID="f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886"
Jul 05 13:58:18.497038 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.497002    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886"} err="failed to get container status \"f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886\": rpc error: code = NotFound desc = could not find container \"f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886\": container with ID starting with f328baf7d860b6435bd7f461a910ea5aedee032f3c64ed6f107d85838cdf0886 not found: ID does not exist"
Jul 05 13:58:18.498069 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.498052    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"]
Jul 05 13:58:18.503316 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:18.503292    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2b8d-openshift-default-69d4b84ddc-7h9gf"]
Jul 05 13:58:20.103125 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:20.103094    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gfdrq_c68f93b3-636b-4419-867e-c75423e0a3e5/manager/0.log"
Jul 05 13:58:20.112644 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:20.112616    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" path="/var/lib/kubelet/pods/85313363-2d50-4de0-8c34-16e43d0ed291/volumes"
Jul 05 13:58:20.677857 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:20.677825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qrnhs_296ef30e-a7dd-431d-9651-c5629a35c23a/limitador/0.log"
Jul 05 13:58:21.124466 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:21.124437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hg5tz_27fe2677-b1da-4535-84a2-a7bff2e42434/istio-proxy/0.log"
Jul 05 13:58:21.578179 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:21.578153    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjwjd_9e47e2e9-b8f9-4f75-bb0e-136666767ca8/istio-proxy/1.log"
Jul 05 13:58:21.923111 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:21.923034    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784f5cbdc-dltf9_5177401f-c1db-4148-abc0-04c10d6f095e/router/0.log"
Jul 05 13:58:22.821096 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:22.821065    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wgkm5_2dfd0b7c-eb7f-42ec-b4bb-c3fb31462029/main/0.log"
Jul 05 13:58:26.957006 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.956971    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ks4vm/must-gather-nkfzj"]
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957303    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957313    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957322    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957330    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957340    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957346    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957353    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957359    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957366    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44236b71-a67d-4c57-a594-ab179fe44b8e" containerName="main"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957371    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44236b71-a67d-4c57-a594-ab179fe44b8e" containerName="main"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957382    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cea84a39-70ad-4cb1-b7aa-cda10bd77d47" containerName="main"
Jul 05 13:58:26.957388 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957387    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cea84a39-70ad-4cb1-b7aa-cda10bd77d47" containerName="main"
Jul 05 13:58:26.957782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957434    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy"
Jul 05 13:58:26.957782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957442    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44236b71-a67d-4c57-a594-ab179fe44b8e" containerName="main"
Jul 05 13:58:26.957782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957449    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00fc4d3-79e8-4c38-9b4c-865885193459" containerName="istio-proxy"
Jul 05 13:58:26.957782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957455    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cea84a39-70ad-4cb1-b7aa-cda10bd77d47" containerName="main"
Jul 05 13:58:26.957782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957461    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy"
Jul 05 13:58:26.957782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.957467    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85313363-2d50-4de0-8c34-16e43d0ed291" containerName="istio-proxy"
Jul 05 13:58:26.962374 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.962352    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:26.964845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.964826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ks4vm\"/\"openshift-service-ca.crt\""
Jul 05 13:58:26.965760 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.965741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ks4vm\"/\"default-dockercfg-q7ls5\""
Jul 05 13:58:26.965875 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.965788    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ks4vm\"/\"kube-root-ca.crt\""
Jul 05 13:58:26.971975 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:26.971950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ks4vm/must-gather-nkfzj"]
Jul 05 13:58:27.098199 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.098165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/893f132c-1045-4ce0-9899-e411964e9930-must-gather-output\") pod \"must-gather-nkfzj\" (UID: \"893f132c-1045-4ce0-9899-e411964e9930\") " pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:27.098389 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.098247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvq7m\" (UniqueName: \"kubernetes.io/projected/893f132c-1045-4ce0-9899-e411964e9930-kube-api-access-dvq7m\") pod \"must-gather-nkfzj\" (UID: \"893f132c-1045-4ce0-9899-e411964e9930\") " pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:27.199230 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.199198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/893f132c-1045-4ce0-9899-e411964e9930-must-gather-output\") pod \"must-gather-nkfzj\" (UID: \"893f132c-1045-4ce0-9899-e411964e9930\") " pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:27.199475 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.199440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvq7m\" (UniqueName: \"kubernetes.io/projected/893f132c-1045-4ce0-9899-e411964e9930-kube-api-access-dvq7m\") pod \"must-gather-nkfzj\" (UID: \"893f132c-1045-4ce0-9899-e411964e9930\") " pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:27.199861 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.199840    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/893f132c-1045-4ce0-9899-e411964e9930-must-gather-output\") pod \"must-gather-nkfzj\" (UID: \"893f132c-1045-4ce0-9899-e411964e9930\") " pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:27.211790 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.211731    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvq7m\" (UniqueName: \"kubernetes.io/projected/893f132c-1045-4ce0-9899-e411964e9930-kube-api-access-dvq7m\") pod \"must-gather-nkfzj\" (UID: \"893f132c-1045-4ce0-9899-e411964e9930\") " pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:27.272352 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.272315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ks4vm/must-gather-nkfzj"
Jul 05 13:58:27.414799 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.414768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ks4vm/must-gather-nkfzj"]
Jul 05 13:58:27.417898 ip-10-0-134-75 kubenswrapper[2565]: W0705 13:58:27.417873    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod893f132c_1045_4ce0_9899_e411964e9930.slice/crio-b75e26bba1f2adedd9d87552d68623e9896c83825960d616f7d8e07debae293b WatchSource:0}: Error finding container b75e26bba1f2adedd9d87552d68623e9896c83825960d616f7d8e07debae293b: Status 404 returned error can't find the container with id b75e26bba1f2adedd9d87552d68623e9896c83825960d616f7d8e07debae293b
Jul 05 13:58:27.419819 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.419798    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:58:27.523341 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:27.523248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ks4vm/must-gather-nkfzj" event={"ID":"893f132c-1045-4ce0-9899-e411964e9930","Type":"ContainerStarted","Data":"b75e26bba1f2adedd9d87552d68623e9896c83825960d616f7d8e07debae293b"}
Jul 05 13:58:28.532208 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:28.532176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ks4vm/must-gather-nkfzj" event={"ID":"893f132c-1045-4ce0-9899-e411964e9930","Type":"ContainerStarted","Data":"6343b167ec18aad73592dc705b6419951671cdfb37e9d704ae8f54378d70ce50"}
Jul 05 13:58:28.532599 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:28.532222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ks4vm/must-gather-nkfzj" event={"ID":"893f132c-1045-4ce0-9899-e411964e9930","Type":"ContainerStarted","Data":"eced47064cfd400a2c506aea2cdc322f1084743566fa462cd34717b9dd3c8af4"}
Jul 05 13:58:28.550094 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:28.550023    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ks4vm/must-gather-nkfzj" podStartSLOduration=1.7379908290000001 podStartE2EDuration="2.550001972s" totalImagesPullingTime="812.011143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:58:28.546879463 +0000 UTC m=+2586.983901189" watchObservedRunningTime="2026-07-05 13:58:28.550001972 +0000 UTC m=+2586.987023697"
Jul 05 13:58:29.866448 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:29.866411    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gt6kj_c1144a9f-42a3-46cc-9c16-0b6bc954cd65/global-pull-secret-syncer/0.log"
Jul 05 13:58:30.015511 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:30.015479    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lq2gn_0f9723c3-246b-41a8-bc29-6daccde48fa5/konnectivity-agent/0.log"
Jul 05 13:58:30.083296 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:30.083267    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-75.ec2.internal_e248d9ed01089d1ca33c4184b25849f2/haproxy/0.log"
Jul 05 13:58:35.367776 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:35.367747    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gfdrq_c68f93b3-636b-4419-867e-c75423e0a3e5/manager/0.log"
Jul 05 13:58:35.659759 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:35.659649    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qrnhs_296ef30e-a7dd-431d-9651-c5629a35c23a/limitador/0.log"
Jul 05 13:58:37.745151 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:37.745121    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dz4jv_f07896df-7828-4395-922f-7dca0d36163a/kube-state-metrics/0.log"
Jul 05 13:58:37.768516 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:37.768440    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dz4jv_f07896df-7828-4395-922f-7dca0d36163a/kube-rbac-proxy-main/0.log"
Jul 05 13:58:37.795996 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:37.795933    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dz4jv_f07896df-7828-4395-922f-7dca0d36163a/kube-rbac-proxy-self/0.log"
Jul 05 13:58:37.824162 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:37.824134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d876fbd96-sbg6z_cf7d8d32-c9fe-4d13-9067-7728d6bee909/metrics-server/0.log"
Jul 05 13:58:37.889434 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:37.889398    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bj277_de5fd667-43bc-4f86-8066-0250989bca1f/node-exporter/0.log"
Jul 05 13:58:37.929076 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:37.929000    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bj277_de5fd667-43bc-4f86-8066-0250989bca1f/kube-rbac-proxy/0.log"
Jul 05 13:58:37.955547 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:37.955518    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bj277_de5fd667-43bc-4f86-8066-0250989bca1f/init-textfile/0.log"
Jul 05 13:58:38.170051 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.170018    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4pcq5_f023722c-18c8-4068-ac88-735a927ebf12/kube-rbac-proxy-main/0.log"
Jul 05 13:58:38.197300 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.197193    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4pcq5_f023722c-18c8-4068-ac88-735a927ebf12/kube-rbac-proxy-self/0.log"
Jul 05 13:58:38.219866 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.219830    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4pcq5_f023722c-18c8-4068-ac88-735a927ebf12/openshift-state-metrics/0.log"
Jul 05 13:58:38.254904 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.254868    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_128b4a09-0fdf-43cc-9315-8fddff519f98/prometheus/0.log"
Jul 05 13:58:38.275990 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.275967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_128b4a09-0fdf-43cc-9315-8fddff519f98/config-reloader/0.log"
Jul 05 13:58:38.304504 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.304475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_128b4a09-0fdf-43cc-9315-8fddff519f98/thanos-sidecar/0.log"
Jul 05 13:58:38.325931 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.325905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_128b4a09-0fdf-43cc-9315-8fddff519f98/kube-rbac-proxy-web/0.log"
Jul 05 13:58:38.360686 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.360627    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_128b4a09-0fdf-43cc-9315-8fddff519f98/kube-rbac-proxy/0.log"
Jul 05 13:58:38.382678 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.382636    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_128b4a09-0fdf-43cc-9315-8fddff519f98/kube-rbac-proxy-thanos/0.log"
Jul 05 13:58:38.406211 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:38.406181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_128b4a09-0fdf-43cc-9315-8fddff519f98/init-config-reloader/0.log"
Jul 05 13:58:39.831359 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.831320    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"]
Jul 05 13:58:39.839998 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.839965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:39.844417 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.844392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"]
Jul 05 13:58:39.939188 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.939153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-podres\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:39.939498 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.939463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-lib-modules\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:39.939729 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.939714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-sys\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:39.939884 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.939867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9lwf\" (UniqueName: \"kubernetes.io/projected/807037f2-23a0-43a5-a003-9c8f0219b94d-kube-api-access-c9lwf\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:39.940093 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:39.940080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-proc\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.041622 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-sys\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.041845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9lwf\" (UniqueName: \"kubernetes.io/projected/807037f2-23a0-43a5-a003-9c8f0219b94d-kube-api-access-c9lwf\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.041845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-proc\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.041845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-podres\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.041845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-proc\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.041845 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041758    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-sys\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.042120 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-lib-modules\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.042120 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041926    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-podres\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.042120 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.041957    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/807037f2-23a0-43a5-a003-9c8f0219b94d-lib-modules\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.049962 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.049929    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9lwf\" (UniqueName: \"kubernetes.io/projected/807037f2-23a0-43a5-a003-9c8f0219b94d-kube-api-access-c9lwf\") pod \"perf-node-gather-daemonset-nxdrh\" (UID: \"807037f2-23a0-43a5-a003-9c8f0219b94d\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.152884 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.152800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.326367 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.326340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"]
Jul 05 13:58:40.611890 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.611854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh" event={"ID":"807037f2-23a0-43a5-a003-9c8f0219b94d","Type":"ContainerStarted","Data":"409ae8615c63f2f95ac06544521de5a0896476daa5c959b5772a472d77ed08ba"}
Jul 05 13:58:40.612184 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.612161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh" event={"ID":"807037f2-23a0-43a5-a003-9c8f0219b94d","Type":"ContainerStarted","Data":"bf0f42869dd79f06cfef5ddaceed99a6f984f69c824583f8fdf4728bd9010a9d"}
Jul 05 13:58:40.612905 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.612882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:40.631744 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:40.631659    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh" podStartSLOduration=1.631639311 podStartE2EDuration="1.631639311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:58:40.629411731 +0000 UTC m=+2599.066433456" watchObservedRunningTime="2026-07-05 13:58:40.631639311 +0000 UTC m=+2599.068661038"
Jul 05 13:58:42.610430 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:42.610401    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvlkl_be43ce0d-dcd4-4ae1-b807-44d64600b3ad/dns/0.log"
Jul 05 13:58:42.632887 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:42.632859    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvlkl_be43ce0d-dcd4-4ae1-b807-44d64600b3ad/kube-rbac-proxy/0.log"
Jul 05 13:58:42.772876 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:42.772837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m99wq_d1863775-a053-442d-96ec-7c30f9e1c8f5/dns-node-resolver/0.log"
Jul 05 13:58:43.369178 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:43.369135    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5849f668b-t9j28_5271c2f2-229b-4720-95bc-cd97206124df/registry/0.log"
Jul 05 13:58:43.417813 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:43.417773    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k88r5_03cafd34-c293-4a41-ba5b-17ac1ab25e1a/node-ca/0.log"
Jul 05 13:58:44.361333 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:44.361236    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hg5tz_27fe2677-b1da-4535-84a2-a7bff2e42434/istio-proxy/0.log"
Jul 05 13:58:44.582867 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:44.582836    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjwjd_9e47e2e9-b8f9-4f75-bb0e-136666767ca8/istio-proxy/0.log"
Jul 05 13:58:44.614469 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:44.614390    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjwjd_9e47e2e9-b8f9-4f75-bb0e-136666767ca8/istio-proxy/1.log"
Jul 05 13:58:44.737751 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:44.737709    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784f5cbdc-dltf9_5177401f-c1db-4148-abc0-04c10d6f095e/router/0.log"
Jul 05 13:58:45.445329 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:45.445282    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p7kl8_044cb6b3-47cc-419e-8326-05bed4594c21/serve-healthcheck-canary/0.log"
Jul 05 13:58:46.101343 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:46.101317    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rzwsg_133f08a0-ebc7-4d30-9ab5-d6a37661b609/kube-rbac-proxy/0.log"
Jul 05 13:58:46.122255 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:46.122228    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rzwsg_133f08a0-ebc7-4d30-9ab5-d6a37661b609/exporter/0.log"
Jul 05 13:58:46.145468 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:46.145442    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rzwsg_133f08a0-ebc7-4d30-9ab5-d6a37661b609/extractor/0.log"
Jul 05 13:58:47.632782 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:47.632755    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-nxdrh"
Jul 05 13:58:48.619416 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:48.619384    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lwd42_a8faef00-c7d3-4928-818a-dd38439fa319/manager/0.log"
Jul 05 13:58:48.804339 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:48.804300    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-v66zn_fa6d2a3d-c1c2-4679-9eaf-42ef0710a94e/manager/0.log"
Jul 05 13:58:49.158371 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:49.158263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-jc4nt_8b01f223-9f50-425b-a84b-3012b344d699/manager/0.log"
Jul 05 13:58:49.179328 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:49.179301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-jc4nt_8b01f223-9f50-425b-a84b-3012b344d699/copy-manifests/0.log"
Jul 05 13:58:50.345249 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:50.345218    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hg5tz_27fe2677-b1da-4535-84a2-a7bff2e42434/istio-proxy/0.log"
Jul 05 13:58:50.537522 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:50.537496    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjwjd_9e47e2e9-b8f9-4f75-bb0e-136666767ca8/istio-proxy/0.log"
Jul 05 13:58:50.577414 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:50.577386    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjwjd_9e47e2e9-b8f9-4f75-bb0e-136666767ca8/istio-proxy/1.log"
Jul 05 13:58:50.611897 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:50.611820    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-687b6f4bf4-7qpjh_90bc5333-f4ae-4888-aff2-2b2433181fdd/manager/0.log"
Jul 05 13:58:50.656626 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:50.656597    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784f5cbdc-dltf9_5177401f-c1db-4148-abc0-04c10d6f095e/router/0.log"
Jul 05 13:58:52.036754 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:52.036719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hg5tz_27fe2677-b1da-4535-84a2-a7bff2e42434/istio-proxy/0.log"
Jul 05 13:58:52.188121 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:52.188036    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjwjd_9e47e2e9-b8f9-4f75-bb0e-136666767ca8/istio-proxy/0.log"
Jul 05 13:58:52.228348 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:52.228321    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjwjd_9e47e2e9-b8f9-4f75-bb0e-136666767ca8/istio-proxy/1.log"
Jul 05 13:58:52.315804 ip-10-0-134-75 kubenswrapper[2565]: I0705 13:58:52.315771    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784f5cbdc-dltf9_5177401f-c1db-4148-abc0-04c10d6f095e/router/0.log"