Jul 08 15:49:00.275709 ip-10-0-132-153 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 15:49:00.275723 ip-10-0-132-153 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 15:49:00.275732 ip-10-0-132-153 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 15:49:00.276064 ip-10-0-132-153 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 15:49:11.618691 ip-10-0-132-153 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 15:49:11.618711 ip-10-0-132-153 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e0d45f842339497e8805dab3146dd8ba --
Jul 08 15:51:09.544847 ip-10-0-132-153 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 15:51:09.929386 ip-10-0-132-153 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 15:51:09.929386 ip-10-0-132-153 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 15:51:09.929386 ip-10-0-132-153 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 15:51:09.929386 ip-10-0-132-153 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 15:51:09.929386 ip-10-0-132-153 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 15:51:09.929386 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.925955    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934409    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934535    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934542    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934547    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934553    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934556    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934559    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934563    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934565    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934568    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934570    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934573    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934588    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934591    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934594    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934597    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934600    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934603    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:09.935848 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934605    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934608    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934614    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934617    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934620    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934622    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934625    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934629    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934633    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934636    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934638    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934641    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934644    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934646    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934648    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934654    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934657    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934660    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934662    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934665    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:09.937597 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934667    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934670    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934673    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934676    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934679    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934682    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934684    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934687    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934690    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934692    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934695    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934697    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934700    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934703    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934705    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934708    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934711    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934713    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934716    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934718    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:09.938868 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934721    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934723    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934726    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934728    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934731    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934734    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934737    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934740    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934742    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934745    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934747    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934750    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934752    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934755    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934758    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934762    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934766    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934770    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934773    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934778    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:09.939565 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934782    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934785    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934788    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934790    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934793    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934797    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934799    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934802    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934805    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934808    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934810    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934813    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934815    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934818    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934820    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934823    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934825    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934828    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934830    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:09.940150 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934833    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.934835    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936328    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936337    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936341    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936344    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936347    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936351    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936356    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936359    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936361    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936364    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936367    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936370    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936372    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936375    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936378    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936381    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936383    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936387    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:09.940664 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936390    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936393    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936396    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936399    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936402    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936404    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936407    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936409    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936412    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936414    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936417    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936419    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936422    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936424    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936427    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936430    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936432    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936435    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936438    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936440    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:09.941265 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936443    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936445    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936449    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936452    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936454    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936457    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936460    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936463    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936465    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936468    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936471    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936473    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936476    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936481    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936484    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936487    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936490    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936492    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936495    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:09.941802 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936499    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936501    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936504    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936507    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936509    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936512    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936514    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936517    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936519    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936522    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936525    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936528    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936532    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936536    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936539    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936541    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936544    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936548    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936551    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:09.942345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936553    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936556    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936559    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936562    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936569    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936571    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936574    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936591    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936594    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936596    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936599    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936602    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936605    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936608    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936610    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936613    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936615    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936618    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936620    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936623    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:09.942894 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936626    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936629    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.936631    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937026    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937032    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937036    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937039    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937042    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937046    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937050    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937053    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937056    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937059    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937061    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937065    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937067    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937071    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937075    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937078    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:09.943503 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937082    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937086    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937088    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937091    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937094    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937097    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937100    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937102    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937105    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937109    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937111    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937114    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937117    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937119    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937124    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937127    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937130    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937132    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937135    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:09.944037 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937137    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937140    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937143    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937145    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937148    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937150    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937153    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937155    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937158    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937161    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937163    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937166    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937168    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937170    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937173    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937176    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937179    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937181    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937184    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937186    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:09.944564 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937189    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937191    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937193    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937196    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937198    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937201    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937204    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937208    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937210    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937213    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937215    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937218    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937221    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937223    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937226    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937228    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937231    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937233    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937236    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937238    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937241    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:09.945103 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937243    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937246    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937248    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937251    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937253    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937257    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937262    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937265    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937268    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937271    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937274    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937277    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937280    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937283    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937285    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937288    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937290    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937293    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937297    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:09.945699 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937300    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937302    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937305    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.937308    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937377    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937387    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937395    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937401    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937407    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937412    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937419    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937425    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937428    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937431    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937434    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937438    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937441    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937444    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937447    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937450    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937453    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937456    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937461    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937464    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 15:51:09.946457 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937467    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937470    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937473    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937489    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937493    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937497    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937500    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937505    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937508    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937511    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937514    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937517    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937521    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937524    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937527    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937535    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937537    2582 flags.go:64] FLAG: --enable-server="true"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937540    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937547    2582 flags.go:64] FLAG: --event-burst="100"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937550    2582 flags.go:64] FLAG: --event-qps="50"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937553    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937556    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937559    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937562    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 15:51:09.947276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937566    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937568    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937571    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937574    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937589    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937592    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937596    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937599    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937602    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937605    2582 flags.go:64] FLAG: --feature-gates=""
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937609    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937612    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937615    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937618    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937621    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937626    2582 flags.go:64] FLAG: --help="false"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937629    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937632    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937635    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937638    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937641    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937644    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937647    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 15:51:10.050440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937652    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 15:51:10.003852 ip-10-0-132-153 systemd[1]: Started Kubernetes Kubelet.
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937654    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937657    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937660    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937663    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937666    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937669    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937672    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937675    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937677    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937680    2582 flags.go:64] FLAG: --lock-file=""
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937683    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937686    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937689    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937697    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937700    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937703    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937706    2582 flags.go:64] FLAG: --logging-format="text"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937709    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937712    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937715    2582 flags.go:64] FLAG: --manifest-url=""
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937718    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937722    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937725    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937730    2582 flags.go:64] FLAG: --max-pods="110"
Jul 08 15:51:10.051645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937733    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937736    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937739    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937742    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937745    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937748    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937751    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937759    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937762    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937765    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937767    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937770    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937775    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937778    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937781    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937784    2582 flags.go:64] FLAG: --port="10250"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937787    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937790    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ba493589e3b8d92a"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937793    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937796    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937799    2582 flags.go:64] FLAG: --register-node="true"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937802    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937805    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937808    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 08 15:51:10.052942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937811    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937814    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937818    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937821    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937824    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937827    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937830    2582 flags.go:64] FLAG: --runonce="false"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937832    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937836    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937839    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937842    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937845    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937848    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937851    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937854    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937858    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937861    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937863    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937866    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937869    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937872    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937875    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937880    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937882    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937885    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 15:51:10.054237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937890    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937892    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937895    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937898    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937901    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937903    2582 flags.go:64] FLAG: --v="2"
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937907    2582 flags.go:64] FLAG: --version="false"
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937912    2582 flags.go:64] FLAG: --vmodule=""
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937915    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.937918    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938046    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938050    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938053    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938057    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938061    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938065    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938068    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938071    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938073    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938076    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938079    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938081    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:10.055328 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938085    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938088    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938091    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938093    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938096    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938098    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938101    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938104    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938106    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938109    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938112    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938115    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938117    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938120    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938122    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938125    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938128    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938130    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938139    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:10.056408 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938142    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938145    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938147    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938150    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938152    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938155    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938158    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938161    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938164    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938166    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938169    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938172    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938174    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938178    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938180    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938183    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938185    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938188    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938190    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938193    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:10.057272 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938195    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938198    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938200    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938203    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938205    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938208    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938210    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938213    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938215    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938218    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938220    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938223    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938226    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938228    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938231    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938233    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938235    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938238    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938242    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938244    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:10.058345 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938247    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938250    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938252    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938255    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938258    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938261    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938264    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938267    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938269    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938272    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938274    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938277    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938280    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938284    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938287    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938289    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938292    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938294    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938297    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:10.059231 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938299    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938302    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938306    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938309    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938312    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938316    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938325    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938327    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.938330    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.938335    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.944910    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.944925    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.944943    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.944949    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 15:51:10.060304 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945008    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945012    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945016    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945019    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945022    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945025    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945028    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945031    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945034    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945037    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945039    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945042    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945045    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945047    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945050    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945052    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945055    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945057    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945060    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945063    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:10.061167 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945066    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945069    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945071    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945074    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945076    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945079    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945082    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945085    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945087    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945092    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945095    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945098    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945100    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945105    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945108    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945111    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945114    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945117    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945120    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:10.062191 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945123    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945125    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945129    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945133    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945136    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945140    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945143    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945146    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945149    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945152    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945154    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945157    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945160    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945163    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945165    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945168    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945171    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945174    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945176    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945179    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:10.063062 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945182    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945184    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945187    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945191    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945195    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945198    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945201    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945204    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945207    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945210    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945212    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945215    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945217    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945220    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945223    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945225    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945228    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945231    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945233    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:10.063950 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945236    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945239    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945242    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945244    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945247    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945249    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945252    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945254    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945257    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945259    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945262    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945265    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945268    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945270    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945273    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945275    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945278    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945281    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945283    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945286    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:10.064843 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945289    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.945294    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945415    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945419    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945423    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945427    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945430    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945433    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945436    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945438    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945441    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945444    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945446    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945449    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:10.065722 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945452    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945454    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945456    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945459    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945461    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945464    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945467    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945469    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945472    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945474    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945477    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945481    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945484    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945488    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945491    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945493    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945497    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945499    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945502    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:10.066391 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945504    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945506    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945509    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945511    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945514    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945517    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945519    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945522    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945524    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945527    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945529    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945531    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945534    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945536    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945539    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945542    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945544    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945547    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945549    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945551    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:10.067287 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945554    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945556    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945559    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945561    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945564    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945566    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945569    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945572    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945574    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945591    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945597    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945600    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945603    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945605    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945608    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945610    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945613    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945616    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945618    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945621    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:10.068182 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945623    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945626    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945628    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945635    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945638    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945640    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945643    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945645    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945648    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945651    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945653    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945655    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945658    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945660    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945663    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945665    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945668    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945671    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945673    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945677    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:10.069042 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945679    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945682    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945684    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945693    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945696    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945699    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945701    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:09.945704    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.945709    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.945826    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.947866    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.949139    2582 server.go:1019] "Starting client certificate rotation"
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.951745    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 15:51:10.072024 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.954701    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 15:51:10.072894 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.954816    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 15:51:10.072894 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.956092    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 15:51:10.072894 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.973125    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 08 15:51:10.072894 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.974872    2582 log.go:25] "Validated CRI v1 image API"
Jul 08 15:51:10.072894 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.975631    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 15:51:10.072894 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.978046    2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 84fa62e2-5b01-41ca-b064-9be4fb88c4dd:/dev/nvme0n1p4 88801f36-1f4a-42a3-83bd-ca123ab09008:/dev/nvme0n1p3]
Jul 08 15:51:10.072894 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.978060    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.982961    2582 manager.go:216] Machine: {Timestamp:2026-07-08 15:51:09.981731622 +0000 UTC m=+0.316740023 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101252 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec299ccc23b3d17352450fe26c2fb8aa SystemUUID:ec299ccc-23b3-d173-5245-0fe26c2fb8aa BootID:e0d45f84-2339-497e-8805-dab3146dd8ba Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:95:07:dd:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:95:07:dd:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:d2:44:0a:10:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.983057    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.983127    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.986458    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.986485    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.987143    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.987153    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.987160    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.987662    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.988340    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.988617    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.990923    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991039    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991065    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991083    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991096    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 15:51:10.280193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991113    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991175    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991517    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.991540    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.993859    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.995758    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.996011    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997489    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997508    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997514    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997521    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997551    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997558    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997565    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997571    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997591    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997597    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997612    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.997617    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.999229    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:09.999237    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.002048    2582 server.go:1268] "Started kubelet"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.002138    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.002202    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.002299    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.003687    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.007269    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.014071    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.014077    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.014252    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.014707    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.014721    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.014710    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.014855    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.014866    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015673    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015687    2582 factory.go:55] Registering systemd factory
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015696    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015882    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015899    2582 factory.go:153] Registering CRI-O factory
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015932    2582 factory.go:223] Registration of the crio container factory successfully
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015954    2582 factory.go:103] Registering Raw factory
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.015968    2582 manager.go:1196] Started watching for new ooms in manager
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.016494    2582 manager.go:349] Starting recovery of all containers
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.016512    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.016516    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 15:51:10.281013 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.016624    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.015794    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-153.ec2.internal.18c05b544930b0d7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-153.ec2.internal,UID:ip-10-0-132-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-153.ec2.internal,},FirstTimestamp:2026-07-08 15:51:10.002024663 +0000 UTC m=+0.337033065,LastTimestamp:2026-07-08 15:51:10.002024663 +0000 UTC m=+0.337033065,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-153.ec2.internal,}"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.021823    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.022869    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.022970    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.025860    2582 manager.go:354] Recovery completed
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.026027    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-txcjx"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.032163    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.033869    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.033888    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.033900    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.034325    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.034333    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.034347    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.034621    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.035274    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.035292    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.035302    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.035493    2582 policy_none.go:49] "None policy: Start"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.035517    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.035527    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.036399    2582 policy_none.go:47] "Start"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.038407    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-153.ec2.internal.18c05b544b16c332  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-153.ec2.internal,UID:ip-10-0-132-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-153.ec2.internal,},FirstTimestamp:2026-07-08 15:51:10.033879858 +0000 UTC m=+0.368888259,LastTimestamp:2026-07-08 15:51:10.033879858 +0000 UTC m=+0.368888259,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-153.ec2.internal,}"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.038923    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-txcjx"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.105273    2582 manager.go:337] "Starting Device Plugin manager"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.105302    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.105313    2582 server.go:87] "Starting device plugin registration server"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.105558    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.105568    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.105720    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.105799    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.105805    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 15:51:10.282409 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.106234    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.106272    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.205905    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.206717    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.206742    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.206753    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.206779    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.213046    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.213062    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-153.ec2.internal\": node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.243526    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.261810    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.261842    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.261861    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.261888    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 15:51:10.283394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.271196    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.348460    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.362606    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal"]
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.362669    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.364506    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.364527    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.364537    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.365662    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.365789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.365814    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.366346    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.366351    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.366366    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.366372    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.366377    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.366391    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.367379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.367400    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.368011    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.368034    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.368043    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.400354    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-153.ec2.internal\" not found" node="ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.411375    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-153.ec2.internal\" not found" node="ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.416828    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ebb569c430ab5042c34c171f35ca6a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal\" (UID: \"3ebb569c430ab5042c34c171f35ca6a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.416857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebb569c430ab5042c34c171f35ca6a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal\" (UID: \"3ebb569c430ab5042c34c171f35ca6a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.442197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.416875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76f545655aaf67c28ab8f818d0661269-config\") pod \"kube-apiserver-proxy-ip-10-0-132-153.ec2.internal\" (UID: \"76f545655aaf67c28ab8f818d0661269\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.449402    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.517161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ebb569c430ab5042c34c171f35ca6a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal\" (UID: \"3ebb569c430ab5042c34c171f35ca6a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.517183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebb569c430ab5042c34c171f35ca6a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal\" (UID: \"3ebb569c430ab5042c34c171f35ca6a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.517209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76f545655aaf67c28ab8f818d0661269-config\") pod \"kube-apiserver-proxy-ip-10-0-132-153.ec2.internal\" (UID: \"76f545655aaf67c28ab8f818d0661269\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.517247    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76f545655aaf67c28ab8f818d0661269-config\") pod \"kube-apiserver-proxy-ip-10-0-132-153.ec2.internal\" (UID: \"76f545655aaf67c28ab8f818d0661269\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.517267    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebb569c430ab5042c34c171f35ca6a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal\" (UID: \"3ebb569c430ab5042c34c171f35ca6a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.517267    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ebb569c430ab5042c34c171f35ca6a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal\" (UID: \"3ebb569c430ab5042c34c171f35ca6a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.587402 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.549677    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.748926 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.651605    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.748926 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.706945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.748926 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.713907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:10.920160 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.752366    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.920160 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.854408    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:10.920160 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.875271    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:10.956849    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.958744    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.958860    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:10.958860    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.042177    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 15:46:10 +0000 UTC" deadline="2027-12-20 22:54:22.66229383 +0000 UTC"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.042209    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12727h3m11.620088363s"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.054177    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.055094    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.055124    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.055134    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:11.080470 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:11.057324    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:11.276167 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:11.159403    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:11.276167 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:11.262238    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-153.ec2.internal\" not found"
Jul 08 15:51:11.468376 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.301725    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:11.468376 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.314963    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:11.468376 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.327567    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 15:51:11.468376 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.328562    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal"
Jul 08 15:51:11.468376 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.345482    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 15:51:11.468376 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.402057    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:11.769003 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:11.650133    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebb569c430ab5042c34c171f35ca6a0.slice/crio-29490fa25701899c21556af93ffa15cc03d3b41944cbec69748c1265d256285e WatchSource:0}: Error finding container 29490fa25701899c21556af93ffa15cc03d3b41944cbec69748c1265d256285e: Status 404 returned error can't find the container with id 29490fa25701899c21556af93ffa15cc03d3b41944cbec69748c1265d256285e
Jul 08 15:51:11.769003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:11.656951    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 15:51:12.015856 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.015836    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 15:51:12.026692 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.026674    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 15:51:12.049548 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.049532    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r2t5s"
Jul 08 15:51:12.050898 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.050878    2582 apiserver.go:52] "Watching apiserver"
Jul 08 15:51:12.053213 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.053191    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:12.060004 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.059981    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r2t5s"
Jul 08 15:51:12.060327 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.060309    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 15:51:12.061256 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.061234    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5","openshift-cluster-node-tuning-operator/tuned-pnvfg","openshift-dns/node-resolver-j78nd","openshift-image-registry/node-ca-6qwt6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal","openshift-multus/multus-b6gdj","openshift-network-diagnostics/network-check-target-nrlcp","kube-system/global-pull-secret-syncer-rk9tn","kube-system/konnectivity-agent-8vzcx","openshift-multus/multus-additional-cni-plugins-qr5mc","openshift-multus/network-metrics-daemon-8f8fs","openshift-network-operator/iptables-alerter-jxg4m","openshift-ovn-kubernetes/ovnkube-node-x4l47"]
Jul 08 15:51:12.064836 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.064815    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.067224 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.067199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.067464 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.067444    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 15:51:12.067777 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.067758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 15:51:12.067861 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.067779    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-47f2m\""
Jul 08 15:51:12.067861 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.067758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 15:51:12.067861 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.067819    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 15:51:12.069352 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.069334    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l56q4\""
Jul 08 15:51:12.069551 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.069532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.069888 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.069862    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 15:51:12.069999 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.069920    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 15:51:12.069999 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.069941    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 15:51:12.071954 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.071854    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fs7hm\""
Jul 08 15:51:12.071954 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.071876    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 15:51:12.071954 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.071904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 15:51:12.071954 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.071859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.074097 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.074078    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.074193 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.074165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l7cpz\""
Jul 08 15:51:12.074415 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.074400    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 15:51:12.074526 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.074508    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 15:51:12.076192 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.076177    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jbctp\""
Jul 08 15:51:12.076357 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.076339    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 15:51:12.076493 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.076471    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 15:51:12.076739 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.076471    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 15:51:12.076739 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.076609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.079009 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.078993    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8nnmz\""
Jul 08 15:51:12.079130 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.079111    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:12.079244 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.079141    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 15:51:12.079244 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.079202    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:12.079244 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.079213    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 15:51:12.079966 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.079943    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 15:51:12.080077 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.079943    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 15:51:12.080077 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.079949    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 15:51:12.080077 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.080064    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 15:51:12.082222 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.082202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:12.082869 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.082257    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:12.084398 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.084378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.086872 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.086848    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ptc59\""
Jul 08 15:51:12.087058 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.087036    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 15:51:12.087159 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.087114    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.087402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.087320    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 15:51:12.087402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.087382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 15:51:12.089888 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.089809    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 15:51:12.089888 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.090320    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 15:51:12.089888 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.090463    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hv8sq\""
Jul 08 15:51:12.092317 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.090973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.093402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.093380    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 15:51:12.093715 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.093695    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 15:51:12.093820 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.093721    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-frhlb\""
Jul 08 15:51:12.094238 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.094221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.094326 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.094311    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:12.115704 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.115689    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 15:51:12.151807 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbpn\" (UniqueName: \"kubernetes.io/projected/de03b97a-8122-4673-b6d3-63a94efd65e6-kube-api-access-7tbpn\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.151807 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-ovn\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.151807 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzflj\" (UniqueName: \"kubernetes.io/projected/ff233a99-4d07-47cb-9f03-e153bf26f76e-kube-api-access-tzflj\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.151807 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-cni-binary-copy\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysctl-d\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-serviceca\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.151981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfrv\" (UniqueName: \"kubernetes.io/projected/d59b06dc-437a-4526-8372-6ba146f1a161-kube-api-access-fgfrv\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-k8s-cni-cncf-io\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j27pk\" (UniqueName: \"kubernetes.io/projected/c685588d-0142-42ca-992a-18d4ec25cb8c-kube-api-access-j27pk\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d97ff5eb-3ed3-4d90-a6cf-07821cfca55a-konnectivity-ca\") pod \"konnectivity-agent-8vzcx\" (UID: \"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a\") " pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.152078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-slash\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-tuned\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-host\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-cni-bin\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-system-cni-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-netns\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-conf-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-kubernetes\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-run\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-system-cni-dir\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-run-netns\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-var-lib-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.152361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-cni-netd\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-sys\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-systemd\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-sys-fs\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-cni-bin\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-kubelet\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-modprobe-d\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de03b97a-8122-4673-b6d3-63a94efd65e6-host-slash\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-etc-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-env-overrides\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovn-node-metrics-cert\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152796    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-os-release\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.153003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysctl-conf\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-var-lib-kubelet\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44tbj\" (UniqueName: \"kubernetes.io/projected/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-kube-api-access-44tbj\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovnkube-config\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwjvp\" (UniqueName: \"kubernetes.io/projected/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-kube-api-access-rwjvp\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c685588d-0142-42ca-992a-18d4ec25cb8c-tmp-dir\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.152983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e61b13c-f4ff-475d-98fa-0811b52489c9-kubelet-config\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/de03b97a-8122-4673-b6d3-63a94efd65e6-iptables-alerter-script\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-kubelet\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153082    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-log-socket\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153148    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-systemd\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-tmp\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e61b13c-f4ff-475d-98fa-0811b52489c9-dbus\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153238    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovnkube-script-lib\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.153717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-device-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-cni-multus\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-lib-modules\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c685588d-0142-42ca-992a-18d4ec25cb8c-hosts-file\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-os-release\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-socket-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-registration-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwsh\" (UniqueName: \"kubernetes.io/projected/4820bcf9-9ac9-4e22-b1ed-e192a424919b-kube-api-access-rjwsh\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-cnibin\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-multus-certs\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153507    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysconfig\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-cnibin\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-hostroot\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-host\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clrkc\" (UniqueName: \"kubernetes.io/projected/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-kube-api-access-clrkc\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d97ff5eb-3ed3-4d90-a6cf-07821cfca55a-agent-certs\") pod \"konnectivity-agent-8vzcx\" (UID: \"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a\") " pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.154247 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-node-log\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-etc-kubernetes\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-systemd-units\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-socket-dir-parent\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-daemon-config\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-cni-binary-copy\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153831    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s8c5\" (UniqueName: \"kubernetes.io/projected/13cc6289-8a1b-4347-9687-113b9395d3cb-kube-api-access-4s8c5\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:12.154734 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.153846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-cni-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.171853 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.171832    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f545655aaf67c28ab8f818d0661269.slice/crio-1d327e84c10bd5c8cae2eb8071a0ed4eeff98e4b1b5e182944b9bfd92e4d0692 WatchSource:0}: Error finding container 1d327e84c10bd5c8cae2eb8071a0ed4eeff98e4b1b5e182944b9bfd92e4d0692: Status 404 returned error can't find the container with id 1d327e84c10bd5c8cae2eb8071a0ed4eeff98e4b1b5e182944b9bfd92e4d0692
Jul 08 15:51:12.254946 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.254917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-tuned\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.255084 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.254951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-host\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.255084 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.254974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-cni-bin\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255084 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255025    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-cni-bin\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255084 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255042    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-host\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.255084 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-system-cni-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-netns\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-conf-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255131    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-system-cni-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-kubernetes\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255176    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-netns\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-run\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255206    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-conf-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.255257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-system-cni-dir\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-run\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255238    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-kubernetes\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255286    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-system-cni-dir\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-run-netns\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-var-lib-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255395    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-run-netns\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255413    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-var-lib-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-cni-netd\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255485    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255346    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255448    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-sys\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.255557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-cni-netd\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-systemd\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255640    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-systemd\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255660    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-sys\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-sys-fs\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-cni-bin\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-kubelet\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255786    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255803    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-sys-fs\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-modprobe-d\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de03b97a-8122-4673-b6d3-63a94efd65e6-host-slash\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255854    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-cni-bin\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-etc-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255930    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-etc-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255991    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-kubelet\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.256307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.255991    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-modprobe-d\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256007    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de03b97a-8122-4673-b6d3-63a94efd65e6-host-slash\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256122    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-openvswitch\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-env-overrides\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovn-node-metrics-cert\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256279    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-os-release\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysctl-conf\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-var-lib-kubelet\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256394    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-os-release\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44tbj\" (UniqueName: \"kubernetes.io/projected/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-kube-api-access-44tbj\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256451    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-var-lib-kubelet\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovnkube-config\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwjvp\" (UniqueName: \"kubernetes.io/projected/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-kube-api-access-rwjvp\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c685588d-0142-42ca-992a-18d4ec25cb8c-tmp-dir\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e61b13c-f4ff-475d-98fa-0811b52489c9-kubelet-config\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.257303 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/de03b97a-8122-4673-b6d3-63a94efd65e6-iptables-alerter-script\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-kubelet\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-log-socket\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256789    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-env-overrides\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-systemd\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-kubelet\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-tmp\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e61b13c-f4ff-475d-98fa-0811b52489c9-dbus\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovnkube-script-lib\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-device-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-cni-multus\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysctl-conf\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-lib-modules\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c685588d-0142-42ca-992a-18d4ec25cb8c-tmp-dir\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257153    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c685588d-0142-42ca-992a-18d4ec25cb8c-hosts-file\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-os-release\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.258203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257239    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-device-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257279    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-socket-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-registration-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwsh\" (UniqueName: \"kubernetes.io/projected/4820bcf9-9ac9-4e22-b1ed-e192a424919b-kube-api-access-rjwsh\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-cnibin\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-multus-certs\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovnkube-config\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysconfig\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-cnibin\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-hostroot\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-host\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.257651    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clrkc\" (UniqueName: \"kubernetes.io/projected/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-kube-api-access-clrkc\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d97ff5eb-3ed3-4d90-a6cf-07821cfca55a-agent-certs\") pod \"konnectivity-agent-8vzcx\" (UID: \"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a\") " pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.257782    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs podName:13cc6289-8a1b-4347-9687-113b9395d3cb nodeName:}" failed. No retries permitted until 2026-07-08 15:51:12.757747746 +0000 UTC m=+3.092756164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs") pod "network-metrics-daemon-8f8fs" (UID: "13cc6289-8a1b-4347-9687-113b9395d3cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.259106 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257854    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.257877    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-node-log\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.256806    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e61b13c-f4ff-475d-98fa-0811b52489c9-kubelet-config\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-etc-kubernetes\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-systemd-units\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258076    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-systemd\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258109    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-var-lib-cni-multus\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-socket-dir-parent\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-daemon-config\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258173    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c685588d-0142-42ca-992a-18d4ec25cb8c-hosts-file\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258173    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-socket-dir-parent\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-cni-binary-copy\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s8c5\" (UniqueName: \"kubernetes.io/projected/13cc6289-8a1b-4347-9687-113b9395d3cb-kube-api-access-4s8c5\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258232    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/de03b97a-8122-4673-b6d3-63a94efd65e6-iptables-alerter-script\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258243    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-log-socket\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-cni-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260025 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-registration-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbpn\" (UniqueName: \"kubernetes.io/projected/de03b97a-8122-4673-b6d3-63a94efd65e6-kube-api-access-7tbpn\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-ovn\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzflj\" (UniqueName: \"kubernetes.io/projected/ff233a99-4d07-47cb-9f03-e153bf26f76e-kube-api-access-tzflj\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258435    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-cni-dir\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258490    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-multus-certs\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258548    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysconfig\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258619    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-hostroot\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-cni-binary-copy\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258724    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-cnibin\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysctl-d\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-serviceca\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258821    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-node-log\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfrv\" (UniqueName: \"kubernetes.io/projected/d59b06dc-437a-4526-8372-6ba146f1a161-kube-api-access-fgfrv\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-k8s-cni-cncf-io\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258864    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-etc-kubernetes\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.260971 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258887    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j27pk\" (UniqueName: \"kubernetes.io/projected/c685588d-0142-42ca-992a-18d4ec25cb8c-kube-api-access-j27pk\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258924    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d97ff5eb-3ed3-4d90-a6cf-07821cfca55a-konnectivity-ca\") pod \"konnectivity-agent-8vzcx\" (UID: \"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a\") " pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258946    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-lib-modules\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258965    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d59b06dc-437a-4526-8372-6ba146f1a161-os-release\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-slash\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-host\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258966    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-systemd-units\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259047    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-host-run-k8s-cni-cncf-io\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259059    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-sysctl-d\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258855    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d59b06dc-437a-4526-8372-6ba146f1a161-cni-binary-copy\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.259089    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.259141    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret podName:3e61b13c-f4ff-475d-98fa-0811b52489c9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:12.759123669 +0000 UTC m=+3.094132074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret") pod "global-pull-secret-syncer-rk9tn" (UID: "3e61b13c-f4ff-475d-98fa-0811b52489c9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.258328    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-cnibin\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259218    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-run-ovn\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259253    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e61b13c-f4ff-475d-98fa-0811b52489c9-dbus\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.261506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259347    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff233a99-4d07-47cb-9f03-e153bf26f76e-host-slash\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259384    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-socket-dir\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259503    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4820bcf9-9ac9-4e22-b1ed-e192a424919b-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259623    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-etc-tuned\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.259747    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovn-node-metrics-cert\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.260124    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-multus-daemon-config\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.260305    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-serviceca\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.260473    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff233a99-4d07-47cb-9f03-e153bf26f76e-ovnkube-script-lib\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.260640    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-cni-binary-copy\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.260765    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d97ff5eb-3ed3-4d90-a6cf-07821cfca55a-konnectivity-ca\") pod \"konnectivity-agent-8vzcx\" (UID: \"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a\") " pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.260946    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d97ff5eb-3ed3-4d90-a6cf-07821cfca55a-agent-certs\") pod \"konnectivity-agent-8vzcx\" (UID: \"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a\") " pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.262095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.261223    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-tmp\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.262765 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.262741    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:12.262765 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.262763    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:12.262918 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.262785    2582 projected.go:196] Error preparing data for projected volume kube-api-access-wn8hp for pod openshift-network-diagnostics/network-check-target-nrlcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:12.263466 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.263438    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp podName:83657d0f-952f-4e19-85ec-67aec0e37ed4 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:12.763385068 +0000 UTC m=+3.098393478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wn8hp" (UniqueName: "kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp") pod "network-check-target-nrlcp" (UID: "83657d0f-952f-4e19-85ec-67aec0e37ed4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:12.267411 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.267385    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44tbj\" (UniqueName: \"kubernetes.io/projected/6f8f7e5a-4e50-4f0b-8fcb-e148d290802c-kube-api-access-44tbj\") pod \"tuned-pnvfg\" (UID: \"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c\") " pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.269309 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.269262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwjvp\" (UniqueName: \"kubernetes.io/projected/2e4bc244-edd0-43af-8ed9-3e5ddc0474c7-kube-api-access-rwjvp\") pod \"multus-b6gdj\" (UID: \"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7\") " pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.270345 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.270160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal" event={"ID":"76f545655aaf67c28ab8f818d0661269","Type":"ContainerStarted","Data":"1d327e84c10bd5c8cae2eb8071a0ed4eeff98e4b1b5e182944b9bfd92e4d0692"}
Jul 08 15:51:12.271396 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.271370    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwsh\" (UniqueName: \"kubernetes.io/projected/4820bcf9-9ac9-4e22-b1ed-e192a424919b-kube-api-access-rjwsh\") pod \"aws-ebs-csi-driver-node-g9xx5\" (UID: \"4820bcf9-9ac9-4e22-b1ed-e192a424919b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.272263 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.272191    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbpn\" (UniqueName: \"kubernetes.io/projected/de03b97a-8122-4673-b6d3-63a94efd65e6-kube-api-access-7tbpn\") pod \"iptables-alerter-jxg4m\" (UID: \"de03b97a-8122-4673-b6d3-63a94efd65e6\") " pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.272363 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.272272    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s8c5\" (UniqueName: \"kubernetes.io/projected/13cc6289-8a1b-4347-9687-113b9395d3cb-kube-api-access-4s8c5\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:12.272938 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.272911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal" event={"ID":"3ebb569c430ab5042c34c171f35ca6a0","Type":"ContainerStarted","Data":"29490fa25701899c21556af93ffa15cc03d3b41944cbec69748c1265d256285e"}
Jul 08 15:51:12.273276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.273252    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j27pk\" (UniqueName: \"kubernetes.io/projected/c685588d-0142-42ca-992a-18d4ec25cb8c-kube-api-access-j27pk\") pod \"node-resolver-j78nd\" (UID: \"c685588d-0142-42ca-992a-18d4ec25cb8c\") " pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.273427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.273414    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clrkc\" (UniqueName: \"kubernetes.io/projected/4e0d6ed7-9388-4031-b5c7-fe89d32f7907-kube-api-access-clrkc\") pod \"node-ca-6qwt6\" (UID: \"4e0d6ed7-9388-4031-b5c7-fe89d32f7907\") " pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.273919 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.273895    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfrv\" (UniqueName: \"kubernetes.io/projected/d59b06dc-437a-4526-8372-6ba146f1a161-kube-api-access-fgfrv\") pod \"multus-additional-cni-plugins-qr5mc\" (UID: \"d59b06dc-437a-4526-8372-6ba146f1a161\") " pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.274049 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.273917    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzflj\" (UniqueName: \"kubernetes.io/projected/ff233a99-4d07-47cb-9f03-e153bf26f76e-kube-api-access-tzflj\") pod \"ovnkube-node-x4l47\" (UID: \"ff233a99-4d07-47cb-9f03-e153bf26f76e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.376031 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.375999    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b6gdj"
Jul 08 15:51:12.384302 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.384243    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxg4m"
Jul 08 15:51:12.387537 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.387511    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4bc244_edd0_43af_8ed9_3e5ddc0474c7.slice/crio-3ff2077017b51c0a653873dc185705f321dc87bf96b94be94a8bb1f4aff67502 WatchSource:0}: Error finding container 3ff2077017b51c0a653873dc185705f321dc87bf96b94be94a8bb1f4aff67502: Status 404 returned error can't find the container with id 3ff2077017b51c0a653873dc185705f321dc87bf96b94be94a8bb1f4aff67502
Jul 08 15:51:12.393717 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.393693    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:12.394627 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.394602    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde03b97a_8122_4673_b6d3_63a94efd65e6.slice/crio-cb1af87316c5ecde90e582455ef5810c844a915311217d87f5b604d02d3537dd WatchSource:0}: Error finding container cb1af87316c5ecde90e582455ef5810c844a915311217d87f5b604d02d3537dd: Status 404 returned error can't find the container with id cb1af87316c5ecde90e582455ef5810c844a915311217d87f5b604d02d3537dd
Jul 08 15:51:12.397642 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.397453    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pnvfg"
Jul 08 15:51:12.404745 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.404688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j78nd"
Jul 08 15:51:12.407233 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.407158    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff233a99_4d07_47cb_9f03_e153bf26f76e.slice/crio-ebd173c7af54a1e12656c74b0c023a321df72fa3627719bc65fc25d2f4051357 WatchSource:0}: Error finding container ebd173c7af54a1e12656c74b0c023a321df72fa3627719bc65fc25d2f4051357: Status 404 returned error can't find the container with id ebd173c7af54a1e12656c74b0c023a321df72fa3627719bc65fc25d2f4051357
Jul 08 15:51:12.409951 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.409931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qwt6"
Jul 08 15:51:12.410830 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.410803    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8f7e5a_4e50_4f0b_8fcb_e148d290802c.slice/crio-b271f0124b9d3903251cec5baf6d7fba09950610902854ee1f0f7b5b964ac974 WatchSource:0}: Error finding container b271f0124b9d3903251cec5baf6d7fba09950610902854ee1f0f7b5b964ac974: Status 404 returned error can't find the container with id b271f0124b9d3903251cec5baf6d7fba09950610902854ee1f0f7b5b964ac974
Jul 08 15:51:12.415287 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.415217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5"
Jul 08 15:51:12.415663 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.415637    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc685588d_0142_42ca_992a_18d4ec25cb8c.slice/crio-31c0756b0ceb5c5cee7a3cc55f21c49ebcb693560a03b2575d08299794f92098 WatchSource:0}: Error finding container 31c0756b0ceb5c5cee7a3cc55f21c49ebcb693560a03b2575d08299794f92098: Status 404 returned error can't find the container with id 31c0756b0ceb5c5cee7a3cc55f21c49ebcb693560a03b2575d08299794f92098
Jul 08 15:51:12.420330 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.420271    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0d6ed7_9388_4031_b5c7_fe89d32f7907.slice/crio-12e8b96e5873d9b81d9f5d5e37588b715136d24a2f3dffa61ac58d8de605d1fd WatchSource:0}: Error finding container 12e8b96e5873d9b81d9f5d5e37588b715136d24a2f3dffa61ac58d8de605d1fd: Status 404 returned error can't find the container with id 12e8b96e5873d9b81d9f5d5e37588b715136d24a2f3dffa61ac58d8de605d1fd
Jul 08 15:51:12.421315 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.421234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:12.424340 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.424220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qr5mc"
Jul 08 15:51:12.426319 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.426298    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4820bcf9_9ac9_4e22_b1ed_e192a424919b.slice/crio-4e8c89792b866e94413a996990b29f448c51771134d821b5fe49dc5b45977e66 WatchSource:0}: Error finding container 4e8c89792b866e94413a996990b29f448c51771134d821b5fe49dc5b45977e66: Status 404 returned error can't find the container with id 4e8c89792b866e94413a996990b29f448c51771134d821b5fe49dc5b45977e66
Jul 08 15:51:12.431790 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.431761    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97ff5eb_3ed3_4d90_a6cf_07821cfca55a.slice/crio-7182c8fc9aa8a10dbf71619da76f06978f4d4079743e1db37eaac853ffaa87ee WatchSource:0}: Error finding container 7182c8fc9aa8a10dbf71619da76f06978f4d4079743e1db37eaac853ffaa87ee: Status 404 returned error can't find the container with id 7182c8fc9aa8a10dbf71619da76f06978f4d4079743e1db37eaac853ffaa87ee
Jul 08 15:51:12.435067 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:12.435043    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59b06dc_437a_4526_8372_6ba146f1a161.slice/crio-9c8141d8bc89511a9f31ad3d9b8dee5c3f26743de8f4c9eeb7ac0698c169726a WatchSource:0}: Error finding container 9c8141d8bc89511a9f31ad3d9b8dee5c3f26743de8f4c9eeb7ac0698c169726a: Status 404 returned error can't find the container with id 9c8141d8bc89511a9f31ad3d9b8dee5c3f26743de8f4c9eeb7ac0698c169726a
Jul 08 15:51:12.763805 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.763717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:12.763805 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.763802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:12.764036 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:12.763848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:12.764036 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.763983    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:12.764132 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.764066    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs podName:13cc6289-8a1b-4347-9687-113b9395d3cb nodeName:}" failed. No retries permitted until 2026-07-08 15:51:13.764046525 +0000 UTC m=+4.099054939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs") pod "network-metrics-daemon-8f8fs" (UID: "13cc6289-8a1b-4347-9687-113b9395d3cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:12.764529 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.764503    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:12.764680 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.764576    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret podName:3e61b13c-f4ff-475d-98fa-0811b52489c9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:13.764549653 +0000 UTC m=+4.099558043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret") pod "global-pull-secret-syncer-rk9tn" (UID: "3e61b13c-f4ff-475d-98fa-0811b52489c9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:12.764760 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.764684    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:12.764760 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.764711    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:12.764760 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.764725    2582 projected.go:196] Error preparing data for projected volume kube-api-access-wn8hp for pod openshift-network-diagnostics/network-check-target-nrlcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:12.764913 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:12.764771    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp podName:83657d0f-952f-4e19-85ec-67aec0e37ed4 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:13.764756253 +0000 UTC m=+4.099764661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn8hp" (UniqueName: "kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp") pod "network-check-target-nrlcp" (UID: "83657d0f-952f-4e19-85ec-67aec0e37ed4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:13.065208 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.065093    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:46:12 +0000 UTC" deadline="2028-03-12 22:58:50.851596809 +0000 UTC"
Jul 08 15:51:13.065208 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.065154    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14719h7m37.786447565s"
Jul 08 15:51:13.262444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.262413    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:13.262946 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.262527    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:13.277296 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.277260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qwt6" event={"ID":"4e0d6ed7-9388-4031-b5c7-fe89d32f7907","Type":"ContainerStarted","Data":"12e8b96e5873d9b81d9f5d5e37588b715136d24a2f3dffa61ac58d8de605d1fd"}
Jul 08 15:51:13.278747 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.278706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pnvfg" event={"ID":"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c","Type":"ContainerStarted","Data":"b271f0124b9d3903251cec5baf6d7fba09950610902854ee1f0f7b5b964ac974"}
Jul 08 15:51:13.280076 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.280047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxg4m" event={"ID":"de03b97a-8122-4673-b6d3-63a94efd65e6","Type":"ContainerStarted","Data":"cb1af87316c5ecde90e582455ef5810c844a915311217d87f5b604d02d3537dd"}
Jul 08 15:51:13.281438 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.281412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b6gdj" event={"ID":"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7","Type":"ContainerStarted","Data":"3ff2077017b51c0a653873dc185705f321dc87bf96b94be94a8bb1f4aff67502"}
Jul 08 15:51:13.283077 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.283039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerStarted","Data":"9c8141d8bc89511a9f31ad3d9b8dee5c3f26743de8f4c9eeb7ac0698c169726a"}
Jul 08 15:51:13.284421 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.284396    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5" event={"ID":"4820bcf9-9ac9-4e22-b1ed-e192a424919b","Type":"ContainerStarted","Data":"4e8c89792b866e94413a996990b29f448c51771134d821b5fe49dc5b45977e66"}
Jul 08 15:51:13.285733 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.285708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j78nd" event={"ID":"c685588d-0142-42ca-992a-18d4ec25cb8c","Type":"ContainerStarted","Data":"31c0756b0ceb5c5cee7a3cc55f21c49ebcb693560a03b2575d08299794f92098"}
Jul 08 15:51:13.287156 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.287133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"ebd173c7af54a1e12656c74b0c023a321df72fa3627719bc65fc25d2f4051357"}
Jul 08 15:51:13.288321 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.288297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vzcx" event={"ID":"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a","Type":"ContainerStarted","Data":"7182c8fc9aa8a10dbf71619da76f06978f4d4079743e1db37eaac853ffaa87ee"}
Jul 08 15:51:13.304636 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.304603    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:13.772947 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.772909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:13.773156 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.772983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:13.773156 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:13.773033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:13.773287 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773169    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:13.773287 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773239    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs podName:13cc6289-8a1b-4347-9687-113b9395d3cb nodeName:}" failed. No retries permitted until 2026-07-08 15:51:15.773217185 +0000 UTC m=+6.108225597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs") pod "network-metrics-daemon-8f8fs" (UID: "13cc6289-8a1b-4347-9687-113b9395d3cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:13.773703 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773680    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:13.773826 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773745    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret podName:3e61b13c-f4ff-475d-98fa-0811b52489c9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:15.773727971 +0000 UTC m=+6.108736367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret") pod "global-pull-secret-syncer-rk9tn" (UID: "3e61b13c-f4ff-475d-98fa-0811b52489c9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:13.773909 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773842    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:13.773909 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773862    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:13.773909 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773877    2582 projected.go:196] Error preparing data for projected volume kube-api-access-wn8hp for pod openshift-network-diagnostics/network-check-target-nrlcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:13.774065 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:13.773919    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp podName:83657d0f-952f-4e19-85ec-67aec0e37ed4 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:15.773905505 +0000 UTC m=+6.108913917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn8hp" (UniqueName: "kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp") pod "network-check-target-nrlcp" (UID: "83657d0f-952f-4e19-85ec-67aec0e37ed4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:14.262481 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:14.262390    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:14.264896 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:14.264854    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:14.267814 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:14.267776    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:14.267976 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:14.267927    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:15.262407 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:15.262373    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:15.262613 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.262503    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:15.793576 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:15.793536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:15.793766 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:15.793625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:15.793766 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:15.793668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:15.793910 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793785    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:15.793910 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793786    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:15.793910 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793846    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs podName:13cc6289-8a1b-4347-9687-113b9395d3cb nodeName:}" failed. No retries permitted until 2026-07-08 15:51:19.793826354 +0000 UTC m=+10.128834753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs") pod "network-metrics-daemon-8f8fs" (UID: "13cc6289-8a1b-4347-9687-113b9395d3cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:15.793910 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793866    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret podName:3e61b13c-f4ff-475d-98fa-0811b52489c9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:19.7938552 +0000 UTC m=+10.128863595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret") pod "global-pull-secret-syncer-rk9tn" (UID: "3e61b13c-f4ff-475d-98fa-0811b52489c9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:15.794137 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793919    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:15.794137 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793935    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:15.794137 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793948    2582 projected.go:196] Error preparing data for projected volume kube-api-access-wn8hp for pod openshift-network-diagnostics/network-check-target-nrlcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:15.794137 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:15.793993    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp podName:83657d0f-952f-4e19-85ec-67aec0e37ed4 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:19.793974402 +0000 UTC m=+10.128982810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn8hp" (UniqueName: "kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp") pod "network-check-target-nrlcp" (UID: "83657d0f-952f-4e19-85ec-67aec0e37ed4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:16.262370 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:16.262129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:16.262370 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:16.262205    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:16.262370 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:16.262252    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:16.262370 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:16.262360    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:17.263439 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:17.262935    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:17.263439 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:17.263067    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:18.262803 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:18.262724    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:18.262944 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:18.262862    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:18.263365 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:18.263343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:18.263496 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:18.263471    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:19.262385 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:19.262353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:19.262557 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.262475    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:19.829884 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:19.829840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:19.829921    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:19.829950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830017    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830034    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830080    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs podName:13cc6289-8a1b-4347-9687-113b9395d3cb nodeName:}" failed. No retries permitted until 2026-07-08 15:51:27.830066312 +0000 UTC m=+18.165074702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs") pod "network-metrics-daemon-8f8fs" (UID: "13cc6289-8a1b-4347-9687-113b9395d3cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830097    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret podName:3e61b13c-f4ff-475d-98fa-0811b52489c9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:27.830087302 +0000 UTC m=+18.165095692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret") pod "global-pull-secret-syncer-rk9tn" (UID: "3e61b13c-f4ff-475d-98fa-0811b52489c9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830144    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830158    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830170    2582 projected.go:196] Error preparing data for projected volume kube-api-access-wn8hp for pod openshift-network-diagnostics/network-check-target-nrlcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:19.830280 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:19.830213    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp podName:83657d0f-952f-4e19-85ec-67aec0e37ed4 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:27.830197348 +0000 UTC m=+18.165205743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn8hp" (UniqueName: "kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp") pod "network-check-target-nrlcp" (UID: "83657d0f-952f-4e19-85ec-67aec0e37ed4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:20.264543 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:20.264040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:20.264543 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:20.264158    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:20.264543 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:20.264245    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:20.264543 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:20.264353    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:21.263174 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:21.262932    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:21.263638 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:21.263293    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:22.263099 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:22.263066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:22.263278 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:22.263225    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:22.263641 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:22.263277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:22.263641 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:22.263391    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:23.262777 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:23.262741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:23.262960 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:23.262855    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:24.262748 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:24.262712    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:24.263200 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:24.262844    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:24.263200 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:24.262885    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:24.263200 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:24.262950    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:25.262981 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:25.262952    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:25.263370 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:25.263069    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:26.262792 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:26.262763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:26.262792 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:26.262786    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:26.263018 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:26.262885    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:26.263018 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:26.262984    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:27.262665 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:27.262629    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:27.262887 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.262756    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:27.888562 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:27.888521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:27.888620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:27.888672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888764    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888787    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888784    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888797    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888858    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret podName:3e61b13c-f4ff-475d-98fa-0811b52489c9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:43.88883919 +0000 UTC m=+34.223847602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret") pod "global-pull-secret-syncer-rk9tn" (UID: "3e61b13c-f4ff-475d-98fa-0811b52489c9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888800    2582 projected.go:196] Error preparing data for projected volume kube-api-access-wn8hp for pod openshift-network-diagnostics/network-check-target-nrlcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888878    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs podName:13cc6289-8a1b-4347-9687-113b9395d3cb nodeName:}" failed. No retries permitted until 2026-07-08 15:51:43.88886737 +0000 UTC m=+34.223875765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs") pod "network-metrics-daemon-8f8fs" (UID: "13cc6289-8a1b-4347-9687-113b9395d3cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:27.889082 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:27.888932    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp podName:83657d0f-952f-4e19-85ec-67aec0e37ed4 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:43.888915429 +0000 UTC m=+34.223923837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn8hp" (UniqueName: "kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp") pod "network-check-target-nrlcp" (UID: "83657d0f-952f-4e19-85ec-67aec0e37ed4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:28.262933 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:28.262854    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:28.262933 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:28.262893    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:28.263203 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:28.262977    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:28.263203 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:28.263122    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:29.262452 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:29.262376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:29.262955 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:29.262483    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:29.325052 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:29.325006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal" event={"ID":"3ebb569c430ab5042c34c171f35ca6a0","Type":"ContainerStarted","Data":"c0d95c39970aaad92756582b9be8056c584289370a2ae7dc8036c39532b6c005"}
Jul 08 15:51:30.263377 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:30.263332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:30.263846 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:30.263465    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:30.263846 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:30.263519    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:30.263846 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:30.263609    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:31.262110 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:31.262073    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:31.262288 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:31.262197    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:32.263704 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:32.263680    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:32.264058 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:32.263802    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:32.264058 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:32.263879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:32.264058 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:32.263991    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:32.341851 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:32.341506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal" event={"ID":"76f545655aaf67c28ab8f818d0661269","Type":"ContainerStarted","Data":"43cd4120aa58afbba0e3393dedb914f1866b5ea7597d2cef4186ee85e09a47f4"}
Jul 08 15:51:32.346172 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:32.346061    2582 generic.go:356] "Generic (PLEG): container finished" podID="3ebb569c430ab5042c34c171f35ca6a0" containerID="c0d95c39970aaad92756582b9be8056c584289370a2ae7dc8036c39532b6c005" exitCode=0
Jul 08 15:51:32.346172 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:32.346145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal" event={"ID":"3ebb569c430ab5042c34c171f35ca6a0","Type":"ContainerDied","Data":"c0d95c39970aaad92756582b9be8056c584289370a2ae7dc8036c39532b6c005"}
Jul 08 15:51:32.348570 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:32.348169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j78nd" event={"ID":"c685588d-0142-42ca-992a-18d4ec25cb8c","Type":"ContainerStarted","Data":"faa496c7e2198f354542ba23f108e198da4d67bd81805f26535c44e3f73bf3c4"}
Jul 08 15:51:32.367772 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:32.367543    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-153.ec2.internal" podStartSLOduration=21.367524109 podStartE2EDuration="21.367524109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:32.367440087 +0000 UTC m=+22.702448500" watchObservedRunningTime="2026-07-08 15:51:32.367524109 +0000 UTC m=+22.702532521"
Jul 08 15:51:33.262233 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.262050    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:33.262431 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:33.262335    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:33.352238 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.352188    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal" event={"ID":"3ebb569c430ab5042c34c171f35ca6a0","Type":"ContainerStarted","Data":"2fbc5e98d32225e5bdacac6c2c1a09fa6f43fa66bc38354925be2032b6e6969a"}
Jul 08 15:51:33.353860 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.353829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vzcx" event={"ID":"d97ff5eb-3ed3-4d90-a6cf-07821cfca55a","Type":"ContainerStarted","Data":"7ef7d0b0766f75dcd8e4386b06f77a9dfa2aa5970c733f03348e29c17ac47b0b"}
Jul 08 15:51:33.355792 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.355734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qwt6" event={"ID":"4e0d6ed7-9388-4031-b5c7-fe89d32f7907","Type":"ContainerStarted","Data":"12d5a95a9ed94d8281dd660a7d5813604f0ac6b6a3f78c6f58470acbe10849a9"}
Jul 08 15:51:33.357318 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.357291    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pnvfg" event={"ID":"6f8f7e5a-4e50-4f0b-8fcb-e148d290802c","Type":"ContainerStarted","Data":"6393ba7a625e1017274e4ca202108d8fb05214c6ed6c1b0a272b0408eb782a0e"}
Jul 08 15:51:33.360369 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.360343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b6gdj" event={"ID":"2e4bc244-edd0-43af-8ed9-3e5ddc0474c7","Type":"ContainerStarted","Data":"93fea7d8157adeb070168a331938c1b87495b2f5d22926c791705310dbd8dea7"}
Jul 08 15:51:33.361868 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.361845    2582 generic.go:356] "Generic (PLEG): container finished" podID="d59b06dc-437a-4526-8372-6ba146f1a161" containerID="9053b88405a1439ca772fcd5ed54937b55fa93ab00d7c631e9c6631649883cf5" exitCode=0
Jul 08 15:51:33.361987 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.361900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerDied","Data":"9053b88405a1439ca772fcd5ed54937b55fa93ab00d7c631e9c6631649883cf5"}
Jul 08 15:51:33.363566 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.363544    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5" event={"ID":"4820bcf9-9ac9-4e22-b1ed-e192a424919b","Type":"ContainerStarted","Data":"bc65df9695579ef1de49ff9868f3ce7b6b17e188f6eb8117ac7c39f4d8e9ab9d"}
Jul 08 15:51:33.366834 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.366812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"bc7ba279d54a183c84402c651c32f948e2e0374dfebf66daf33a950a6949f47b"}
Jul 08 15:51:33.366917 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.366890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"052b219dfbc41e394a97ee6d1478057f989465cc72d8c236b6a6693df602d730"}
Jul 08 15:51:33.366979 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.366944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"91948fb95812fc8b6b71644093e48c582f59ab65337375eac8f3415270404bb5"}
Jul 08 15:51:33.367041 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.366992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"78c32eeb4e109f82cfbff1b710ddf198918309e067a5bf5609dcbaf3382309bc"}
Jul 08 15:51:33.367093 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.367039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"667f14d93cd31da868486419506d37cb6c6b71da7033a72b77e43cc0d8820697"}
Jul 08 15:51:33.367093 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.367088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"9e4de1e8db09694f39c81e900d24ddd05d3a18e0018f5b9eb4bfffef5596a440"}
Jul 08 15:51:33.371738 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.371696    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j78nd" podStartSLOduration=3.984792768 podStartE2EDuration="23.371678691s" totalImagesPullingTime="19.386885923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:32.417876997 +0000 UTC m=+22.752885517" watchObservedRunningTime="2026-07-08 15:51:33.371678691 +0000 UTC m=+23.706687105"
Jul 08 15:51:33.371857 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.371833    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-153.ec2.internal" podStartSLOduration=22.371828069 podStartE2EDuration="22.371828069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:33.371120941 +0000 UTC m=+23.706129346" watchObservedRunningTime="2026-07-08 15:51:33.371828069 +0000 UTC m=+23.706836481"
Jul 08 15:51:33.393939 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.393896    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6qwt6" podStartSLOduration=3.646346721 podStartE2EDuration="23.393883805s" totalImagesPullingTime="19.747537084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:33.393659551 +0000 UTC m=+23.728667962" watchObservedRunningTime="2026-07-08 15:51:33.393883805 +0000 UTC m=+23.728892216"
Jul 08 15:51:33.411364 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.411333    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8vzcx" podStartSLOduration=12.357661235 podStartE2EDuration="23.411323309s" totalImagesPullingTime="11.053662074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:33.410952966 +0000 UTC m=+23.745961376" watchObservedRunningTime="2026-07-08 15:51:33.411323309 +0000 UTC m=+23.746331719"
Jul 08 15:51:33.431258 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:33.431226    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pnvfg" podStartSLOduration=3.672973915 podStartE2EDuration="23.431215239s" totalImagesPullingTime="19.758241324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:33.430783881 +0000 UTC m=+23.765792293" watchObservedRunningTime="2026-07-08 15:51:33.431215239 +0000 UTC m=+23.766223650"
Jul 08 15:51:34.078952 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.078921    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:34.079635 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.079613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:34.095408 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.095391    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 15:51:34.097803 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.097758    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b6gdj" podStartSLOduration=4.29759831 podStartE2EDuration="24.097736812s" totalImagesPullingTime="19.800138502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:33.474360285 +0000 UTC m=+23.809368674" watchObservedRunningTime="2026-07-08 15:51:34.097736812 +0000 UTC m=+24.432745221"
Jul 08 15:51:34.115970 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.115897    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T15:51:34.095404803Z","UUID":"97aad95d-1739-489a-be95-30c1f0c1253c","Handler":null,"Name":"","Endpoint":""}
Jul 08 15:51:34.117115 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.117093    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 15:51:34.117194 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.117135    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 15:51:34.262698 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.262621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:34.262852 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.262621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:34.262852 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:34.262749    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:34.262852 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:34.262835    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:34.370164 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.370138    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxg4m" event={"ID":"de03b97a-8122-4673-b6d3-63a94efd65e6","Type":"ContainerStarted","Data":"6c120544d5638db3be0d84c23aa4ce075e5ea1acf14c8c31dcea691e2dfdbd0d"}
Jul 08 15:51:34.372168 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.372130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5" event={"ID":"4820bcf9-9ac9-4e22-b1ed-e192a424919b","Type":"ContainerStarted","Data":"0f1814c72459b230eb8e4756fd0a401721f274412d7381bc853f93d198803e0b"}
Jul 08 15:51:34.372813 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.372787    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:34.373073 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.373055    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8vzcx"
Jul 08 15:51:34.388575 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:34.388533    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jxg4m" podStartSLOduration=4.614127768 podStartE2EDuration="24.388519786s" totalImagesPullingTime="19.774392018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:34.388275767 +0000 UTC m=+24.723284189" watchObservedRunningTime="2026-07-08 15:51:34.388519786 +0000 UTC m=+24.723528196"
Jul 08 15:51:35.262853 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:35.262822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:35.263003 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:35.262962    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:35.378104 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:35.377884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"993f8dbe747a41edac6fb78d812eccd8893eef11f9f8981223b8273a75e101e4"}
Jul 08 15:51:36.262269 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:36.262230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:36.262444 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:36.262361    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:36.262444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:36.262400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:36.262553 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:36.262479    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:36.381511 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:36.381477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5" event={"ID":"4820bcf9-9ac9-4e22-b1ed-e192a424919b","Type":"ContainerStarted","Data":"f7f0cdc4c011fd3108ea782bb6ba5417dbb890ca404103d047dab28454aaa21f"}
Jul 08 15:51:36.402387 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:36.402337    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9xx5" podStartSLOduration=3.934034866 podStartE2EDuration="26.402324299s" totalImagesPullingTime="22.468289433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:36.401300934 +0000 UTC m=+26.736309356" watchObservedRunningTime="2026-07-08 15:51:36.402324299 +0000 UTC m=+26.737332703"
Jul 08 15:51:37.263010 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:37.262978    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:37.263151 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:37.263107    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:38.262281 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:38.262189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:38.262977 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:38.262311    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:38.262977 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:38.262368    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:38.262977 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:38.262469    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:39.262511 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.262335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:39.262896 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:39.262600    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:39.390374 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.390343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" event={"ID":"ff233a99-4d07-47cb-9f03-e153bf26f76e","Type":"ContainerStarted","Data":"492a8c7505bc2f42a12a1b2f6e5017f40f1bc1932b4395290c50924e3a54fffd"}
Jul 08 15:51:39.390622 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.390595    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:39.390723 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.390671    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:39.392381 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.392355    2582 generic.go:356] "Generic (PLEG): container finished" podID="d59b06dc-437a-4526-8372-6ba146f1a161" containerID="7509687a2cd1ecdcd6b0c377c6710bdf0621d9bcfc6d7e4589136b4dd8e6d6df" exitCode=0
Jul 08 15:51:39.392463 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.392401    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerDied","Data":"7509687a2cd1ecdcd6b0c377c6710bdf0621d9bcfc6d7e4589136b4dd8e6d6df"}
Jul 08 15:51:39.406601 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.406561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:39.406703 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.406691    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:39.425929 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:39.425896    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47" podStartSLOduration=9.475690683 podStartE2EDuration="29.425884718s" totalImagesPullingTime="19.950194035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:39.424103952 +0000 UTC m=+29.759112362" watchObservedRunningTime="2026-07-08 15:51:39.425884718 +0000 UTC m=+29.760893129"
Jul 08 15:51:40.263849 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.263821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:40.264433 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:40.263941    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:40.264433 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.263984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:40.264433 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:40.264126    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:40.394919 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.394889    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:51:40.781796 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.781545    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rk9tn"]
Jul 08 15:51:40.781930 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.781837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:40.781970 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:40.781948    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:40.786196 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.786161    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrlcp"]
Jul 08 15:51:40.787427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.787401    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8f8fs"]
Jul 08 15:51:40.787675 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.787660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:40.789449 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:40.788645    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:40.789449 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:40.789037    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:40.789449 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:40.789164    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:41.398145 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:41.398118    2582 generic.go:356] "Generic (PLEG): container finished" podID="d59b06dc-437a-4526-8372-6ba146f1a161" containerID="f1d85ec543053f4af0c6489ed3c00fb510a234718dc6c260b99a5e713be03d97" exitCode=0
Jul 08 15:51:41.398484 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:41.398213    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerDied","Data":"f1d85ec543053f4af0c6489ed3c00fb510a234718dc6c260b99a5e713be03d97"}
Jul 08 15:51:42.262823 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:42.262800    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:42.262920 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:42.262824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:42.262958 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:42.262925    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:42.263037 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:42.263020    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:42.402805 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:42.402731    2582 generic.go:356] "Generic (PLEG): container finished" podID="d59b06dc-437a-4526-8372-6ba146f1a161" containerID="45704828a28243e1185512f57665a603253b9b958703ac6a35c5c9b34888b8d9" exitCode=0
Jul 08 15:51:42.402805 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:42.402767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerDied","Data":"45704828a28243e1185512f57665a603253b9b958703ac6a35c5c9b34888b8d9"}
Jul 08 15:51:43.262302 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:43.262223    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:43.262450 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.262355    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:43.911689 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:43.911660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:43.911701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:43.911745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911823    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911845    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911860    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911871    2582 projected.go:196] Error preparing data for projected volume kube-api-access-wn8hp for pod openshift-network-diagnostics/network-check-target-nrlcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911891    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs podName:13cc6289-8a1b-4347-9687-113b9395d3cb nodeName:}" failed. No retries permitted until 2026-07-08 15:52:15.911873986 +0000 UTC m=+66.246882394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs") pod "network-metrics-daemon-8f8fs" (UID: "13cc6289-8a1b-4347-9687-113b9395d3cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911899    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911910    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp podName:83657d0f-952f-4e19-85ec-67aec0e37ed4 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:15.911900317 +0000 UTC m=+66.246908706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wn8hp" (UniqueName: "kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp") pod "network-check-target-nrlcp" (UID: "83657d0f-952f-4e19-85ec-67aec0e37ed4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:43.912104 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:43.911972    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret podName:3e61b13c-f4ff-475d-98fa-0811b52489c9 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:15.911952544 +0000 UTC m=+66.246960933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret") pod "global-pull-secret-syncer-rk9tn" (UID: "3e61b13c-f4ff-475d-98fa-0811b52489c9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:44.262873 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:44.262795    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:44.263026 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:44.262926    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rk9tn" podUID="3e61b13c-f4ff-475d-98fa-0811b52489c9"
Jul 08 15:51:44.263026 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:44.262986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:44.263115 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:44.263089    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrlcp" podUID="83657d0f-952f-4e19-85ec-67aec0e37ed4"
Jul 08 15:51:45.263100 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:45.263069    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:45.263637 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:45.263210    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8f8fs" podUID="13cc6289-8a1b-4347-9687-113b9395d3cb"
Jul 08 15:51:45.952251 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:45.952226    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-153.ec2.internal" event="NodeReady"
Jul 08 15:51:45.952415 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:45.952329    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 15:51:46.000607 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.000566    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8xnhs"]
Jul 08 15:51:46.031550 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.031483    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-trww9"]
Jul 08 15:51:46.031702 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.031622    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.034701 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.034677    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 15:51:46.034973 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.034954    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mjhcc\""
Jul 08 15:51:46.035198 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.035175    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 15:51:46.042838 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.042818    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8xnhs"]
Jul 08 15:51:46.042924 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.042855    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trww9"]
Jul 08 15:51:46.042979 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.042954    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.043039 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.042980    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p6x6r"]
Jul 08 15:51:46.045775 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.045617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 15:51:46.045775 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.045639    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 15:51:46.045923 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.045837    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 15:51:46.045982 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.045926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 15:51:46.046496 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.046477    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96wh4\""
Jul 08 15:51:46.060828 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.060808    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p6x6r"]
Jul 08 15:51:46.060911 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.060889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.064495 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.064323    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 15:51:46.064495 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.064333    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 15:51:46.064495 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.064374    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-68mn7\""
Jul 08 15:51:46.064889 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.064868    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 15:51:46.128227 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128196    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qqlm\" (UniqueName: \"kubernetes.io/projected/d22e1688-1c81-446d-bacd-9267421e8538-kube-api-access-2qqlm\") pod \"ingress-canary-p6x6r\" (UID: \"d22e1688-1c81-446d-bacd-9267421e8538\") " pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.128227 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmc8l\" (UniqueName: \"kubernetes.io/projected/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-api-access-qmc8l\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.128437 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-config-volume\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.128437 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-tmp-dir\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.128437 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d22e1688-1c81-446d-bacd-9267421e8538-cert\") pod \"ingress-canary-p6x6r\" (UID: \"d22e1688-1c81-446d-bacd-9267421e8538\") " pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.128437 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.128437 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq2g4\" (UniqueName: \"kubernetes.io/projected/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-kube-api-access-vq2g4\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.128437 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ea18122-ff82-4685-9fd0-0a8622439b62-crio-socket\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.128654 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea18122-ff82-4685-9fd0-0a8622439b62-data-volume\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.128654 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.128654 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.128480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.229262 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ea18122-ff82-4685-9fd0-0a8622439b62-crio-socket\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.229262 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea18122-ff82-4685-9fd0-0a8622439b62-data-volume\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.229462 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.229462 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.229462 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qqlm\" (UniqueName: \"kubernetes.io/projected/d22e1688-1c81-446d-bacd-9267421e8538-kube-api-access-2qqlm\") pod \"ingress-canary-p6x6r\" (UID: \"d22e1688-1c81-446d-bacd-9267421e8538\") " pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.229462 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmc8l\" (UniqueName: \"kubernetes.io/projected/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-api-access-qmc8l\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.229462 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-config-volume\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.229740 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-tmp-dir\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.229740 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229505    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ea18122-ff82-4685-9fd0-0a8622439b62-crio-socket\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.229740 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d22e1688-1c81-446d-bacd-9267421e8538-cert\") pod \"ingress-canary-p6x6r\" (UID: \"d22e1688-1c81-446d-bacd-9267421e8538\") " pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.229740 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.229740 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2g4\" (UniqueName: \"kubernetes.io/projected/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-kube-api-access-vq2g4\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.229740 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.229461    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:46.230030 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.229775    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:46.729755369 +0000 UTC m=+37.064763774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:46.230030 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229573    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea18122-ff82-4685-9fd0-0a8622439b62-data-volume\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.230030 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.229480    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:46.230030 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.229839    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls podName:c0c4fae1-b722-44bf-8e8a-ac14c732b1d0 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:46.729828575 +0000 UTC m=+37.064836969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls") pod "dns-default-8xnhs" (UID: "c0c4fae1-b722-44bf-8e8a-ac14c732b1d0") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:46.230030 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.229700    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:46.230030 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.229877    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:46.729868326 +0000 UTC m=+37.064876735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:46.230030 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.229883    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-tmp-dir\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.230384 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.230052    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-config-volume\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.234246 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.234222    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d22e1688-1c81-446d-bacd-9267421e8538-cert\") pod \"ingress-canary-p6x6r\" (UID: \"d22e1688-1c81-446d-bacd-9267421e8538\") " pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.238593 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.238559    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qqlm\" (UniqueName: \"kubernetes.io/projected/d22e1688-1c81-446d-bacd-9267421e8538-kube-api-access-2qqlm\") pod \"ingress-canary-p6x6r\" (UID: \"d22e1688-1c81-446d-bacd-9267421e8538\") " pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.238698 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.238561    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmc8l\" (UniqueName: \"kubernetes.io/projected/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-api-access-qmc8l\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.238698 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.238603    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq2g4\" (UniqueName: \"kubernetes.io/projected/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-kube-api-access-vq2g4\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.262770 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.262750    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:51:46.262974 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.262956    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:51:46.265848 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.265822    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8k7f\""
Jul 08 15:51:46.265848 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.265838    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 15:51:46.265848 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.265837    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 15:51:46.266410 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.265839    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 15:51:46.371102 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.371084    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p6x6r"
Jul 08 15:51:46.572816 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.572574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p6x6r"]
Jul 08 15:51:46.576704 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:46.576679    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22e1688_1c81_446d_bacd_9267421e8538.slice/crio-5132acb8201e32f9099c2c7a53d9907bb69ac7450dffcfd88c01c512241106d3 WatchSource:0}: Error finding container 5132acb8201e32f9099c2c7a53d9907bb69ac7450dffcfd88c01c512241106d3: Status 404 returned error can't find the container with id 5132acb8201e32f9099c2c7a53d9907bb69ac7450dffcfd88c01c512241106d3
Jul 08 15:51:46.733487 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.733378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.733487 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.733437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:46.733487 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.733463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:46.733786 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.733514    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:46.733786 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.733616    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:47.733593665 +0000 UTC m=+38.068602068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:46.733786 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.733623    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:46.733786 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.733627    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:46.733786 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.733667    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls podName:c0c4fae1-b722-44bf-8e8a-ac14c732b1d0 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:47.733652555 +0000 UTC m=+38.068660961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls") pod "dns-default-8xnhs" (UID: "c0c4fae1-b722-44bf-8e8a-ac14c732b1d0") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:46.733786 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:46.733683    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:47.733675106 +0000 UTC m=+38.068683495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:46.859037 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.859006    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6zjkg"]
Jul 08 15:51:46.888080 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.888052    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6zjkg"]
Jul 08 15:51:46.888219 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.888183    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:46.890935 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.890801    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 15:51:46.890935 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.890801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 15:51:46.890935 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.890911    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lqvpz\""
Jul 08 15:51:46.891231 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.891100    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 15:51:46.891685 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.891666    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 15:51:46.935211 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.935184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f745adf5-4351-41eb-8aa8-965de33c3361-signing-cabundle\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:46.935389 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.935251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfpct\" (UniqueName: \"kubernetes.io/projected/f745adf5-4351-41eb-8aa8-965de33c3361-kube-api-access-wfpct\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:46.935389 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:46.935357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f745adf5-4351-41eb-8aa8-965de33c3361-signing-key\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.036101 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.036029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f745adf5-4351-41eb-8aa8-965de33c3361-signing-key\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.036101 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.036086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f745adf5-4351-41eb-8aa8-965de33c3361-signing-cabundle\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.036286 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.036235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpct\" (UniqueName: \"kubernetes.io/projected/f745adf5-4351-41eb-8aa8-965de33c3361-kube-api-access-wfpct\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.036707 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.036689    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f745adf5-4351-41eb-8aa8-965de33c3361-signing-cabundle\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.039156 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.039132    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f745adf5-4351-41eb-8aa8-965de33c3361-signing-key\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.045388 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.045371    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpct\" (UniqueName: \"kubernetes.io/projected/f745adf5-4351-41eb-8aa8-965de33c3361-kube-api-access-wfpct\") pod \"service-ca-758f599c5-6zjkg\" (UID: \"f745adf5-4351-41eb-8aa8-965de33c3361\") " pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.199212 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.199174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-6zjkg"
Jul 08 15:51:47.262729 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.262696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:51:47.266466 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.266440    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 15:51:47.266973 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.266527    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-24mlw\""
Jul 08 15:51:47.365146 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.365099    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6zjkg"]
Jul 08 15:51:47.368797 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:51:47.368768    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf745adf5_4351_41eb_8aa8_965de33c3361.slice/crio-ffa88ff3d9c58b09efa89569bc0c767592dccfcc9bd30eca364d6ad13922f3d3 WatchSource:0}: Error finding container ffa88ff3d9c58b09efa89569bc0c767592dccfcc9bd30eca364d6ad13922f3d3: Status 404 returned error can't find the container with id ffa88ff3d9c58b09efa89569bc0c767592dccfcc9bd30eca364d6ad13922f3d3
Jul 08 15:51:47.416320 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.416287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-6zjkg" event={"ID":"f745adf5-4351-41eb-8aa8-965de33c3361","Type":"ContainerStarted","Data":"ffa88ff3d9c58b09efa89569bc0c767592dccfcc9bd30eca364d6ad13922f3d3"}
Jul 08 15:51:47.417606 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.417564    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p6x6r" event={"ID":"d22e1688-1c81-446d-bacd-9267421e8538","Type":"ContainerStarted","Data":"5132acb8201e32f9099c2c7a53d9907bb69ac7450dffcfd88c01c512241106d3"}
Jul 08 15:51:47.741854 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.741765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:47.741854 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.741815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:47.742073 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.741909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:47.742073 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:47.741953    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:47.742073 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:47.741997    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:47.742073 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:47.742010    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:47.742073 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:47.742031    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:49.742008255 +0000 UTC m=+40.077016667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:47.742073 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:47.742051    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:49.742041665 +0000 UTC m=+40.077050058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:47.742073 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:47.742065    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls podName:c0c4fae1-b722-44bf-8e8a-ac14c732b1d0 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:49.742057194 +0000 UTC m=+40.077065611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls") pod "dns-default-8xnhs" (UID: "c0c4fae1-b722-44bf-8e8a-ac14c732b1d0") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:47.835991 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:47.835960    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j78nd_c685588d-0142-42ca-992a-18d4ec25cb8c/dns-node-resolver/0.log"
Jul 08 15:51:48.611233 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:48.611197    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qwt6_4e0d6ed7-9388-4031-b5c7-fe89d32f7907/node-ca/0.log"
Jul 08 15:51:49.759250 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:49.759141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:49.759250 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:49.759220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:49.759250 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:49.759252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:49.759838 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:49.759269    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:49.759838 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:49.759349    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:53.759327951 +0000 UTC m=+44.094336346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:49.759838 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:49.759370    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:49.759838 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:49.759423    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls podName:c0c4fae1-b722-44bf-8e8a-ac14c732b1d0 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:53.759407447 +0000 UTC m=+44.094416044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls") pod "dns-default-8xnhs" (UID: "c0c4fae1-b722-44bf-8e8a-ac14c732b1d0") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:49.759838 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:49.759484    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:49.759838 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:49.759518    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:53.759507891 +0000 UTC m=+44.094516280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:51.430083 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:51.430050    2582 generic.go:356] "Generic (PLEG): container finished" podID="d59b06dc-437a-4526-8372-6ba146f1a161" containerID="f1087d680f6fc672b87acec7044bfb0d21c1be4072066a94b393e42ec1f84b17" exitCode=0
Jul 08 15:51:51.430401 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:51.430134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerDied","Data":"f1087d680f6fc672b87acec7044bfb0d21c1be4072066a94b393e42ec1f84b17"}
Jul 08 15:51:51.431600 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:51.431565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p6x6r" event={"ID":"d22e1688-1c81-446d-bacd-9267421e8538","Type":"ContainerStarted","Data":"fdd85d9b40ee19311065e6a7074a89e5af2b06d2d0080235b7697836fd7c4092"}
Jul 08 15:51:52.435118 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:52.435079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-6zjkg" event={"ID":"f745adf5-4351-41eb-8aa8-965de33c3361","Type":"ContainerStarted","Data":"3fc51637bcf260678be4f845bd2dc102776d4e80d1540c045dcb1670d0f27237"}
Jul 08 15:51:52.438027 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:52.437996    2582 generic.go:356] "Generic (PLEG): container finished" podID="d59b06dc-437a-4526-8372-6ba146f1a161" containerID="2a4172221d18ea2e68b81930de955e2ee8dad3712cd54055c2de37d16e5e2c84" exitCode=0
Jul 08 15:51:52.438141 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:52.438069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerDied","Data":"2a4172221d18ea2e68b81930de955e2ee8dad3712cd54055c2de37d16e5e2c84"}
Jul 08 15:51:52.451755 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:52.451713    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p6x6r" podStartSLOduration=2.6593272040000002 podStartE2EDuration="6.451700121s" totalImagesPullingTime="3.792372917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:51.475744424 +0000 UTC m=+41.810752836" watchObservedRunningTime="2026-07-08 15:51:52.451700121 +0000 UTC m=+42.786708524"
Jul 08 15:51:52.451856 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:52.451813    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-6zjkg" podStartSLOduration=2.483272156 podStartE2EDuration="6.451803099s" totalImagesPullingTime="3.968530943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:52.45149835 +0000 UTC m=+42.786506761" watchObservedRunningTime="2026-07-08 15:51:52.451803099 +0000 UTC m=+42.786811510"
Jul 08 15:51:53.444770 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:53.444707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" event={"ID":"d59b06dc-437a-4526-8372-6ba146f1a161","Type":"ContainerStarted","Data":"9997b4b500ad01328f29abe23be611b4af7dad612f27e846db39e12e98878446"}
Jul 08 15:51:53.472749 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:53.472695    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qr5mc" podStartSLOduration=8.783881747 podStartE2EDuration="43.472674594s" totalImagesPullingTime="34.688792847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:53.471284106 +0000 UTC m=+43.806292519" watchObservedRunningTime="2026-07-08 15:51:53.472674594 +0000 UTC m=+43.807682986"
Jul 08 15:51:53.794562 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:53.794484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:53.794562 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:53.794522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:51:53.794769 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:51:53.794622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:51:53.794769 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:53.794644    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:53.794769 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:53.794701    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:53.794769 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:53.794709    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:53.794769 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:53.794704    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:01.794689222 +0000 UTC m=+52.129697612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:53.794769 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:53.794750    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:01.794738979 +0000 UTC m=+52.129747367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:53.794769 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:51:53.794760    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls podName:c0c4fae1-b722-44bf-8e8a-ac14c732b1d0 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:01.794754322 +0000 UTC m=+52.129762711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls") pod "dns-default-8xnhs" (UID: "c0c4fae1-b722-44bf-8e8a-ac14c732b1d0") : secret "dns-default-metrics-tls" not found
Jul 08 15:52:01.855871 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:01.855832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:52:01.856324 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:01.855896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:52:01.856324 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:01.855917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:52:01.856324 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:52:01.856040    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:52:01.856324 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:52:01.856113    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls podName:6ea18122-ff82-4685-9fd0-0a8622439b62 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:17.856094652 +0000 UTC m=+68.191103045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trww9" (UID: "6ea18122-ff82-4685-9fd0-0a8622439b62") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:52:01.856477 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:01.856346    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ea18122-ff82-4685-9fd0-0a8622439b62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:52:01.858684 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:01.858664    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0c4fae1-b722-44bf-8e8a-ac14c732b1d0-metrics-tls\") pod \"dns-default-8xnhs\" (UID: \"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0\") " pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:52:01.942059 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:01.942032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:52:02.078037 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:02.078007    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8xnhs"]
Jul 08 15:52:02.083098 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:02.083074    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c4fae1_b722_44bf_8e8a_ac14c732b1d0.slice/crio-d1498757c7628a9c3da5646d54096f615857f06eebf1c35920b0af4eda9e9c60 WatchSource:0}: Error finding container d1498757c7628a9c3da5646d54096f615857f06eebf1c35920b0af4eda9e9c60: Status 404 returned error can't find the container with id d1498757c7628a9c3da5646d54096f615857f06eebf1c35920b0af4eda9e9c60
Jul 08 15:52:02.465308 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:02.465269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8xnhs" event={"ID":"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0","Type":"ContainerStarted","Data":"d1498757c7628a9c3da5646d54096f615857f06eebf1c35920b0af4eda9e9c60"}
Jul 08 15:52:05.474499 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:05.474464    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8xnhs" event={"ID":"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0","Type":"ContainerStarted","Data":"86a2d5155b1ae49d14811b67c8a215386f98233912b7e5ea6fbaebc80fc979c0"}
Jul 08 15:52:05.474974 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:05.474524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8xnhs" event={"ID":"c0c4fae1-b722-44bf-8e8a-ac14c732b1d0","Type":"ContainerStarted","Data":"db9010056035ccc280f2d0733ce26d300dd6cf1e5c8fc9fd92774088c60536af"}
Jul 08 15:52:05.474974 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:05.474612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:52:05.507748 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:05.507696    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8xnhs" podStartSLOduration=17.962238716 podStartE2EDuration="20.507657414s" totalImagesPullingTime="2.545418698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:05.507130552 +0000 UTC m=+55.842138963" watchObservedRunningTime="2026-07-08 15:52:05.507657414 +0000 UTC m=+55.842665802"
Jul 08 15:52:08.463417 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.463375    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"]
Jul 08 15:52:08.484913 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.484860    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"]
Jul 08 15:52:08.485085 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.484997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.487551 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.487524    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 15:52:08.487696 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.487561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9mwqk\""
Jul 08 15:52:08.489301 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.489279    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 15:52:08.489443 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.489425    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 15:52:08.489766 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.489749    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 15:52:08.499892 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.499872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"]
Jul 08 15:52:08.499988 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.499901    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"]
Jul 08 15:52:08.500045 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.499990    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.502794 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.502776    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 15:52:08.503187 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.503172    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 15:52:08.504007 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.503989    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 15:52:08.505016 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.504998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 15:52:08.605061 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-hub\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.605203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48zl7\" (UniqueName: \"kubernetes.io/projected/7927f18f-495b-405e-aa38-7cfaa0353ad4-kube-api-access-48zl7\") pod \"managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4\" (UID: \"7927f18f-495b-405e-aa38-7cfaa0353ad4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.605203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-ca\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.605203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.605203 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8d7475-de38-4b3c-a8f8-2783db10446e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.605360 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.605360 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605233    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtjl5\" (UniqueName: \"kubernetes.io/projected/8c8d7475-de38-4b3c-a8f8-2783db10446e-kube-api-access-vtjl5\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.605360 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.605301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7927f18f-495b-405e-aa38-7cfaa0353ad4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4\" (UID: \"7927f18f-495b-405e-aa38-7cfaa0353ad4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.706509 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-hub\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.706662 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48zl7\" (UniqueName: \"kubernetes.io/projected/7927f18f-495b-405e-aa38-7cfaa0353ad4-kube-api-access-48zl7\") pod \"managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4\" (UID: \"7927f18f-495b-405e-aa38-7cfaa0353ad4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.706662 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-ca\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.706662 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.706662 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8d7475-de38-4b3c-a8f8-2783db10446e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.706925 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.707017 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtjl5\" (UniqueName: \"kubernetes.io/projected/8c8d7475-de38-4b3c-a8f8-2783db10446e-kube-api-access-vtjl5\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.707017 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.706992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7927f18f-495b-405e-aa38-7cfaa0353ad4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4\" (UID: \"7927f18f-495b-405e-aa38-7cfaa0353ad4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.707351 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.707328    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8d7475-de38-4b3c-a8f8-2783db10446e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.709511 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.709487    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-ca\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.709612 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.709509    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-hub\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.709612 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.709530    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.709690 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.709667    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7927f18f-495b-405e-aa38-7cfaa0353ad4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4\" (UID: \"7927f18f-495b-405e-aa38-7cfaa0353ad4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.709783 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.709768    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8c8d7475-de38-4b3c-a8f8-2783db10446e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.724575 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.724526    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48zl7\" (UniqueName: \"kubernetes.io/projected/7927f18f-495b-405e-aa38-7cfaa0353ad4-kube-api-access-48zl7\") pod \"managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4\" (UID: \"7927f18f-495b-405e-aa38-7cfaa0353ad4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.725688 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.725671    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtjl5\" (UniqueName: \"kubernetes.io/projected/8c8d7475-de38-4b3c-a8f8-2783db10446e-kube-api-access-vtjl5\") pod \"cluster-proxy-proxy-agent-5f4544b45-djxq5\" (UID: \"8c8d7475-de38-4b3c-a8f8-2783db10446e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.804091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.804063    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"
Jul 08 15:52:08.811290 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.811269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"
Jul 08 15:52:08.968040 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.968015    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4"]
Jul 08 15:52:08.969203 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:08.969171    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7927f18f_495b_405e_aa38_7cfaa0353ad4.slice/crio-7f273334e8c278e532d38fae8f767de022e2c5e1c7fadbcb54ccdbeda8b22813 WatchSource:0}: Error finding container 7f273334e8c278e532d38fae8f767de022e2c5e1c7fadbcb54ccdbeda8b22813: Status 404 returned error can't find the container with id 7f273334e8c278e532d38fae8f767de022e2c5e1c7fadbcb54ccdbeda8b22813
Jul 08 15:52:08.985267 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:08.985177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5"]
Jul 08 15:52:08.988947 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:08.988921    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c8d7475_de38_4b3c_a8f8_2783db10446e.slice/crio-b34cc8184e11c924da1443cabe96bb447ffe07650b4ecb7abf39f812171988fb WatchSource:0}: Error finding container b34cc8184e11c924da1443cabe96bb447ffe07650b4ecb7abf39f812171988fb: Status 404 returned error can't find the container with id b34cc8184e11c924da1443cabe96bb447ffe07650b4ecb7abf39f812171988fb
Jul 08 15:52:09.483786 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:09.483745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4" event={"ID":"7927f18f-495b-405e-aa38-7cfaa0353ad4","Type":"ContainerStarted","Data":"7f273334e8c278e532d38fae8f767de022e2c5e1c7fadbcb54ccdbeda8b22813"}
Jul 08 15:52:09.484830 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:09.484809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5" event={"ID":"8c8d7475-de38-4b3c-a8f8-2783db10446e","Type":"ContainerStarted","Data":"b34cc8184e11c924da1443cabe96bb447ffe07650b4ecb7abf39f812171988fb"}
Jul 08 15:52:11.410223 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:11.410192    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4l47"
Jul 08 15:52:12.495353 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:12.495317    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4" event={"ID":"7927f18f-495b-405e-aa38-7cfaa0353ad4","Type":"ContainerStarted","Data":"6fe07ab4046c210497fc77552ece19988e09500f6429915eac8f460446ef568d"}
Jul 08 15:52:12.514786 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:12.514728    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cdbf664d8-pm6k4" podStartSLOduration=1.160646746 podStartE2EDuration="4.514706659s" totalImagesPullingTime="3.354059913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:12.513329535 +0000 UTC m=+62.848337947" watchObservedRunningTime="2026-07-08 15:52:12.514706659 +0000 UTC m=+62.849715071"
Jul 08 15:52:14.502237 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:14.502195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5" event={"ID":"8c8d7475-de38-4b3c-a8f8-2783db10446e","Type":"ContainerStarted","Data":"eb5cd98d8552ce03eaf7c64bb9cda4c94aeb8440978aa495371f42e82b8f15a7"}
Jul 08 15:52:14.502640 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:14.502249    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5" event={"ID":"8c8d7475-de38-4b3c-a8f8-2783db10446e","Type":"ContainerStarted","Data":"7c9b415fcfe6fbaeed8f9ba173b25d6d2892567d51c96855df587b32d8b4ab32"}
Jul 08 15:52:14.502640 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:14.502269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5" event={"ID":"8c8d7475-de38-4b3c-a8f8-2783db10446e","Type":"ContainerStarted","Data":"afbde79d605dec9f93a82c5456e8096fb5673d2fdc892d9ef0dc74575359a16d"}
Jul 08 15:52:14.523373 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:14.523331    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f4544b45-djxq5" podStartSLOduration=1.770168873 podStartE2EDuration="6.523317854s" totalImagesPullingTime="4.753148981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:14.521856934 +0000 UTC m=+64.856865344" watchObservedRunningTime="2026-07-08 15:52:14.523317854 +0000 UTC m=+64.858326243"
Jul 08 15:52:15.478634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.478605    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8xnhs"
Jul 08 15:52:15.963794 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.963765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:52:15.964188 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.963805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:52:15.964188 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.963831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:52:15.966487 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.966470    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 15:52:15.967213 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.967200    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 15:52:15.967256 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.967204    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 15:52:15.976251 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.976235    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 15:52:15.976608 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.976570    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e61b13c-f4ff-475d-98fa-0811b52489c9-original-pull-secret\") pod \"global-pull-secret-syncer-rk9tn\" (UID: \"3e61b13c-f4ff-475d-98fa-0811b52489c9\") " pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:52:15.976679 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.976573    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13cc6289-8a1b-4347-9687-113b9395d3cb-metrics-certs\") pod \"network-metrics-daemon-8f8fs\" (UID: \"13cc6289-8a1b-4347-9687-113b9395d3cb\") " pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:52:15.986949 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:15.986926    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8hp\" (UniqueName: \"kubernetes.io/projected/83657d0f-952f-4e19-85ec-67aec0e37ed4-kube-api-access-wn8hp\") pod \"network-check-target-nrlcp\" (UID: \"83657d0f-952f-4e19-85ec-67aec0e37ed4\") " pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:52:16.077647 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.077622    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-24mlw\""
Jul 08 15:52:16.085695 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.085677    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8f8fs"
Jul 08 15:52:16.204356 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.204322    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8f8fs"]
Jul 08 15:52:16.207146 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:16.207121    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cc6289_8a1b_4347_9687_113b9395d3cb.slice/crio-4a51b340d394b21be293ff72f765e9bf54e221462d581393aeb7288f325f6422 WatchSource:0}: Error finding container 4a51b340d394b21be293ff72f765e9bf54e221462d581393aeb7288f325f6422: Status 404 returned error can't find the container with id 4a51b340d394b21be293ff72f765e9bf54e221462d581393aeb7288f325f6422
Jul 08 15:52:16.274020 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.273966    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rk9tn"
Jul 08 15:52:16.282682 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.282653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8k7f\""
Jul 08 15:52:16.290830 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.290804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:52:16.401386 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.401281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rk9tn"]
Jul 08 15:52:16.404678 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:16.404651    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e61b13c_f4ff_475d_98fa_0811b52489c9.slice/crio-fe84835fa16b612899155770bf10cf7a4ddb453c68f22cfbee3d4a54b1407663 WatchSource:0}: Error finding container fe84835fa16b612899155770bf10cf7a4ddb453c68f22cfbee3d4a54b1407663: Status 404 returned error can't find the container with id fe84835fa16b612899155770bf10cf7a4ddb453c68f22cfbee3d4a54b1407663
Jul 08 15:52:16.417712 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.417690    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrlcp"]
Jul 08 15:52:16.421080 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:16.421058    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83657d0f_952f_4e19_85ec_67aec0e37ed4.slice/crio-24cb110ffb088686fd1d328d5daa761003781b2cfb4d861329614ca29df1594b WatchSource:0}: Error finding container 24cb110ffb088686fd1d328d5daa761003781b2cfb4d861329614ca29df1594b: Status 404 returned error can't find the container with id 24cb110ffb088686fd1d328d5daa761003781b2cfb4d861329614ca29df1594b
Jul 08 15:52:16.509733 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.509706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrlcp" event={"ID":"83657d0f-952f-4e19-85ec-67aec0e37ed4","Type":"ContainerStarted","Data":"24cb110ffb088686fd1d328d5daa761003781b2cfb4d861329614ca29df1594b"}
Jul 08 15:52:16.514214 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.514174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rk9tn" event={"ID":"3e61b13c-f4ff-475d-98fa-0811b52489c9","Type":"ContainerStarted","Data":"fe84835fa16b612899155770bf10cf7a4ddb453c68f22cfbee3d4a54b1407663"}
Jul 08 15:52:16.515232 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:16.515212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8f8fs" event={"ID":"13cc6289-8a1b-4347-9687-113b9395d3cb","Type":"ContainerStarted","Data":"4a51b340d394b21be293ff72f765e9bf54e221462d581393aeb7288f325f6422"}
Jul 08 15:52:17.877684 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:17.877649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:52:17.880367 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:17.880311    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ea18122-ff82-4685-9fd0-0a8622439b62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trww9\" (UID: \"6ea18122-ff82-4685-9fd0-0a8622439b62\") " pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:52:18.155827 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:18.155739    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96wh4\""
Jul 08 15:52:18.164104 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:18.164077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trww9"
Jul 08 15:52:18.310069 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:18.310028    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trww9"]
Jul 08 15:52:18.316732 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:18.316704    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea18122_ff82_4685_9fd0_0a8622439b62.slice/crio-c770ebffd1b00a22c354f034d0e991b53fe43224016bf70884b230beafae30a9 WatchSource:0}: Error finding container c770ebffd1b00a22c354f034d0e991b53fe43224016bf70884b230beafae30a9: Status 404 returned error can't find the container with id c770ebffd1b00a22c354f034d0e991b53fe43224016bf70884b230beafae30a9
Jul 08 15:52:18.523931 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:18.523835    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trww9" event={"ID":"6ea18122-ff82-4685-9fd0-0a8622439b62","Type":"ContainerStarted","Data":"c770ebffd1b00a22c354f034d0e991b53fe43224016bf70884b230beafae30a9"}
Jul 08 15:52:18.526186 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:18.526152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8f8fs" event={"ID":"13cc6289-8a1b-4347-9687-113b9395d3cb","Type":"ContainerStarted","Data":"66ed417e82e8de2c92e3ce6a8e785a46f0a27679647723ac8b39d54451a9ed61"}
Jul 08 15:52:18.526323 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:18.526209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8f8fs" event={"ID":"13cc6289-8a1b-4347-9687-113b9395d3cb","Type":"ContainerStarted","Data":"f8d4aefdafdaeac2e7778c93d056ccfbbdca214ad57c26927760f528eced1077"}
Jul 08 15:52:18.544017 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:18.543967    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8f8fs" podStartSLOduration=67.220469525 podStartE2EDuration="1m8.543947142s" totalImagesPullingTime="1.323477617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:18.542399187 +0000 UTC m=+68.877407599" watchObservedRunningTime="2026-07-08 15:52:18.543947142 +0000 UTC m=+68.878955554"
Jul 08 15:52:24.565231 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.564075    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-smghm"]
Jul 08 15:52:24.579548 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.579525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.582301 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.582278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 15:52:24.582301 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.582283    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 15:52:24.582473 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.582283    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 15:52:24.582473 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.582284    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 15:52:24.583173 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.583017    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4sr77\""
Jul 08 15:52:24.583173 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.583061    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 15:52:24.583173 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.583017    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 15:52:24.736373 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rmlj\" (UniqueName: \"kubernetes.io/projected/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-kube-api-access-4rmlj\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736373 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-tls\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736373 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-metrics-client-ca\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736661 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-wtmp\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736661 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736413    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-textfile\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736661 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-sys\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736661 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-root\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736661 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.736661 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.736541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-accelerators-collector-config\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.836945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-sys\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.836984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-root\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-accelerators-collector-config\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rmlj\" (UniqueName: \"kubernetes.io/projected/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-kube-api-access-4rmlj\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837107    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-tls\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-metrics-client-ca\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-wtmp\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-textfile\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837218    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-sys\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837272    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-root\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:52:24.837388    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:52:24.837444    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-tls podName:404a01b5-78d3-493f-b2f7-b7e9ca8f139c nodeName:}" failed. No retries permitted until 2026-07-08 15:52:25.337424083 +0000 UTC m=+75.672432477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-tls") pod "node-exporter-smghm" (UID: "404a01b5-78d3-493f-b2f7-b7e9ca8f139c") : secret "node-exporter-tls" not found
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.837495    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-textfile\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.838039    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-metrics-client-ca\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.838427 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.838199    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-accelerators-collector-config\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.839311 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.838571    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-wtmp\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.844709 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.844662    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:24.849302 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:24.849262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rmlj\" (UniqueName: \"kubernetes.io/projected/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-kube-api-access-4rmlj\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:25.341447 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.341403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-tls\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:25.343735 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.343715    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404a01b5-78d3-493f-b2f7-b7e9ca8f139c-node-exporter-tls\") pod \"node-exporter-smghm\" (UID: \"404a01b5-78d3-493f-b2f7-b7e9ca8f139c\") " pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:25.501934 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.501902    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-smghm"
Jul 08 15:52:25.511091 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:25.511060    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404a01b5_78d3_493f_b2f7_b7e9ca8f139c.slice/crio-57d33b4c29f47a60c82dcb423476a868512b27e8738051f07bfa84d88b496cf2 WatchSource:0}: Error finding container 57d33b4c29f47a60c82dcb423476a868512b27e8738051f07bfa84d88b496cf2: Status 404 returned error can't find the container with id 57d33b4c29f47a60c82dcb423476a868512b27e8738051f07bfa84d88b496cf2
Jul 08 15:52:25.570174 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.570138    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrlcp" event={"ID":"83657d0f-952f-4e19-85ec-67aec0e37ed4","Type":"ContainerStarted","Data":"9a3291b391e2065728d6881710a76656d76f2ee678378ed211451871b4cd9ded"}
Jul 08 15:52:25.570617 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.570231    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:52:25.571396 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.571374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smghm" event={"ID":"404a01b5-78d3-493f-b2f7-b7e9ca8f139c","Type":"ContainerStarted","Data":"57d33b4c29f47a60c82dcb423476a868512b27e8738051f07bfa84d88b496cf2"}
Jul 08 15:52:25.572854 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.572824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rk9tn" event={"ID":"3e61b13c-f4ff-475d-98fa-0811b52489c9","Type":"ContainerStarted","Data":"bbef61430c0df8d1862ca416329ffc2570fb18055d5271cde02995773334f694"}
Jul 08 15:52:25.574220 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.574199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trww9" event={"ID":"6ea18122-ff82-4685-9fd0-0a8622439b62","Type":"ContainerStarted","Data":"0dca7608c19c9c3d96687ca424ae004d585ffac49486d043e375eca7a9ec3723"}
Jul 08 15:52:25.624260 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.624155    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rk9tn" podStartSLOduration=66.573193685 podStartE2EDuration="1m14.62413386s" totalImagesPullingTime="8.050940175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:25.623229169 +0000 UTC m=+75.958237595" watchObservedRunningTime="2026-07-08 15:52:25.62413386 +0000 UTC m=+75.959142272"
Jul 08 15:52:25.624921 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:25.624879    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nrlcp" podStartSLOduration=67.589984018 podStartE2EDuration="1m15.624866259s" totalImagesPullingTime="8.034882241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:25.605570381 +0000 UTC m=+75.940578793" watchObservedRunningTime="2026-07-08 15:52:25.624866259 +0000 UTC m=+75.959874672"
Jul 08 15:52:26.579644 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:26.579553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trww9" event={"ID":"6ea18122-ff82-4685-9fd0-0a8622439b62","Type":"ContainerStarted","Data":"3ea46501509423d66a879afee78ce543309e9c8e30abd39594aa4ccc9ad802ca"}
Jul 08 15:52:27.585078 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:27.585042    2582 generic.go:356] "Generic (PLEG): container finished" podID="404a01b5-78d3-493f-b2f7-b7e9ca8f139c" containerID="7bf87b75417471379d9b62bf59d332b717a931b15ba1b66c624d366a4891b46c" exitCode=0
Jul 08 15:52:27.585528 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:27.585105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smghm" event={"ID":"404a01b5-78d3-493f-b2f7-b7e9ca8f139c","Type":"ContainerDied","Data":"7bf87b75417471379d9b62bf59d332b717a931b15ba1b66c624d366a4891b46c"}
Jul 08 15:52:28.590891 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:28.590852    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smghm" event={"ID":"404a01b5-78d3-493f-b2f7-b7e9ca8f139c","Type":"ContainerStarted","Data":"5dd943522b2b20bca86b9fa3aa75cc2f1e9f2d72eb73b4d7301a2ed85c664c98"}
Jul 08 15:52:28.591317 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:28.590921    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smghm" event={"ID":"404a01b5-78d3-493f-b2f7-b7e9ca8f139c","Type":"ContainerStarted","Data":"1f3e39acc0c3de685ec15dd25877381adee28bddbab5d26adbe9e615821ff2a7"}
Jul 08 15:52:28.592713 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:28.592690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trww9" event={"ID":"6ea18122-ff82-4685-9fd0-0a8622439b62","Type":"ContainerStarted","Data":"8bbb3eb20e9c95e4babda165bdf29b0a982133cda092f65bb27b78e1f18b87e3"}
Jul 08 15:52:28.613537 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:28.613490    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-smghm" podStartSLOduration=3.504566836 podStartE2EDuration="4.613475694s" totalImagesPullingTime="1.034085287s" totalInitContainerRuntime="74.823571ms" isStatefulPod=true podCreationTimestamp="2026-07-08 15:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:28.612649807 +0000 UTC m=+78.947658217" watchObservedRunningTime="2026-07-08 15:52:28.613475694 +0000 UTC m=+78.948484143"
Jul 08 15:52:28.633192 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:28.633149    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-trww9" podStartSLOduration=33.833453562 podStartE2EDuration="43.633135358s" totalImagesPullingTime="9.799681796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:28.632249889 +0000 UTC m=+78.967258304" watchObservedRunningTime="2026-07-08 15:52:28.633135358 +0000 UTC m=+78.968143769"
Jul 08 15:52:29.332113 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.332077    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"]
Jul 08 15:52:29.334073 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.334050    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:29.336337 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.336313    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 15:52:29.336435 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.336334    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-l8vv2\""
Jul 08 15:52:29.343973 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.343953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"]
Jul 08 15:52:29.476330 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.476301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c09fdcdc-95af-430d-8071-adbf5edc1378-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z57rb\" (UID: \"c09fdcdc-95af-430d-8071-adbf5edc1378\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:29.476477 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.476345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzrk8\" (UniqueName: \"kubernetes.io/projected/c09fdcdc-95af-430d-8071-adbf5edc1378-kube-api-access-rzrk8\") pod \"monitoring-plugin-d5dcff7cf-z57rb\" (UID: \"c09fdcdc-95af-430d-8071-adbf5edc1378\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:29.576864 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.576835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzrk8\" (UniqueName: \"kubernetes.io/projected/c09fdcdc-95af-430d-8071-adbf5edc1378-kube-api-access-rzrk8\") pod \"monitoring-plugin-d5dcff7cf-z57rb\" (UID: \"c09fdcdc-95af-430d-8071-adbf5edc1378\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:29.576987 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.576885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c09fdcdc-95af-430d-8071-adbf5edc1378-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z57rb\" (UID: \"c09fdcdc-95af-430d-8071-adbf5edc1378\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:29.577092 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:52:29.577078    2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 15:52:29.577147 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:52:29.577138    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c09fdcdc-95af-430d-8071-adbf5edc1378-monitoring-plugin-cert podName:c09fdcdc-95af-430d-8071-adbf5edc1378 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:30.077118401 +0000 UTC m=+80.412126808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c09fdcdc-95af-430d-8071-adbf5edc1378-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-z57rb" (UID: "c09fdcdc-95af-430d-8071-adbf5edc1378") : secret "monitoring-plugin-cert" not found
Jul 08 15:52:29.586346 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.586289    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzrk8\" (UniqueName: \"kubernetes.io/projected/c09fdcdc-95af-430d-8071-adbf5edc1378-kube-api-access-rzrk8\") pod \"monitoring-plugin-d5dcff7cf-z57rb\" (UID: \"c09fdcdc-95af-430d-8071-adbf5edc1378\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:29.774477 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.774446    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5ddd858755-5ctvj"]
Jul 08 15:52:29.779609 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.779282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.781858 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.781832    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 08 15:52:29.781858 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.781849    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 08 15:52:29.782046 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.781860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 08 15:52:29.782046 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.781898    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nj5r6\""
Jul 08 15:52:29.782046 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.781900    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 08 15:52:29.784279 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.784266    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 08 15:52:29.788661 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.788639    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 08 15:52:29.792668 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.792649    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ddd858755-5ctvj"]
Jul 08 15:52:29.880177 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgzcb\" (UniqueName: \"kubernetes.io/projected/3533ec01-e272-40cb-942d-0dcb99e8acc7-kube-api-access-lgzcb\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.880177 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-telemeter-client-tls\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.880177 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.880177 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-metrics-client-ca\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.880411 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-serving-certs-ca-bundle\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.880411 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.880411 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-federate-client-tls\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.880411 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.880380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-secret-telemeter-client\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981589 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-federate-client-tls\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981730 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-secret-telemeter-client\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981730 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgzcb\" (UniqueName: \"kubernetes.io/projected/3533ec01-e272-40cb-942d-0dcb99e8acc7-kube-api-access-lgzcb\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981730 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-telemeter-client-tls\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981730 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981730 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-metrics-client-ca\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981950 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-serving-certs-ca-bundle\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.981950 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.981884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.982509 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.982481    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-metrics-client-ca\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.982650 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.982627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-serving-certs-ca-bundle\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.982800 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.982776    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3533ec01-e272-40cb-942d-0dcb99e8acc7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.984252 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.984221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-federate-client-tls\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.984339 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.984260    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.984435 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.984417    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-telemeter-client-tls\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.984485 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.984468    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3533ec01-e272-40cb-942d-0dcb99e8acc7-secret-telemeter-client\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:29.990498 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:29.990478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgzcb\" (UniqueName: \"kubernetes.io/projected/3533ec01-e272-40cb-942d-0dcb99e8acc7-kube-api-access-lgzcb\") pod \"telemeter-client-5ddd858755-5ctvj\" (UID: \"3533ec01-e272-40cb-942d-0dcb99e8acc7\") " pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:30.083131 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.083088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c09fdcdc-95af-430d-8071-adbf5edc1378-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z57rb\" (UID: \"c09fdcdc-95af-430d-8071-adbf5edc1378\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:30.085277 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.085253    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c09fdcdc-95af-430d-8071-adbf5edc1378-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z57rb\" (UID: \"c09fdcdc-95af-430d-8071-adbf5edc1378\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:30.089185 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.089166    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj"
Jul 08 15:52:30.221541 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.221509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ddd858755-5ctvj"]
Jul 08 15:52:30.225170 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:30.225142    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3533ec01_e272_40cb_942d_0dcb99e8acc7.slice/crio-7f84d6304fcf909efc0e7868bccc6a6b5c948dd17212301277df4949949a8537 WatchSource:0}: Error finding container 7f84d6304fcf909efc0e7868bccc6a6b5c948dd17212301277df4949949a8537: Status 404 returned error can't find the container with id 7f84d6304fcf909efc0e7868bccc6a6b5c948dd17212301277df4949949a8537
Jul 08 15:52:30.242343 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.242323    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:30.365697 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.365673    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"]
Jul 08 15:52:30.367960 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:30.367933    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09fdcdc_95af_430d_8071_adbf5edc1378.slice/crio-6a84edcf6729a25718820d95a38c77a2c6f54d2a4240dff55fb49d7b99c51f93 WatchSource:0}: Error finding container 6a84edcf6729a25718820d95a38c77a2c6f54d2a4240dff55fb49d7b99c51f93: Status 404 returned error can't find the container with id 6a84edcf6729a25718820d95a38c77a2c6f54d2a4240dff55fb49d7b99c51f93
Jul 08 15:52:30.601414 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.601376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb" event={"ID":"c09fdcdc-95af-430d-8071-adbf5edc1378","Type":"ContainerStarted","Data":"6a84edcf6729a25718820d95a38c77a2c6f54d2a4240dff55fb49d7b99c51f93"}
Jul 08 15:52:30.602361 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:30.602337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj" event={"ID":"3533ec01-e272-40cb-942d-0dcb99e8acc7","Type":"ContainerStarted","Data":"7f84d6304fcf909efc0e7868bccc6a6b5c948dd17212301277df4949949a8537"}
Jul 08 15:52:32.611767 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:32.611739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj" event={"ID":"3533ec01-e272-40cb-942d-0dcb99e8acc7","Type":"ContainerStarted","Data":"408be0519c22735f32076520f402ce5071a0597d698ff15e47f00c3679d45afd"}
Jul 08 15:52:32.613147 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:32.613123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb" event={"ID":"c09fdcdc-95af-430d-8071-adbf5edc1378","Type":"ContainerStarted","Data":"f57e5da7242ce80f93d0d139be414c7492c19b92d90a9007f055e5789ea4b182"}
Jul 08 15:52:32.613363 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:32.613332    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:32.617799 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:32.617778    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb"
Jul 08 15:52:32.631882 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:32.631842    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z57rb" podStartSLOduration=1.57377034 podStartE2EDuration="3.631829635s" totalImagesPullingTime="2.058059295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:32.631049367 +0000 UTC m=+82.966057900" watchObservedRunningTime="2026-07-08 15:52:32.631829635 +0000 UTC m=+82.966838045"
Jul 08 15:52:33.619116 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:33.619035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj" event={"ID":"3533ec01-e272-40cb-942d-0dcb99e8acc7","Type":"ContainerStarted","Data":"07e9f881a43fc0b7f3998326e1b8517f51ca4dbbc25a600463b9f62a2cc2b57d"}
Jul 08 15:52:33.619116 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:33.619088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj" event={"ID":"3533ec01-e272-40cb-942d-0dcb99e8acc7","Type":"ContainerStarted","Data":"3f2eec9a7cb418d3a6c2e25203ef0abc6d0c0b6ef9869d240615ae44adf32c5e"}
Jul 08 15:52:33.642430 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:33.642373    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5ddd858755-5ctvj" podStartSLOduration=1.61076665 podStartE2EDuration="4.642356632s" totalImagesPullingTime="3.031589982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:33.641742284 +0000 UTC m=+83.976750694" watchObservedRunningTime="2026-07-08 15:52:33.642356632 +0000 UTC m=+83.977365044"
Jul 08 15:52:34.624425 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.624394    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64b4db4d5b-t7g64"]
Jul 08 15:52:34.626322 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.626306    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.628713 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.628691    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 15:52:34.628858 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.628787    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 15:52:34.628931 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.628874    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 15:52:34.629633 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.629609    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 15:52:34.629753 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.629643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 15:52:34.629753 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.629653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfj5m\""
Jul 08 15:52:34.629753 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.629657    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 15:52:34.629753 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.629702    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 15:52:34.637480 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.637458    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 15:52:34.642890 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.642866    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b4db4d5b-t7g64"]
Jul 08 15:52:34.717110 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.717080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-config\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.717110 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.717108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-service-ca\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.717318 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.717147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-trusted-ca-bundle\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.717318 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.717189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-oauth-config\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.717429 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.717359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-serving-cert\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.717535 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.717512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkl65\" (UniqueName: \"kubernetes.io/projected/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-kube-api-access-tkl65\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.717634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.717616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-oauth-serving-cert\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818023 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.817991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkl65\" (UniqueName: \"kubernetes.io/projected/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-kube-api-access-tkl65\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818163 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-oauth-serving-cert\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818163 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-config\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818163 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-service-ca\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818163 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-trusted-ca-bundle\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818163 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-oauth-config\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818163 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-serving-cert\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818872 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818846    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-service-ca\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818999 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818858    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-config\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818999 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818885    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-oauth-serving-cert\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.818999 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.818984    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-trusted-ca-bundle\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.820655 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.820637    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-serving-cert\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.820747 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.820677    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-oauth-config\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.829254 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.829230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkl65\" (UniqueName: \"kubernetes.io/projected/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-kube-api-access-tkl65\") pod \"console-64b4db4d5b-t7g64\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") " pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:34.939149 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:34.939085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:35.061797 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:35.061762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b4db4d5b-t7g64"]
Jul 08 15:52:35.064478 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:52:35.064446    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b6bd83_0f4d_4d77_9c03_ea25b3fbd1e2.slice/crio-996de0cc686c45f419c3f31aca3829e59ee83ca96f8c0e9dd00e7c4f6d15398e WatchSource:0}: Error finding container 996de0cc686c45f419c3f31aca3829e59ee83ca96f8c0e9dd00e7c4f6d15398e: Status 404 returned error can't find the container with id 996de0cc686c45f419c3f31aca3829e59ee83ca96f8c0e9dd00e7c4f6d15398e
Jul 08 15:52:35.627143 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:35.627108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b4db4d5b-t7g64" event={"ID":"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2","Type":"ContainerStarted","Data":"996de0cc686c45f419c3f31aca3829e59ee83ca96f8c0e9dd00e7c4f6d15398e"}
Jul 08 15:52:38.640415 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:38.640383    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b4db4d5b-t7g64" event={"ID":"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2","Type":"ContainerStarted","Data":"4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41"}
Jul 08 15:52:38.661724 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:38.661677    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64b4db4d5b-t7g64" podStartSLOduration=1.708036616 podStartE2EDuration="4.661661063s" totalImagesPullingTime="2.953624447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:38.6605745 +0000 UTC m=+88.995582916" watchObservedRunningTime="2026-07-08 15:52:38.661661063 +0000 UTC m=+88.996669473"
Jul 08 15:52:44.939345 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:44.939309    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:44.939738 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:44.939393    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:44.944320 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:44.944298    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:45.668841 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:45.668807    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:52:56.582649 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:52:56.582616    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nrlcp"
Jul 08 15:54:11.170686 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:11.170601    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b4db4d5b-t7g64"]
Jul 08 15:54:36.190073 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.190008    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64b4db4d5b-t7g64" podUID="81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" containerName="console" containerID="cri-o://4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41" gracePeriod=15
Jul 08 15:54:36.426888 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.426860    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:54:36.466014 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.465954    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-trusted-ca-bundle\") pod \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") "
Jul 08 15:54:36.466014 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.465999    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-service-ca\") pod \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") "
Jul 08 15:54:36.466166 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466028    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkl65\" (UniqueName: \"kubernetes.io/projected/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-kube-api-access-tkl65\") pod \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") "
Jul 08 15:54:36.466166 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466064    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-serving-cert\") pod \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") "
Jul 08 15:54:36.466166 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466101    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-oauth-config\") pod \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") "
Jul 08 15:54:36.466166 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466132    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-oauth-serving-cert\") pod \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") "
Jul 08 15:54:36.466166 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466156    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-config\") pod \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\" (UID: \"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2\") "
Jul 08 15:54:36.466509 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466480    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" (UID: "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:54:36.466645 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466626    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-config" (OuterVolumeSpecName: "console-config") pod "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" (UID: "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:54:36.466701 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466649    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" (UID: "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:54:36.466701 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.466651    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" (UID: "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:54:36.468414 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.468382    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" (UID: "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:54:36.468414 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.468400    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" (UID: "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:54:36.468570 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.468386    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-kube-api-access-tkl65" (OuterVolumeSpecName: "kube-api-access-tkl65") pod "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" (UID: "81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2"). InnerVolumeSpecName "kube-api-access-tkl65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:54:36.567310 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.567287    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-service-ca\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:54:36.567310 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.567308    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkl65\" (UniqueName: \"kubernetes.io/projected/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-kube-api-access-tkl65\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:54:36.567439 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.567317    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-serving-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:54:36.567439 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.567326    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-oauth-config\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:54:36.567439 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.567334    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-oauth-serving-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:54:36.567439 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.567341    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-console-config\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:54:36.567439 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:36.567351    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2-trusted-ca-bundle\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:54:37.033927 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.033895    2582 generic.go:356] "Generic (PLEG): container finished" podID="81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" containerID="4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41" exitCode=0
Jul 08 15:54:37.034091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.033936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b4db4d5b-t7g64" event={"ID":"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2","Type":"ContainerDied","Data":"4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41"}
Jul 08 15:54:37.034091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.033942    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b4db4d5b-t7g64"
Jul 08 15:54:37.034091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.033974    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b4db4d5b-t7g64" event={"ID":"81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2","Type":"ContainerDied","Data":"996de0cc686c45f419c3f31aca3829e59ee83ca96f8c0e9dd00e7c4f6d15398e"}
Jul 08 15:54:37.034091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.033993    2582 scope.go:117] "RemoveContainer" containerID="4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41"
Jul 08 15:54:37.043018 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.042995    2582 scope.go:117] "RemoveContainer" containerID="4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41"
Jul 08 15:54:37.043238 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:54:37.043218    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41\": container with ID starting with 4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41 not found: ID does not exist" containerID="4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41"
Jul 08 15:54:37.043284 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.043245    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41"} err="failed to get container status \"4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41\": rpc error: code = NotFound desc = could not find container \"4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41\": container with ID starting with 4012e3e77d2d946971f6a51135fe4dace36aaf3b3e7fd754b0b92381d278fd41 not found: ID does not exist"
Jul 08 15:54:37.053885 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.053866    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b4db4d5b-t7g64"]
Jul 08 15:54:37.057798 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:37.057778    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64b4db4d5b-t7g64"]
Jul 08 15:54:38.266417 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:54:38.266385    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" path="/var/lib/kubelet/pods/81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2/volumes"
Jul 08 15:55:50.049045 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.048967    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5fstk"]
Jul 08 15:55:50.049505 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.049190    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" containerName="console"
Jul 08 15:55:50.049505 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.049201    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" containerName="console"
Jul 08 15:55:50.049505 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.049246    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="81b6bd83-0f4d-4d77-9c03-ea25b3fbd1e2" containerName="console"
Jul 08 15:55:50.051763 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.051747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.053983 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.053962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 15:55:50.054095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.054053    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 15:55:50.054992 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.054976    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ljb24\""
Jul 08 15:55:50.060769 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.060748    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5fstk"]
Jul 08 15:55:50.154848 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.154822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03d23c6-fb53-4e93-a564-521cf47eec29-bound-sa-token\") pod \"cert-manager-55b4d954d5-5fstk\" (UID: \"f03d23c6-fb53-4e93-a564-521cf47eec29\") " pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.154996 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.154853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkzh\" (UniqueName: \"kubernetes.io/projected/f03d23c6-fb53-4e93-a564-521cf47eec29-kube-api-access-sxkzh\") pod \"cert-manager-55b4d954d5-5fstk\" (UID: \"f03d23c6-fb53-4e93-a564-521cf47eec29\") " pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.255370 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.255342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03d23c6-fb53-4e93-a564-521cf47eec29-bound-sa-token\") pod \"cert-manager-55b4d954d5-5fstk\" (UID: \"f03d23c6-fb53-4e93-a564-521cf47eec29\") " pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.255490 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.255379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkzh\" (UniqueName: \"kubernetes.io/projected/f03d23c6-fb53-4e93-a564-521cf47eec29-kube-api-access-sxkzh\") pod \"cert-manager-55b4d954d5-5fstk\" (UID: \"f03d23c6-fb53-4e93-a564-521cf47eec29\") " pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.264109 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.264085    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03d23c6-fb53-4e93-a564-521cf47eec29-bound-sa-token\") pod \"cert-manager-55b4d954d5-5fstk\" (UID: \"f03d23c6-fb53-4e93-a564-521cf47eec29\") " pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.264307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.264289    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkzh\" (UniqueName: \"kubernetes.io/projected/f03d23c6-fb53-4e93-a564-521cf47eec29-kube-api-access-sxkzh\") pod \"cert-manager-55b4d954d5-5fstk\" (UID: \"f03d23c6-fb53-4e93-a564-521cf47eec29\") " pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.360437 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.360405    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5fstk"
Jul 08 15:55:50.479557 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.479522    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5fstk"]
Jul 08 15:55:50.482362 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:55:50.482328    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf03d23c6_fb53_4e93_a564_521cf47eec29.slice/crio-1471f583e10787189e6bccd92a17a777d2cce752a85f88008c590fe468c80b91 WatchSource:0}: Error finding container 1471f583e10787189e6bccd92a17a777d2cce752a85f88008c590fe468c80b91: Status 404 returned error can't find the container with id 1471f583e10787189e6bccd92a17a777d2cce752a85f88008c590fe468c80b91
Jul 08 15:55:50.987689 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.987660    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"]
Jul 08 15:55:50.991574 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.991556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:50.994326 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.994302    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 15:55:50.994625 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.994605    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 15:55:50.995276 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:50.995261    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2ct9g\""
Jul 08 15:55:51.001128 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.001108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"]
Jul 08 15:55:51.162499 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.162463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blsgl\" (UniqueName: \"kubernetes.io/projected/b93c6f84-fed0-4a92-940f-18ad3432c3ab-kube-api-access-blsgl\") pod \"openshift-lws-operator-fd8ccff4c-l4zkr\" (UID: \"b93c6f84-fed0-4a92-940f-18ad3432c3ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:51.162499 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.162499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b93c6f84-fed0-4a92-940f-18ad3432c3ab-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l4zkr\" (UID: \"b93c6f84-fed0-4a92-940f-18ad3432c3ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:51.262843 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.262793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blsgl\" (UniqueName: \"kubernetes.io/projected/b93c6f84-fed0-4a92-940f-18ad3432c3ab-kube-api-access-blsgl\") pod \"openshift-lws-operator-fd8ccff4c-l4zkr\" (UID: \"b93c6f84-fed0-4a92-940f-18ad3432c3ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:51.262843 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.262821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b93c6f84-fed0-4a92-940f-18ad3432c3ab-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l4zkr\" (UID: \"b93c6f84-fed0-4a92-940f-18ad3432c3ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:51.263125 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.263108    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b93c6f84-fed0-4a92-940f-18ad3432c3ab-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l4zkr\" (UID: \"b93c6f84-fed0-4a92-940f-18ad3432c3ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:51.272086 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.272061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blsgl\" (UniqueName: \"kubernetes.io/projected/b93c6f84-fed0-4a92-940f-18ad3432c3ab-kube-api-access-blsgl\") pod \"openshift-lws-operator-fd8ccff4c-l4zkr\" (UID: \"b93c6f84-fed0-4a92-940f-18ad3432c3ab\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:51.274094 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.274060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5fstk" event={"ID":"f03d23c6-fb53-4e93-a564-521cf47eec29","Type":"ContainerStarted","Data":"1471f583e10787189e6bccd92a17a777d2cce752a85f88008c590fe468c80b91"}
Jul 08 15:55:51.300404 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.300374    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"
Jul 08 15:55:51.420060 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:51.419806    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr"]
Jul 08 15:55:51.422435 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:55:51.422395    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb93c6f84_fed0_4a92_940f_18ad3432c3ab.slice/crio-09a9240d5edf4636a9a0dab5c44a4e41141659f2019b956e3dfdb7e86a8369dd WatchSource:0}: Error finding container 09a9240d5edf4636a9a0dab5c44a4e41141659f2019b956e3dfdb7e86a8369dd: Status 404 returned error can't find the container with id 09a9240d5edf4636a9a0dab5c44a4e41141659f2019b956e3dfdb7e86a8369dd
Jul 08 15:55:52.277568 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:55:52.277537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr" event={"ID":"b93c6f84-fed0-4a92-940f-18ad3432c3ab","Type":"ContainerStarted","Data":"09a9240d5edf4636a9a0dab5c44a4e41141659f2019b956e3dfdb7e86a8369dd"}
Jul 08 15:56:00.308569 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:00.308535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5fstk" event={"ID":"f03d23c6-fb53-4e93-a564-521cf47eec29","Type":"ContainerStarted","Data":"170c049e8ad9d297f209d1275df33fc0b0dd2ab22cf2cb3f51a2a70ddb877287"}
Jul 08 15:56:00.327116 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:00.327066    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5fstk" podStartSLOduration=0.919433726 podStartE2EDuration="10.327047675s" totalImagesPullingTime="9.407613949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:00.32627882 +0000 UTC m=+290.661287230" watchObservedRunningTime="2026-07-08 15:56:00.327047675 +0000 UTC m=+290.662056093"
Jul 08 15:56:01.314310 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:01.314266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr" event={"ID":"b93c6f84-fed0-4a92-940f-18ad3432c3ab","Type":"ContainerStarted","Data":"a00fcc7741b02dbe43c2ace03cbace56498b2a1f78ddc6fd85d9aa3d8d464a77"}
Jul 08 15:56:01.332221 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:01.332176    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l4zkr" podStartSLOduration=1.578186553 podStartE2EDuration="11.332160752s" totalImagesPullingTime="9.753974199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:01.330360499 +0000 UTC m=+291.665368910" watchObservedRunningTime="2026-07-08 15:56:01.332160752 +0000 UTC m=+291.667169163"
Jul 08 15:56:10.046399 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:10.046372    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 15:56:20.028534 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.028499    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"]
Jul 08 15:56:20.033688 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.033670    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.036873 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.036843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 15:56:20.037076 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.037058    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 15:56:20.037707 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.037682    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 15:56:20.037833 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.037718    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g2rr9\""
Jul 08 15:56:20.037988 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.037963    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 15:56:20.050259 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.050239    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"]
Jul 08 15:56:20.157619 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.157569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-tmp\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.157764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.157623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.157764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.157704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-manifests\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.157764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.157742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm976\" (UniqueName: \"kubernetes.io/projected/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-kube-api-access-sm976\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.157883 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.157769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-webhook-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.258696 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.258664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-manifests\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.258837 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.258704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm976\" (UniqueName: \"kubernetes.io/projected/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-kube-api-access-sm976\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.258837 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.258738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-webhook-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.258837 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.258790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-tmp\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.258957 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.258917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.259122 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.259103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-manifests\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.260953 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.260931    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-tmp\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.261192 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.261174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-webhook-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.261270 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.261198    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.269343 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.269321    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm976\" (UniqueName: \"kubernetes.io/projected/e9a50bda-ad66-4746-b48e-2cc5fa2d4dda-kube-api-access-sm976\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-4rj78\" (UID: \"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.344140 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.344115    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:20.470530 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.470507    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"]
Jul 08 15:56:20.473130 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:20.473104    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a50bda_ad66_4746_b48e_2cc5fa2d4dda.slice/crio-86e4833ec418a6dabddc22ff5b4e43464abeeb1da1a9338b8689055f6bf9407f WatchSource:0}: Error finding container 86e4833ec418a6dabddc22ff5b4e43464abeeb1da1a9338b8689055f6bf9407f: Status 404 returned error can't find the container with id 86e4833ec418a6dabddc22ff5b4e43464abeeb1da1a9338b8689055f6bf9407f
Jul 08 15:56:20.475072 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:20.475054    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 15:56:21.382116 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:21.382081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78" event={"ID":"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda","Type":"ContainerStarted","Data":"86e4833ec418a6dabddc22ff5b4e43464abeeb1da1a9338b8689055f6bf9407f"}
Jul 08 15:56:24.395223 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:24.395183    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78" event={"ID":"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda","Type":"ContainerStarted","Data":"445252324a06230b8648992144ed3263b99934c3a40ed37ea14df84aeb815308"}
Jul 08 15:56:25.399835 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:25.399793    2582 generic.go:356] "Generic (PLEG): container finished" podID="e9a50bda-ad66-4746-b48e-2cc5fa2d4dda" containerID="445252324a06230b8648992144ed3263b99934c3a40ed37ea14df84aeb815308" exitCode=0
Jul 08 15:56:25.400210 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:25.399846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78" event={"ID":"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda","Type":"ContainerDied","Data":"445252324a06230b8648992144ed3263b99934c3a40ed37ea14df84aeb815308"}
Jul 08 15:56:26.405230 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:26.405146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78" event={"ID":"e9a50bda-ad66-4746-b48e-2cc5fa2d4dda","Type":"ContainerStarted","Data":"ad954980e35f289ae487495079b3a55b68e9d683ffb9e1186422fccc404db874"}
Jul 08 15:56:26.405565 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:26.405251    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:26.428232 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:26.428181    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78" podStartSLOduration=1.662127136 podStartE2EDuration="6.428163898s" totalImagesPullingTime="3.674269483s" totalInitContainerRuntime="1.091767279s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:26.426355411 +0000 UTC m=+316.761363805" watchObservedRunningTime="2026-07-08 15:56:26.428163898 +0000 UTC m=+316.763172310"
Jul 08 15:56:37.411034 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:37.411004    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-4rj78"
Jul 08 15:56:40.159503 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.159464    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-777c755669-dh5nk"]
Jul 08 15:56:40.162556 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.162532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.165398 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.165379    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 15:56:40.165646 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.165631    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 15:56:40.166335 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.166319    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v5sbg\""
Jul 08 15:56:40.168469 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.168452    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 15:56:40.168962 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.168712    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 15:56:40.188868 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.188831    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-777c755669-dh5nk"]
Jul 08 15:56:40.201879 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.201849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tghxm\" (UniqueName: \"kubernetes.io/projected/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-kube-api-access-tghxm\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.201982 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.201883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-tls-certs\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.201982 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.201917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-tmp\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.302759 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.302721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tghxm\" (UniqueName: \"kubernetes.io/projected/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-kube-api-access-tghxm\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.302759 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.302756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-tls-certs\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.302995 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.302785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-tmp\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.302995 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.302942    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j2m56"]
Jul 08 15:56:40.304933 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.304910    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-tmp\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.305204 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.305185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-tls-certs\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.306100 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.306086    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:40.309300 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.309272    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rvgl8\""
Jul 08 15:56:40.309413 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.309299    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 15:56:40.324300 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.324276    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j2m56"]
Jul 08 15:56:40.330029 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.330000    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tghxm\" (UniqueName: \"kubernetes.io/projected/2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd-kube-api-access-tghxm\") pod \"kube-auth-proxy-777c755669-dh5nk\" (UID: \"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd\") " pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.404162 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.404131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/949b136a-314b-4d4b-98f5-8499a235a8ba-cert\") pod \"odh-model-controller-7998c67dc4-j2m56\" (UID: \"949b136a-314b-4d4b-98f5-8499a235a8ba\") " pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:40.404291 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.404169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mj7\" (UniqueName: \"kubernetes.io/projected/949b136a-314b-4d4b-98f5-8499a235a8ba-kube-api-access-q4mj7\") pod \"odh-model-controller-7998c67dc4-j2m56\" (UID: \"949b136a-314b-4d4b-98f5-8499a235a8ba\") " pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:40.471378 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.471310    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk"
Jul 08 15:56:40.504771 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.504739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/949b136a-314b-4d4b-98f5-8499a235a8ba-cert\") pod \"odh-model-controller-7998c67dc4-j2m56\" (UID: \"949b136a-314b-4d4b-98f5-8499a235a8ba\") " pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:40.504945 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.504786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mj7\" (UniqueName: \"kubernetes.io/projected/949b136a-314b-4d4b-98f5-8499a235a8ba-kube-api-access-q4mj7\") pod \"odh-model-controller-7998c67dc4-j2m56\" (UID: \"949b136a-314b-4d4b-98f5-8499a235a8ba\") " pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:40.504945 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:40.504903    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 15:56:40.505072 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:40.504976    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/949b136a-314b-4d4b-98f5-8499a235a8ba-cert podName:949b136a-314b-4d4b-98f5-8499a235a8ba nodeName:}" failed. No retries permitted until 2026-07-08 15:56:41.004959698 +0000 UTC m=+331.339968086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/949b136a-314b-4d4b-98f5-8499a235a8ba-cert") pod "odh-model-controller-7998c67dc4-j2m56" (UID: "949b136a-314b-4d4b-98f5-8499a235a8ba") : secret "odh-model-controller-webhook-cert" not found
Jul 08 15:56:40.536007 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.535976    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mj7\" (UniqueName: \"kubernetes.io/projected/949b136a-314b-4d4b-98f5-8499a235a8ba-kube-api-access-q4mj7\") pod \"odh-model-controller-7998c67dc4-j2m56\" (UID: \"949b136a-314b-4d4b-98f5-8499a235a8ba\") " pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:40.629016 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:40.628983    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-777c755669-dh5nk"]
Jul 08 15:56:40.632668 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:40.632639    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d27e5f0_98d8_44d8_a0fc_ed7d60584bbd.slice/crio-3e3625922d265a4811d645170d3aa085414812f0159bf80b3c9f9d94911707eb WatchSource:0}: Error finding container 3e3625922d265a4811d645170d3aa085414812f0159bf80b3c9f9d94911707eb: Status 404 returned error can't find the container with id 3e3625922d265a4811d645170d3aa085414812f0159bf80b3c9f9d94911707eb
Jul 08 15:56:41.009883 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.009848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/949b136a-314b-4d4b-98f5-8499a235a8ba-cert\") pod \"odh-model-controller-7998c67dc4-j2m56\" (UID: \"949b136a-314b-4d4b-98f5-8499a235a8ba\") " pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:41.012174 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.012150    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/949b136a-314b-4d4b-98f5-8499a235a8ba-cert\") pod \"odh-model-controller-7998c67dc4-j2m56\" (UID: \"949b136a-314b-4d4b-98f5-8499a235a8ba\") " pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:41.225482 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.225447    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:41.350990 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.350965    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j2m56"]
Jul 08 15:56:41.353128 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:41.353102    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949b136a_314b_4d4b_98f5_8499a235a8ba.slice/crio-96b3be300f4d1e80862751bbd413d38bf0df9222fd4b67dc693f70ce99e4b3a9 WatchSource:0}: Error finding container 96b3be300f4d1e80862751bbd413d38bf0df9222fd4b67dc693f70ce99e4b3a9: Status 404 returned error can't find the container with id 96b3be300f4d1e80862751bbd413d38bf0df9222fd4b67dc693f70ce99e4b3a9
Jul 08 15:56:41.461807 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.461775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j2m56" event={"ID":"949b136a-314b-4d4b-98f5-8499a235a8ba","Type":"ContainerStarted","Data":"96b3be300f4d1e80862751bbd413d38bf0df9222fd4b67dc693f70ce99e4b3a9"}
Jul 08 15:56:41.462806 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.462776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk" event={"ID":"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd","Type":"ContainerStarted","Data":"3e3625922d265a4811d645170d3aa085414812f0159bf80b3c9f9d94911707eb"}
Jul 08 15:56:41.626160 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.626125    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fsk44"]
Jul 08 15:56:41.630236 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.630214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:41.633750 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.633730    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-c67l2\""
Jul 08 15:56:41.633838 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.633767    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 15:56:41.642764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.642742    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fsk44"]
Jul 08 15:56:41.714927 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.714898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhkfh\" (UniqueName: \"kubernetes.io/projected/818ecf57-d215-4e7d-98b2-55e8011c50a0-kube-api-access-hhkfh\") pod \"model-serving-api-54d89bd5fc-fsk44\" (UID: \"818ecf57-d215-4e7d-98b2-55e8011c50a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:41.715059 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.714940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818ecf57-d215-4e7d-98b2-55e8011c50a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-fsk44\" (UID: \"818ecf57-d215-4e7d-98b2-55e8011c50a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:41.815896 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.815857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhkfh\" (UniqueName: \"kubernetes.io/projected/818ecf57-d215-4e7d-98b2-55e8011c50a0-kube-api-access-hhkfh\") pod \"model-serving-api-54d89bd5fc-fsk44\" (UID: \"818ecf57-d215-4e7d-98b2-55e8011c50a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:41.816039 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.815911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818ecf57-d215-4e7d-98b2-55e8011c50a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-fsk44\" (UID: \"818ecf57-d215-4e7d-98b2-55e8011c50a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:41.816119 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:41.816069    2582 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 08 15:56:41.816177 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:41.816144    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/818ecf57-d215-4e7d-98b2-55e8011c50a0-tls-certs podName:818ecf57-d215-4e7d-98b2-55e8011c50a0 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:42.316122753 +0000 UTC m=+332.651131142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/818ecf57-d215-4e7d-98b2-55e8011c50a0-tls-certs") pod "model-serving-api-54d89bd5fc-fsk44" (UID: "818ecf57-d215-4e7d-98b2-55e8011c50a0") : secret "model-serving-api-tls" not found
Jul 08 15:56:41.827240 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.827219    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhkfh\" (UniqueName: \"kubernetes.io/projected/818ecf57-d215-4e7d-98b2-55e8011c50a0-kube-api-access-hhkfh\") pod \"model-serving-api-54d89bd5fc-fsk44\" (UID: \"818ecf57-d215-4e7d-98b2-55e8011c50a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:41.923048 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.922966    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"]
Jul 08 15:56:41.926432 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.926412    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:41.930503 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.930468    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 15:56:41.930640 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.930476    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 15:56:41.930895 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.930865    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rrhkt\""
Jul 08 15:56:41.931388 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.931367    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 15:56:41.931475 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.931369    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 15:56:41.971460 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:41.971438    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"]
Jul 08 15:56:42.017390 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.017357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e35d0f-75af-4003-98e2-613ad6974b8e-local-certs\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.017509 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.017413    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.017509 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.017445    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-token\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.017509 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.017473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-cacerts\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.017509 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.017497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.017669 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.017560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.017669 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.017599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqqnt\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-kube-api-access-pqqnt\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.118722 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.118684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e35d0f-75af-4003-98e2-613ad6974b8e-local-certs\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.118860 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.118735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.118860 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.118759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-token\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.118860 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.118779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-cacerts\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.118860 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.118795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.119082 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.118869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.119082 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.119052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqqnt\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-kube-api-access-pqqnt\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.119688 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.119627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.121297 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.121273    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e35d0f-75af-4003-98e2-613ad6974b8e-local-certs\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.121633 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.121608    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-cacerts\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.121725 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.121703    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.121795 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.121699    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.128118 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.128093    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-token\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.128504 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.128486    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqqnt\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-kube-api-access-pqqnt\") pod \"istiod-openshift-gateway-7574459656-6xz9k\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.237909 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.237833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:42.320714 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.320674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818ecf57-d215-4e7d-98b2-55e8011c50a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-fsk44\" (UID: \"818ecf57-d215-4e7d-98b2-55e8011c50a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:42.324283 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.324254    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818ecf57-d215-4e7d-98b2-55e8011c50a0-tls-certs\") pod \"model-serving-api-54d89bd5fc-fsk44\" (UID: \"818ecf57-d215-4e7d-98b2-55e8011c50a0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:42.393216 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.393180    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"]
Jul 08 15:56:42.398739 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:42.398708    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e35d0f_75af_4003_98e2_613ad6974b8e.slice/crio-358e5f74139abfab299e9b49e32aa17fc41fa5bc23b6a09b6f87cdae4b6ae2b9 WatchSource:0}: Error finding container 358e5f74139abfab299e9b49e32aa17fc41fa5bc23b6a09b6f87cdae4b6ae2b9: Status 404 returned error can't find the container with id 358e5f74139abfab299e9b49e32aa17fc41fa5bc23b6a09b6f87cdae4b6ae2b9
Jul 08 15:56:42.470300 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.470251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k" event={"ID":"e0e35d0f-75af-4003-98e2-613ad6974b8e","Type":"ContainerStarted","Data":"358e5f74139abfab299e9b49e32aa17fc41fa5bc23b6a09b6f87cdae4b6ae2b9"}
Jul 08 15:56:42.541029 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.540936    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:42.704826 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:42.704794    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fsk44"]
Jul 08 15:56:42.708683 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:42.708656    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818ecf57_d215_4e7d_98b2_55e8011c50a0.slice/crio-b17c927bbff0fd30be408a81269ff0eba9daebb952431f87aae892b1bcf6acb5 WatchSource:0}: Error finding container b17c927bbff0fd30be408a81269ff0eba9daebb952431f87aae892b1bcf6acb5: Status 404 returned error can't find the container with id b17c927bbff0fd30be408a81269ff0eba9daebb952431f87aae892b1bcf6acb5
Jul 08 15:56:43.476243 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:43.476205    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fsk44" event={"ID":"818ecf57-d215-4e7d-98b2-55e8011c50a0","Type":"ContainerStarted","Data":"b17c927bbff0fd30be408a81269ff0eba9daebb952431f87aae892b1bcf6acb5"}
Jul 08 15:56:46.542236 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:46.542203    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:56:46.542630 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:46.542279    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:56:47.495822 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.495790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk" event={"ID":"2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd","Type":"ContainerStarted","Data":"4ea8a806688aab83813378e562370760c749f4664714ddf94c3754cb60211461"}
Jul 08 15:56:47.497438 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.497407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fsk44" event={"ID":"818ecf57-d215-4e7d-98b2-55e8011c50a0","Type":"ContainerStarted","Data":"56aee551d721b35ea334ab497d26a9c49ba08109bb897a930125fdcec360b5e2"}
Jul 08 15:56:47.497608 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.497496    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:47.498946 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.498924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k" event={"ID":"e0e35d0f-75af-4003-98e2-613ad6974b8e","Type":"ContainerStarted","Data":"a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2"}
Jul 08 15:56:47.499092 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.499079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:47.500283 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.500257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j2m56" event={"ID":"949b136a-314b-4d4b-98f5-8499a235a8ba","Type":"ContainerStarted","Data":"a58754fbfd7c16fe4bc0cbcc5ece304e41343e45dd7d59e58eb9cbb8a53abc70"}
Jul 08 15:56:47.500429 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.500408    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:56:47.500844 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.500824    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-6xz9k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 15:56:47.500926 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.500869    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k" podUID="e0e35d0f-75af-4003-98e2-613ad6974b8e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 15:56:47.519176 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.519136    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-777c755669-dh5nk" podStartSLOduration=1.6162980550000001 podStartE2EDuration="7.5191243s" totalImagesPullingTime="5.902826245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:47.517624385 +0000 UTC m=+337.852632799" watchObservedRunningTime="2026-07-08 15:56:47.5191243 +0000 UTC m=+337.854132707"
Jul 08 15:56:47.544383 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.544340    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k" podStartSLOduration=2.4036475729999998 podStartE2EDuration="6.544327181s" totalImagesPullingTime="4.140679608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:47.543225589 +0000 UTC m=+337.878234001" watchObservedRunningTime="2026-07-08 15:56:47.544327181 +0000 UTC m=+337.879335592"
Jul 08 15:56:47.565454 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.565411    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fsk44" podStartSLOduration=2.693328839 podStartE2EDuration="6.565398494s" totalImagesPullingTime="3.872069655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:47.564916929 +0000 UTC m=+337.899925341" watchObservedRunningTime="2026-07-08 15:56:47.565398494 +0000 UTC m=+337.900406950"
Jul 08 15:56:47.586291 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:47.586245    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-j2m56" podStartSLOduration=2.409300645 podStartE2EDuration="7.586235252s" totalImagesPullingTime="5.176934607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:47.585623174 +0000 UTC m=+337.920631585" watchObservedRunningTime="2026-07-08 15:56:47.586235252 +0000 UTC m=+337.921243663"
Jul 08 15:56:48.404436 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.404396    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"]
Jul 08 15:56:48.407787 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.407763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.413016 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.412992    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jtg7l\""
Jul 08 15:56:48.439527 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.439501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"]
Jul 08 15:56:48.476077 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476190 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476190 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476190 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476399 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476218    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476399 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476241    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476399 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476530 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7mf\" (UniqueName: \"kubernetes.io/projected/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-kube-api-access-2h7mf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.476530 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.476436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.505027 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.505008    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:48.577104 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577501 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577501 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577501 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577501 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577501 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7mf\" (UniqueName: \"kubernetes.io/projected/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-kube-api-access-2h7mf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.577764 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.577704    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.578093 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.578022    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.578152 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.578100    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.578735 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.578710    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.578834 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.578734    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.580117 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.580089    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.580879 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.580855    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.593468 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.593448    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.593745 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.593727    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7mf\" (UniqueName: \"kubernetes.io/projected/5db36d26-c9ed-43fb-9ac9-1c88a0a9876e-kube-api-access-2h7mf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgd5s\" (UID: \"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.718263 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.718192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:48.893745 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:48.893722    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"]
Jul 08 15:56:48.894718 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:48.894690    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db36d26_c9ed_43fb_9ac9_1c88a0a9876e.slice/crio-d6a76f729017086f1fbfec940c37c073d90aa6888e1abb39354e674efd5c493a WatchSource:0}: Error finding container d6a76f729017086f1fbfec940c37c073d90aa6888e1abb39354e674efd5c493a: Status 404 returned error can't find the container with id d6a76f729017086f1fbfec940c37c073d90aa6888e1abb39354e674efd5c493a
Jul 08 15:56:49.510739 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:49.510706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s" event={"ID":"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e","Type":"ContainerStarted","Data":"d6a76f729017086f1fbfec940c37c073d90aa6888e1abb39354e674efd5c493a"}
Jul 08 15:56:51.697225 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.697189    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"]
Jul 08 15:56:51.705933 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.705911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:51.709101 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.708865    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 15:56:51.709194 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.709102    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bztqw\""
Jul 08 15:56:51.715686 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.710075    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"]
Jul 08 15:56:51.715686 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.715178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:51.719029 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.718656    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gb754\""
Jul 08 15:56:51.719029 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.718856    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 15:56:51.725389 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.724814    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"]
Jul 08 15:56:51.731924 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.731896    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"]
Jul 08 15:56:51.807956 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.807921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-cert\") pod \"kserve-controller-manager-d6f4b65b8-8trgd\" (UID: \"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:51.808122 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.807963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89898794-9b11-43d5-881b-9c649ee731d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9ffrh\" (UID: \"89898794-9b11-43d5-881b-9c649ee731d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:51.808122 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.808052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5fw9\" (UniqueName: \"kubernetes.io/projected/89898794-9b11-43d5-881b-9c649ee731d9-kube-api-access-q5fw9\") pod \"llmisvc-controller-manager-777c6bd7d5-9ffrh\" (UID: \"89898794-9b11-43d5-881b-9c649ee731d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:51.808305 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.808145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-kube-api-access-8vq7n\") pod \"kserve-controller-manager-d6f4b65b8-8trgd\" (UID: \"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:51.908742 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.908711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-cert\") pod \"kserve-controller-manager-d6f4b65b8-8trgd\" (UID: \"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:51.908742 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.908744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89898794-9b11-43d5-881b-9c649ee731d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9ffrh\" (UID: \"89898794-9b11-43d5-881b-9c649ee731d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:51.908933 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.908775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5fw9\" (UniqueName: \"kubernetes.io/projected/89898794-9b11-43d5-881b-9c649ee731d9-kube-api-access-q5fw9\") pod \"llmisvc-controller-manager-777c6bd7d5-9ffrh\" (UID: \"89898794-9b11-43d5-881b-9c649ee731d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:51.908933 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.908860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-kube-api-access-8vq7n\") pod \"kserve-controller-manager-d6f4b65b8-8trgd\" (UID: \"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:51.908933 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:51.908888    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 15:56:51.909093 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:51.908971    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89898794-9b11-43d5-881b-9c649ee731d9-cert podName:89898794-9b11-43d5-881b-9c649ee731d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:52.408949154 +0000 UTC m=+342.743957557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89898794-9b11-43d5-881b-9c649ee731d9-cert") pod "llmisvc-controller-manager-777c6bd7d5-9ffrh" (UID: "89898794-9b11-43d5-881b-9c649ee731d9") : secret "llmisvc-webhook-server-cert" not found
Jul 08 15:56:51.909093 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:51.909007    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 08 15:56:51.909093 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:51.909070    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-cert podName:0ba10f3c-1b8d-4f0b-abf8-87c945ea4567 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:52.409052995 +0000 UTC m=+342.744061394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-cert") pod "kserve-controller-manager-d6f4b65b8-8trgd" (UID: "0ba10f3c-1b8d-4f0b-abf8-87c945ea4567") : secret "kserve-webhook-server-cert" not found
Jul 08 15:56:51.918899 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.918873    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:56:51.918968 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.918931    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:56:51.918968 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.918957    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:56:51.925893 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.925874    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vq7n\" (UniqueName: \"kubernetes.io/projected/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-kube-api-access-8vq7n\") pod \"kserve-controller-manager-d6f4b65b8-8trgd\" (UID: \"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:51.933828 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:51.933802    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5fw9\" (UniqueName: \"kubernetes.io/projected/89898794-9b11-43d5-881b-9c649ee731d9-kube-api-access-q5fw9\") pod \"llmisvc-controller-manager-777c6bd7d5-9ffrh\" (UID: \"89898794-9b11-43d5-881b-9c649ee731d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:52.413738 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.413706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-cert\") pod \"kserve-controller-manager-d6f4b65b8-8trgd\" (UID: \"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:52.413738 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.413737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89898794-9b11-43d5-881b-9c649ee731d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9ffrh\" (UID: \"89898794-9b11-43d5-881b-9c649ee731d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:52.416198 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.416161    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89898794-9b11-43d5-881b-9c649ee731d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9ffrh\" (UID: \"89898794-9b11-43d5-881b-9c649ee731d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:52.416314 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.416231    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba10f3c-1b8d-4f0b-abf8-87c945ea4567-cert\") pod \"kserve-controller-manager-d6f4b65b8-8trgd\" (UID: \"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:52.526001 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.525969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s" event={"ID":"5db36d26-c9ed-43fb-9ac9-1c88a0a9876e","Type":"ContainerStarted","Data":"839f23f1d7a4162bbbe1e021a10c713e0e8d5a8d749394313e0649f153ba8553"}
Jul 08 15:56:52.562232 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.562186    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s" podStartSLOduration=1.540287094 podStartE2EDuration="4.562172113s" totalImagesPullingTime="3.021885019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:52.55941658 +0000 UTC m=+342.894425003" watchObservedRunningTime="2026-07-08 15:56:52.562172113 +0000 UTC m=+342.897180524"
Jul 08 15:56:52.626656 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.626630    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:52.636246 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.636225    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:52.719102 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.719065    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:52.724841 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.724815    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:52.782533 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.782510    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"]
Jul 08 15:56:52.784911 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:52.784886    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba10f3c_1b8d_4f0b_abf8_87c945ea4567.slice/crio-9e2bba899405865f977ade5a2b0b2a5a236fe0293a591579dbc5eecd2c392d3a WatchSource:0}: Error finding container 9e2bba899405865f977ade5a2b0b2a5a236fe0293a591579dbc5eecd2c392d3a: Status 404 returned error can't find the container with id 9e2bba899405865f977ade5a2b0b2a5a236fe0293a591579dbc5eecd2c392d3a
Jul 08 15:56:52.798415 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.798386    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"]
Jul 08 15:56:52.800026 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:56:52.800004    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod89898794_9b11_43d5_881b_9c649ee731d9.slice/crio-bc365103ef5fca2756546402cad886d47f26db5c5b94b1ef9d77557c6db8aa98 WatchSource:0}: Error finding container bc365103ef5fca2756546402cad886d47f26db5c5b94b1ef9d77557c6db8aa98: Status 404 returned error can't find the container with id bc365103ef5fca2756546402cad886d47f26db5c5b94b1ef9d77557c6db8aa98
Jul 08 15:56:52.893987 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.893959    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"]
Jul 08 15:56:52.894159 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:52.894139    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k" podUID="e0e35d0f-75af-4003-98e2-613ad6974b8e" containerName="discovery" containerID="cri-o://a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2" gracePeriod=30
Jul 08 15:56:53.138264 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.138241    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:53.219761 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.219728    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-dns-cert\") pod \"e0e35d0f-75af-4003-98e2-613ad6974b8e\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") "
Jul 08 15:56:53.219925 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.219771    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-kubeconfig\") pod \"e0e35d0f-75af-4003-98e2-613ad6974b8e\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") "
Jul 08 15:56:53.219925 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.219796    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqqnt\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-kube-api-access-pqqnt\") pod \"e0e35d0f-75af-4003-98e2-613ad6974b8e\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") "
Jul 08 15:56:53.219925 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.219879    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-ca-configmap\") pod \"e0e35d0f-75af-4003-98e2-613ad6974b8e\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") "
Jul 08 15:56:53.219925 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.219917    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-token\") pod \"e0e35d0f-75af-4003-98e2-613ad6974b8e\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") "
Jul 08 15:56:53.220127 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.219951    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-cacerts\") pod \"e0e35d0f-75af-4003-98e2-613ad6974b8e\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") "
Jul 08 15:56:53.220127 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.220012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e35d0f-75af-4003-98e2-613ad6974b8e-local-certs\") pod \"e0e35d0f-75af-4003-98e2-613ad6974b8e\" (UID: \"e0e35d0f-75af-4003-98e2-613ad6974b8e\") "
Jul 08 15:56:53.220868 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.220819    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e0e35d0f-75af-4003-98e2-613ad6974b8e" (UID: "e0e35d0f-75af-4003-98e2-613ad6974b8e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:56:53.222552 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.222509    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-kube-api-access-pqqnt" (OuterVolumeSpecName: "kube-api-access-pqqnt") pod "e0e35d0f-75af-4003-98e2-613ad6974b8e" (UID: "e0e35d0f-75af-4003-98e2-613ad6974b8e"). InnerVolumeSpecName "kube-api-access-pqqnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:56:53.222811 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.222778    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e0e35d0f-75af-4003-98e2-613ad6974b8e" (UID: "e0e35d0f-75af-4003-98e2-613ad6974b8e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:56:53.222908 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.222803    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e0e35d0f-75af-4003-98e2-613ad6974b8e" (UID: "e0e35d0f-75af-4003-98e2-613ad6974b8e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:56:53.222908 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.222828    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-cacerts" (OuterVolumeSpecName: "cacerts") pod "e0e35d0f-75af-4003-98e2-613ad6974b8e" (UID: "e0e35d0f-75af-4003-98e2-613ad6974b8e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:56:53.222908 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.222851    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0e35d0f-75af-4003-98e2-613ad6974b8e" (UID: "e0e35d0f-75af-4003-98e2-613ad6974b8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:56:53.223012 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.222903    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e35d0f-75af-4003-98e2-613ad6974b8e-local-certs" (OuterVolumeSpecName: "local-certs") pod "e0e35d0f-75af-4003-98e2-613ad6974b8e" (UID: "e0e35d0f-75af-4003-98e2-613ad6974b8e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:56:53.320959 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.320937    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-token\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:56:53.320959 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.320958    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-cacerts\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:56:53.320959 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.320966    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e35d0f-75af-4003-98e2-613ad6974b8e-local-certs\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:56:53.321244 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.320975    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-dns-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:56:53.321244 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.320983    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-kubeconfig\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:56:53.321244 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.321060    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqqnt\" (UniqueName: \"kubernetes.io/projected/e0e35d0f-75af-4003-98e2-613ad6974b8e-kube-api-access-pqqnt\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:56:53.321244 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.321069    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0e35d0f-75af-4003-98e2-613ad6974b8e-istio-csr-ca-configmap\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:56:53.536724 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.536683    2582 generic.go:356] "Generic (PLEG): container finished" podID="e0e35d0f-75af-4003-98e2-613ad6974b8e" containerID="a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2" exitCode=0
Jul 08 15:56:53.536896 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.536736    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k" event={"ID":"e0e35d0f-75af-4003-98e2-613ad6974b8e","Type":"ContainerDied","Data":"a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2"}
Jul 08 15:56:53.536896 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.536824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k" event={"ID":"e0e35d0f-75af-4003-98e2-613ad6974b8e","Type":"ContainerDied","Data":"358e5f74139abfab299e9b49e32aa17fc41fa5bc23b6a09b6f87cdae4b6ae2b9"}
Jul 08 15:56:53.536896 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.536839    2582 scope.go:117] "RemoveContainer" containerID="a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2"
Jul 08 15:56:53.537122 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.537095    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"
Jul 08 15:56:53.538124 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.538089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh" event={"ID":"89898794-9b11-43d5-881b-9c649ee731d9","Type":"ContainerStarted","Data":"bc365103ef5fca2756546402cad886d47f26db5c5b94b1ef9d77557c6db8aa98"}
Jul 08 15:56:53.539421 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.539396    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd" event={"ID":"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567","Type":"ContainerStarted","Data":"9e2bba899405865f977ade5a2b0b2a5a236fe0293a591579dbc5eecd2c392d3a"}
Jul 08 15:56:53.539610 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.539592    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:53.540643 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.540626    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgd5s"
Jul 08 15:56:53.583109 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.583037    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"]
Jul 08 15:56:53.587490 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.587464    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6xz9k"]
Jul 08 15:56:53.633029 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.628166    2582 scope.go:117] "RemoveContainer" containerID="a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2"
Jul 08 15:56:53.633196 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:56:53.633162    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2\": container with ID starting with a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2 not found: ID does not exist" containerID="a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2"
Jul 08 15:56:53.633271 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:53.633204    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2"} err="failed to get container status \"a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2\": rpc error: code = NotFound desc = could not find container \"a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2\": container with ID starting with a81df337e40290c7bb7cbb052db5744e1dd809aaefff748193acadd76cb667b2 not found: ID does not exist"
Jul 08 15:56:54.272215 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:54.272098    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e35d0f-75af-4003-98e2-613ad6974b8e" path="/var/lib/kubelet/pods/e0e35d0f-75af-4003-98e2-613ad6974b8e/volumes"
Jul 08 15:56:56.554962 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:56.554927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh" event={"ID":"89898794-9b11-43d5-881b-9c649ee731d9","Type":"ContainerStarted","Data":"57cb32f5f0e5d0c34d1c0e12da5254abd602eeaaad9d66dafdada1aaac42407f"}
Jul 08 15:56:56.555381 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:56.555053    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:56:56.556531 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:56.556511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd" event={"ID":"0ba10f3c-1b8d-4f0b-abf8-87c945ea4567","Type":"ContainerStarted","Data":"5416c3622b4c916fd73d7f6c59a2aa56c5323d7e5771038f0717d778296eff12"}
Jul 08 15:56:56.556638 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:56.556626    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:56:56.583495 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:56.583454    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh" podStartSLOduration=2.254035039 podStartE2EDuration="5.583442803s" totalImagesPullingTime="3.329407764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:56.581540869 +0000 UTC m=+346.916549292" watchObservedRunningTime="2026-07-08 15:56:56.583442803 +0000 UTC m=+346.918451213"
Jul 08 15:56:56.615619 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:56.615568    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd" podStartSLOduration=2.274930082 podStartE2EDuration="5.615556532s" totalImagesPullingTime="3.34062645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:56.614725602 +0000 UTC m=+346.949734013" watchObservedRunningTime="2026-07-08 15:56:56.615556532 +0000 UTC m=+346.950564943"
Jul 08 15:56:58.508641 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:58.508613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fsk44"
Jul 08 15:56:58.529985 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:56:58.529959    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-j2m56"
Jul 08 15:57:27.563468 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:27.563433    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9ffrh"
Jul 08 15:57:27.566391 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:27.566367    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8trgd"
Jul 08 15:57:41.168997 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.168960    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7t6m"]
Jul 08 15:57:41.169444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.169371    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e35d0f-75af-4003-98e2-613ad6974b8e" containerName="discovery"
Jul 08 15:57:41.169444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.169387    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e35d0f-75af-4003-98e2-613ad6974b8e" containerName="discovery"
Jul 08 15:57:41.169559 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.169486    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e35d0f-75af-4003-98e2-613ad6974b8e" containerName="discovery"
Jul 08 15:57:41.171215 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.171193    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m"
Jul 08 15:57:41.173733 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.173711    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 15:57:41.174618 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.174597    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 15:57:41.174713 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.174600    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dcpld\""
Jul 08 15:57:41.184355 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.184331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7t6m"]
Jul 08 15:57:41.191926 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.191898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46g46\" (UniqueName: \"kubernetes.io/projected/ffa6bd57-0951-4788-9bd8-e034ab550e05-kube-api-access-46g46\") pod \"kuadrant-operator-catalog-h7t6m\" (UID: \"ffa6bd57-0951-4788-9bd8-e034ab550e05\") " pod="kuadrant-system/kuadrant-operator-catalog-h7t6m"
Jul 08 15:57:41.292329 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.292298    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46g46\" (UniqueName: \"kubernetes.io/projected/ffa6bd57-0951-4788-9bd8-e034ab550e05-kube-api-access-46g46\") pod \"kuadrant-operator-catalog-h7t6m\" (UID: \"ffa6bd57-0951-4788-9bd8-e034ab550e05\") " pod="kuadrant-system/kuadrant-operator-catalog-h7t6m"
Jul 08 15:57:41.305871 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.305849    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46g46\" (UniqueName: \"kubernetes.io/projected/ffa6bd57-0951-4788-9bd8-e034ab550e05-kube-api-access-46g46\") pod \"kuadrant-operator-catalog-h7t6m\" (UID: \"ffa6bd57-0951-4788-9bd8-e034ab550e05\") " pod="kuadrant-system/kuadrant-operator-catalog-h7t6m"
Jul 08 15:57:41.480660 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.480569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m"
Jul 08 15:57:41.525749 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.525716    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7t6m"]
Jul 08 15:57:41.606790 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.606769    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7t6m"]
Jul 08 15:57:41.608826 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:57:41.608794    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa6bd57_0951_4788_9bd8_e034ab550e05.slice/crio-1b59466fcf9523696a668081f4fe486c23ba7696b92ae63ae4d85917b860b01c WatchSource:0}: Error finding container 1b59466fcf9523696a668081f4fe486c23ba7696b92ae63ae4d85917b860b01c: Status 404 returned error can't find the container with id 1b59466fcf9523696a668081f4fe486c23ba7696b92ae63ae4d85917b860b01c
Jul 08 15:57:41.736157 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.736095    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-clf2j"]
Jul 08 15:57:41.738703 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.738679    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m" event={"ID":"ffa6bd57-0951-4788-9bd8-e034ab550e05","Type":"ContainerStarted","Data":"1b59466fcf9523696a668081f4fe486c23ba7696b92ae63ae4d85917b860b01c"}
Jul 08 15:57:41.738821 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.738777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:41.748432 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.748408    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-clf2j"]
Jul 08 15:57:41.796322 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.796298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrws5\" (UniqueName: \"kubernetes.io/projected/1dc7fd5d-e33c-42b6-a99d-4769f3c982fd-kube-api-access-rrws5\") pod \"kuadrant-operator-catalog-clf2j\" (UID: \"1dc7fd5d-e33c-42b6-a99d-4769f3c982fd\") " pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:41.897499 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.897477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrws5\" (UniqueName: \"kubernetes.io/projected/1dc7fd5d-e33c-42b6-a99d-4769f3c982fd-kube-api-access-rrws5\") pod \"kuadrant-operator-catalog-clf2j\" (UID: \"1dc7fd5d-e33c-42b6-a99d-4769f3c982fd\") " pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:41.906794 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:41.906774    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrws5\" (UniqueName: \"kubernetes.io/projected/1dc7fd5d-e33c-42b6-a99d-4769f3c982fd-kube-api-access-rrws5\") pod \"kuadrant-operator-catalog-clf2j\" (UID: \"1dc7fd5d-e33c-42b6-a99d-4769f3c982fd\") " pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:42.047779 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:42.047713    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:42.170501 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:42.170471    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-clf2j"]
Jul 08 15:57:42.173450 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:57:42.173421    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc7fd5d_e33c_42b6_a99d_4769f3c982fd.slice/crio-9d054fa4c32ae583e3485fa36f7de9c4a8b29db1b3254821330cd06aee13852a WatchSource:0}: Error finding container 9d054fa4c32ae583e3485fa36f7de9c4a8b29db1b3254821330cd06aee13852a: Status 404 returned error can't find the container with id 9d054fa4c32ae583e3485fa36f7de9c4a8b29db1b3254821330cd06aee13852a
Jul 08 15:57:42.749136 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:42.749091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-clf2j" event={"ID":"1dc7fd5d-e33c-42b6-a99d-4769f3c982fd","Type":"ContainerStarted","Data":"9d054fa4c32ae583e3485fa36f7de9c4a8b29db1b3254821330cd06aee13852a"}
Jul 08 15:57:44.759704 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:44.759661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m" event={"ID":"ffa6bd57-0951-4788-9bd8-e034ab550e05","Type":"ContainerStarted","Data":"ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104"}
Jul 08 15:57:44.760144 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:44.759715    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m" podUID="ffa6bd57-0951-4788-9bd8-e034ab550e05" containerName="registry-server" containerID="cri-o://ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104" gracePeriod=2
Jul 08 15:57:44.761110 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:44.761076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-clf2j" event={"ID":"1dc7fd5d-e33c-42b6-a99d-4769f3c982fd","Type":"ContainerStarted","Data":"969b954bd297da6bb5d42f54ba2bc17c7153df7bcfb63c3d6511e92a49df5285"}
Jul 08 15:57:44.776754 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:44.776699    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m" podStartSLOduration=1.388134605 podStartE2EDuration="3.776685232s" totalImagesPullingTime="2.388550627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:44.776536355 +0000 UTC m=+395.111544767" watchObservedRunningTime="2026-07-08 15:57:44.776685232 +0000 UTC m=+395.111693646"
Jul 08 15:57:44.796135 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:44.796095    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-clf2j" podStartSLOduration=1.96923622 podStartE2EDuration="3.796082895s" totalImagesPullingTime="1.826846675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:44.794319994 +0000 UTC m=+395.129328404" watchObservedRunningTime="2026-07-08 15:57:44.796082895 +0000 UTC m=+395.131091305"
Jul 08 15:57:44.994607 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:44.994559    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m"
Jul 08 15:57:45.025464 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.025404    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46g46\" (UniqueName: \"kubernetes.io/projected/ffa6bd57-0951-4788-9bd8-e034ab550e05-kube-api-access-46g46\") pod \"ffa6bd57-0951-4788-9bd8-e034ab550e05\" (UID: \"ffa6bd57-0951-4788-9bd8-e034ab550e05\") "
Jul 08 15:57:45.027467 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.027444    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa6bd57-0951-4788-9bd8-e034ab550e05-kube-api-access-46g46" (OuterVolumeSpecName: "kube-api-access-46g46") pod "ffa6bd57-0951-4788-9bd8-e034ab550e05" (UID: "ffa6bd57-0951-4788-9bd8-e034ab550e05"). InnerVolumeSpecName "kube-api-access-46g46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:57:45.126432 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.126401    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46g46\" (UniqueName: \"kubernetes.io/projected/ffa6bd57-0951-4788-9bd8-e034ab550e05-kube-api-access-46g46\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:57:45.766075 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.766039    2582 generic.go:356] "Generic (PLEG): container finished" podID="ffa6bd57-0951-4788-9bd8-e034ab550e05" containerID="ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104" exitCode=0
Jul 08 15:57:45.766494 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.766082    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m"
Jul 08 15:57:45.766494 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.766127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m" event={"ID":"ffa6bd57-0951-4788-9bd8-e034ab550e05","Type":"ContainerDied","Data":"ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104"}
Jul 08 15:57:45.766494 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.766165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7t6m" event={"ID":"ffa6bd57-0951-4788-9bd8-e034ab550e05","Type":"ContainerDied","Data":"1b59466fcf9523696a668081f4fe486c23ba7696b92ae63ae4d85917b860b01c"}
Jul 08 15:57:45.766494 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.766188    2582 scope.go:117] "RemoveContainer" containerID="ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104"
Jul 08 15:57:45.775569 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.775553    2582 scope.go:117] "RemoveContainer" containerID="ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104"
Jul 08 15:57:45.775828 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:57:45.775810    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104\": container with ID starting with ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104 not found: ID does not exist" containerID="ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104"
Jul 08 15:57:45.775871 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.775840    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104"} err="failed to get container status \"ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104\": rpc error: code = NotFound desc = could not find container \"ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104\": container with ID starting with ac994d7af9cbe6ddf16573f3c23e0aa46219fe10821cafcd022095b631c32104 not found: ID does not exist"
Jul 08 15:57:45.786715 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.786691    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7t6m"]
Jul 08 15:57:45.791005 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:45.790985    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7t6m"]
Jul 08 15:57:46.268280 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:46.268247    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa6bd57-0951-4788-9bd8-e034ab550e05" path="/var/lib/kubelet/pods/ffa6bd57-0951-4788-9bd8-e034ab550e05/volumes"
Jul 08 15:57:52.048330 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:52.048294    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:52.048819 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:52.048360    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:52.071479 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:52.071454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:57:52.815773 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:57:52.815746    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-clf2j"
Jul 08 15:58:00.884737 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.884701    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-548567875c-4skf2"]
Jul 08 15:58:00.885188 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.885026    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa6bd57-0951-4788-9bd8-e034ab550e05" containerName="registry-server"
Jul 08 15:58:00.885188 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.885038    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa6bd57-0951-4788-9bd8-e034ab550e05" containerName="registry-server"
Jul 08 15:58:00.885188 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.885084    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa6bd57-0951-4788-9bd8-e034ab550e05" containerName="registry-server"
Jul 08 15:58:00.889334 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.889318    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:00.892157 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.892131    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 15:58:00.892331 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.892316    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 15:58:00.892397 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.892376    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 15:58:00.892479 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.892466    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 15:58:00.893098 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.893071    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 15:58:00.893199 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.893165    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 15:58:00.893263 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.893202    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 15:58:00.893263 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.893227    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfj5m\""
Jul 08 15:58:00.897798 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.897772    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 15:58:00.899005 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.898986    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548567875c-4skf2"]
Jul 08 15:58:00.939802 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.939769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-oauth-serving-cert\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:00.939914 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.939817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-service-ca\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:00.939914 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.939896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-trusted-ca-bundle\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:00.939982 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.939941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-config\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:00.940019 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.939982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-serving-cert\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:00.940051 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.940028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-oauth-config\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:00.940083 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:00.940053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jh5j\" (UniqueName: \"kubernetes.io/projected/999dbc4e-b0d4-4828-98e8-b5467386c30a-kube-api-access-6jh5j\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.041411 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.041384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-oauth-serving-cert\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.041634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.041416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-service-ca\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.041634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.041446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-trusted-ca-bundle\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.041634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.041477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-config\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.041634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.041516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-serving-cert\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.041634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.041565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-oauth-config\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.041634 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.041613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh5j\" (UniqueName: \"kubernetes.io/projected/999dbc4e-b0d4-4828-98e8-b5467386c30a-kube-api-access-6jh5j\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.042197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.042166    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-oauth-serving-cert\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.042295 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.042175    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-service-ca\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.042295 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.042281    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-config\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.042521 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.042503    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/999dbc4e-b0d4-4828-98e8-b5467386c30a-trusted-ca-bundle\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.044010 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.043992    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-serving-cert\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.044101 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.044013    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/999dbc4e-b0d4-4828-98e8-b5467386c30a-console-oauth-config\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.050284 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.050261    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jh5j\" (UniqueName: \"kubernetes.io/projected/999dbc4e-b0d4-4828-98e8-b5467386c30a-kube-api-access-6jh5j\") pod \"console-548567875c-4skf2\" (UID: \"999dbc4e-b0d4-4828-98e8-b5467386c30a\") " pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.199245 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.199164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:01.332568 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.332539    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548567875c-4skf2"]
Jul 08 15:58:01.336675 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:01.336635    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999dbc4e_b0d4_4828_98e8_b5467386c30a.slice/crio-01df11c0621795ea642699f5423391fdf914f10dc4e1ad31f26d46b2d9a5cf23 WatchSource:0}: Error finding container 01df11c0621795ea642699f5423391fdf914f10dc4e1ad31f26d46b2d9a5cf23: Status 404 returned error can't find the container with id 01df11c0621795ea642699f5423391fdf914f10dc4e1ad31f26d46b2d9a5cf23
Jul 08 15:58:01.831137 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.831105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548567875c-4skf2" event={"ID":"999dbc4e-b0d4-4828-98e8-b5467386c30a","Type":"ContainerStarted","Data":"b519fd92ecc44b597cb230098b9ff38ecc0d27b99dcb225a12f59abf6c02e770"}
Jul 08 15:58:01.831310 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.831153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548567875c-4skf2" event={"ID":"999dbc4e-b0d4-4828-98e8-b5467386c30a","Type":"ContainerStarted","Data":"01df11c0621795ea642699f5423391fdf914f10dc4e1ad31f26d46b2d9a5cf23"}
Jul 08 15:58:01.858348 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:01.858273    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-548567875c-4skf2" podStartSLOduration=1.858258544 podStartE2EDuration="1.858258544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:01.858105481 +0000 UTC m=+412.193113902" watchObservedRunningTime="2026-07-08 15:58:01.858258544 +0000 UTC m=+412.193266953"
Jul 08 15:58:11.200030 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:11.200001    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:11.200411 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:11.200088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:11.204592 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:11.204555    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:11.875003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:11.874976    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548567875c-4skf2"
Jul 08 15:58:12.853639 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:12.853611    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"]
Jul 08 15:58:12.858045 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:12.858030    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"
Jul 08 15:58:12.860444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:12.860420    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 15:58:12.860551 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:12.860448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wjbpn\""
Jul 08 15:58:12.868461 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:12.868434    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"]
Jul 08 15:58:12.932201 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:12.932171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwc75\" (UniqueName: \"kubernetes.io/projected/82e8a8a5-de1c-4518-98ef-713a26c80956-kube-api-access-qwc75\") pod \"dns-operator-controller-manager-864dd78c4c-j6fbb\" (UID: \"82e8a8a5-de1c-4518-98ef-713a26c80956\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"
Jul 08 15:58:13.033102 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:13.033071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwc75\" (UniqueName: \"kubernetes.io/projected/82e8a8a5-de1c-4518-98ef-713a26c80956-kube-api-access-qwc75\") pod \"dns-operator-controller-manager-864dd78c4c-j6fbb\" (UID: \"82e8a8a5-de1c-4518-98ef-713a26c80956\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"
Jul 08 15:58:13.041753 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:13.041737    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwc75\" (UniqueName: \"kubernetes.io/projected/82e8a8a5-de1c-4518-98ef-713a26c80956-kube-api-access-qwc75\") pod \"dns-operator-controller-manager-864dd78c4c-j6fbb\" (UID: \"82e8a8a5-de1c-4518-98ef-713a26c80956\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"
Jul 08 15:58:13.168402 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:13.168336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"
Jul 08 15:58:13.297528 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:13.297506    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"]
Jul 08 15:58:13.300208 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:13.300183    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e8a8a5_de1c_4518_98ef_713a26c80956.slice/crio-c9c81d7d9b67912dbf5683c401b61927d568b345eb4809993b62da34634c9237 WatchSource:0}: Error finding container c9c81d7d9b67912dbf5683c401b61927d568b345eb4809993b62da34634c9237: Status 404 returned error can't find the container with id c9c81d7d9b67912dbf5683c401b61927d568b345eb4809993b62da34634c9237
Jul 08 15:58:13.880415 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:13.880381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb" event={"ID":"82e8a8a5-de1c-4518-98ef-713a26c80956","Type":"ContainerStarted","Data":"c9c81d7d9b67912dbf5683c401b61927d568b345eb4809993b62da34634c9237"}
Jul 08 15:58:15.890083 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:15.890053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb" event={"ID":"82e8a8a5-de1c-4518-98ef-713a26c80956","Type":"ContainerStarted","Data":"2fac1700740a4b0f54fd2d33ef149a2d83fb315591d569f828d505cd467598a8"}
Jul 08 15:58:15.890463 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:15.890176    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"
Jul 08 15:58:15.908891 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:15.908845    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb" podStartSLOduration=1.814272595 podStartE2EDuration="3.908828084s" totalImagesPullingTime="2.094555489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:15.907400144 +0000 UTC m=+426.242408566" watchObservedRunningTime="2026-07-08 15:58:15.908828084 +0000 UTC m=+426.243836494"
Jul 08 15:58:16.309181 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.309154    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"]
Jul 08 15:58:16.312434 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.312412    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:16.315443 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.315425    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n64pz\""
Jul 08 15:58:16.325436 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.325416    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"]
Jul 08 15:58:16.461384 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.461355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42f8q\" (UniqueName: \"kubernetes.io/projected/02f0a621-4723-4898-9017-650d38aa0973-kube-api-access-42f8q\") pod \"limitador-operator-controller-manager-859d7b78bd-fj5ch\" (UID: \"02f0a621-4723-4898-9017-650d38aa0973\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:16.562677 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.562601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42f8q\" (UniqueName: \"kubernetes.io/projected/02f0a621-4723-4898-9017-650d38aa0973-kube-api-access-42f8q\") pod \"limitador-operator-controller-manager-859d7b78bd-fj5ch\" (UID: \"02f0a621-4723-4898-9017-650d38aa0973\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:16.573444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.573423    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42f8q\" (UniqueName: \"kubernetes.io/projected/02f0a621-4723-4898-9017-650d38aa0973-kube-api-access-42f8q\") pod \"limitador-operator-controller-manager-859d7b78bd-fj5ch\" (UID: \"02f0a621-4723-4898-9017-650d38aa0973\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:16.622036 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.622010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:16.748472 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.748450    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"]
Jul 08 15:58:16.749639 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:16.749566    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f0a621_4723_4898_9017_650d38aa0973.slice/crio-e2250af1b5fc2aa22e42700fcf7fd73d7b44b2bf536f6807194b31af1363cbd5 WatchSource:0}: Error finding container e2250af1b5fc2aa22e42700fcf7fd73d7b44b2bf536f6807194b31af1363cbd5: Status 404 returned error can't find the container with id e2250af1b5fc2aa22e42700fcf7fd73d7b44b2bf536f6807194b31af1363cbd5
Jul 08 15:58:16.895594 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:16.895503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch" event={"ID":"02f0a621-4723-4898-9017-650d38aa0973","Type":"ContainerStarted","Data":"e2250af1b5fc2aa22e42700fcf7fd73d7b44b2bf536f6807194b31af1363cbd5"}
Jul 08 15:58:18.906514 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:18.906482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch" event={"ID":"02f0a621-4723-4898-9017-650d38aa0973","Type":"ContainerStarted","Data":"f7503a969892d8db47ee67eff7c06f14a593727128496540d6dd06f616f0459e"}
Jul 08 15:58:18.906858 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:18.906685    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:18.944663 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:18.944613    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch" podStartSLOduration=0.902648775 podStartE2EDuration="2.944596397s" totalImagesPullingTime="2.041947622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:18.944222468 +0000 UTC m=+429.279230882" watchObservedRunningTime="2026-07-08 15:58:18.944596397 +0000 UTC m=+429.279604801"
Jul 08 15:58:21.561431 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.561392    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"]
Jul 08 15:58:21.565027 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.565005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:21.574627 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.574607    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t64wh\""
Jul 08 15:58:21.578425 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.578404    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"]
Jul 08 15:58:21.705548 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.705516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fjz\" (UniqueName: \"kubernetes.io/projected/f7cceda7-701e-495c-937f-17aa125b4647-kube-api-access-p8fjz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:21.705714 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.705590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7cceda7-701e-495c-937f-17aa125b4647-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:21.806483 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.806452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7cceda7-701e-495c-937f-17aa125b4647-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:21.806638 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.806513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fjz\" (UniqueName: \"kubernetes.io/projected/f7cceda7-701e-495c-937f-17aa125b4647-kube-api-access-p8fjz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:21.806907 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.806886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7cceda7-701e-495c-937f-17aa125b4647-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:21.823332 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.823286    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fjz\" (UniqueName: \"kubernetes.io/projected/f7cceda7-701e-495c-937f-17aa125b4647-kube-api-access-p8fjz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:21.875305 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:21.875279    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:22.038715 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:22.038687    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"]
Jul 08 15:58:22.040260 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:22.040234    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cceda7_701e_495c_937f_17aa125b4647.slice/crio-2eba63c9debc3a5e9d75a1cebc20a9943dd1114145d741cb36509ac80aee5794 WatchSource:0}: Error finding container 2eba63c9debc3a5e9d75a1cebc20a9943dd1114145d741cb36509ac80aee5794: Status 404 returned error can't find the container with id 2eba63c9debc3a5e9d75a1cebc20a9943dd1114145d741cb36509ac80aee5794
Jul 08 15:58:22.926628 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:22.926571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs" event={"ID":"f7cceda7-701e-495c-937f-17aa125b4647","Type":"ContainerStarted","Data":"2eba63c9debc3a5e9d75a1cebc20a9943dd1114145d741cb36509ac80aee5794"}
Jul 08 15:58:24.472834 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.472793    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"]
Jul 08 15:58:24.476556 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.476529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"
Jul 08 15:58:24.479818 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.479790    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jltvz\""
Jul 08 15:58:24.495035 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.495008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"]
Jul 08 15:58:24.631386 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.631351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqwc\" (UniqueName: \"kubernetes.io/projected/2106d375-d28f-438d-b319-9a9c38d61d4f-kube-api-access-vfqwc\") pod \"authorino-operator-75cc8d5cb7-slvnx\" (UID: \"2106d375-d28f-438d-b319-9a9c38d61d4f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"
Jul 08 15:58:24.732680 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.732611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqwc\" (UniqueName: \"kubernetes.io/projected/2106d375-d28f-438d-b319-9a9c38d61d4f-kube-api-access-vfqwc\") pod \"authorino-operator-75cc8d5cb7-slvnx\" (UID: \"2106d375-d28f-438d-b319-9a9c38d61d4f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"
Jul 08 15:58:24.742559 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.742533    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqwc\" (UniqueName: \"kubernetes.io/projected/2106d375-d28f-438d-b319-9a9c38d61d4f-kube-api-access-vfqwc\") pod \"authorino-operator-75cc8d5cb7-slvnx\" (UID: \"2106d375-d28f-438d-b319-9a9c38d61d4f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"
Jul 08 15:58:24.789393 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.789362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"
Jul 08 15:58:24.963736 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:24.963704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"]
Jul 08 15:58:24.966295 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:24.966260    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2106d375_d28f_438d_b319_9a9c38d61d4f.slice/crio-203dae43e396ccb9bf6c7c6fbd105177d2592678bad10c98e324bdd848bc246a WatchSource:0}: Error finding container 203dae43e396ccb9bf6c7c6fbd105177d2592678bad10c98e324bdd848bc246a: Status 404 returned error can't find the container with id 203dae43e396ccb9bf6c7c6fbd105177d2592678bad10c98e324bdd848bc246a
Jul 08 15:58:25.946735 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:25.946697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx" event={"ID":"2106d375-d28f-438d-b319-9a9c38d61d4f","Type":"ContainerStarted","Data":"203dae43e396ccb9bf6c7c6fbd105177d2592678bad10c98e324bdd848bc246a"}
Jul 08 15:58:26.897747 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:26.897721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j6fbb"
Jul 08 15:58:28.963126 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:28.963085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx" event={"ID":"2106d375-d28f-438d-b319-9a9c38d61d4f","Type":"ContainerStarted","Data":"e02668e71fe39cdf415a945c1faf689cc65918842f8f65cd515f5230263dffb9"}
Jul 08 15:58:28.963515 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:28.963152    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"
Jul 08 15:58:28.964733 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:28.964708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs" event={"ID":"f7cceda7-701e-495c-937f-17aa125b4647","Type":"ContainerStarted","Data":"8fcc06052a1e12cd8cdd7782b953347d671c2661191f3ea346c142767abab360"}
Jul 08 15:58:28.964865 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:28.964848    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:28.984479 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:28.984430    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx" podStartSLOduration=1.586022563 podStartE2EDuration="4.984418011s" totalImagesPullingTime="3.398395448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:28.982635036 +0000 UTC m=+439.317643449" watchObservedRunningTime="2026-07-08 15:58:28.984418011 +0000 UTC m=+439.319426399"
Jul 08 15:58:29.004988 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:29.004947    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs" podStartSLOduration=1.670994793 podStartE2EDuration="8.004935697s" totalImagesPullingTime="6.333940904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:29.003414753 +0000 UTC m=+439.338423164" watchObservedRunningTime="2026-07-08 15:58:29.004935697 +0000 UTC m=+439.339944107"
Jul 08 15:58:29.913111 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:29.913077    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:39.971568 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:39.971479    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:39.972055 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:39.971613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-slvnx"
Jul 08 15:58:41.469469 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.469433    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"]
Jul 08 15:58:41.472767 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.472746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.493983 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.493950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"]
Jul 08 15:58:41.568944 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.568913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.569059 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.568986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8clfr\" (UniqueName: \"kubernetes.io/projected/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-kube-api-access-8clfr\") pod \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.669957 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.669926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.670081 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.669973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8clfr\" (UniqueName: \"kubernetes.io/projected/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-kube-api-access-8clfr\") pod \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.670372 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.670343    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.683254 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.683235    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8clfr\" (UniqueName: \"kubernetes.io/projected/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-kube-api-access-8clfr\") pod \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.782379 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.782310    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:41.792234 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.792208    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"]
Jul 08 15:58:41.797823 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.797799    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"]
Jul 08 15:58:41.809925 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.809898    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"]
Jul 08 15:58:41.810125 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.810096    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs" podUID="f7cceda7-701e-495c-937f-17aa125b4647" containerName="manager" containerID="cri-o://8fcc06052a1e12cd8cdd7782b953347d671c2661191f3ea346c142767abab360" gracePeriod=2
Jul 08 15:58:41.822773 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:41.822714    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f7cceda7-701e-495c-937f-17aa125b4647\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\": pods \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:41.823209 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.823150    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"]
Jul 08 15:58:41.826475 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.826449    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"]
Jul 08 15:58:41.826827 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.826811    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7cceda7-701e-495c-937f-17aa125b4647" containerName="manager"
Jul 08 15:58:41.826906 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.826830    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7cceda7-701e-495c-937f-17aa125b4647" containerName="manager"
Jul 08 15:58:41.826961 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.826950    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7cceda7-701e-495c-937f-17aa125b4647" containerName="manager"
Jul 08 15:58:41.829857 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.829841    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:41.832178 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:41.832147    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="f7cceda7-701e-495c-937f-17aa125b4647" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:41.841353 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.841328    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"]
Jul 08 15:58:41.844388 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.844370    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"]
Jul 08 15:58:41.844513 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.844494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:41.844551 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.844509    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch" podUID="02f0a621-4723-4898-9017-650d38aa0973" containerName="manager" containerID="cri-o://f7503a969892d8db47ee67eff7c06f14a593727128496540d6dd06f616f0459e" gracePeriod=2
Jul 08 15:58:41.848963 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.848943    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"]
Jul 08 15:58:41.854322 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.854286    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"]
Jul 08 15:58:41.868520 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.868495    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"]
Jul 08 15:58:41.870893 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.870873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkzz\" (UniqueName: \"kubernetes.io/projected/d1647dc6-9f0e-42ef-9645-8cbe3476f999-kube-api-access-nzkzz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bnzjj\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:41.871016 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.870970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1647dc6-9f0e-42ef-9645-8cbe3476f999-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bnzjj\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:41.871163 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.871125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c135821d-4dc5-442f-a309-f57e373f71fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ksrx\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:41.871277 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.871182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw2c7\" (UniqueName: \"kubernetes.io/projected/c135821d-4dc5-442f-a309-f57e373f71fd-kube-api-access-qw2c7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ksrx\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:41.885703 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:41.885664    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fj5ch\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="02f0a621-4723-4898-9017-650d38aa0973" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:41.887838 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:41.887812    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="f7cceda7-701e-495c-937f-17aa125b4647" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:41.971966 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.971938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1647dc6-9f0e-42ef-9645-8cbe3476f999-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bnzjj\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:41.972091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.971978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c135821d-4dc5-442f-a309-f57e373f71fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ksrx\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:41.972091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.971996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2c7\" (UniqueName: \"kubernetes.io/projected/c135821d-4dc5-442f-a309-f57e373f71fd-kube-api-access-qw2c7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ksrx\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:41.972091 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.972027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkzz\" (UniqueName: \"kubernetes.io/projected/d1647dc6-9f0e-42ef-9645-8cbe3476f999-kube-api-access-nzkzz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bnzjj\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:41.972385 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.972363    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c135821d-4dc5-442f-a309-f57e373f71fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ksrx\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:41.972625 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.972598    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1647dc6-9f0e-42ef-9645-8cbe3476f999-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bnzjj\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:41.994777 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.994751    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkzz\" (UniqueName: \"kubernetes.io/projected/d1647dc6-9f0e-42ef-9645-8cbe3476f999-kube-api-access-nzkzz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bnzjj\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:41.997401 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:41.997379    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw2c7\" (UniqueName: \"kubernetes.io/projected/c135821d-4dc5-442f-a309-f57e373f71fd-kube-api-access-qw2c7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ksrx\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:42.029301 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.029010    2582 generic.go:356] "Generic (PLEG): container finished" podID="02f0a621-4723-4898-9017-650d38aa0973" containerID="f7503a969892d8db47ee67eff7c06f14a593727128496540d6dd06f616f0459e" exitCode=0
Jul 08 15:58:42.030880 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.030855    2582 generic.go:356] "Generic (PLEG): container finished" podID="f7cceda7-701e-495c-937f-17aa125b4647" containerID="8fcc06052a1e12cd8cdd7782b953347d671c2661191f3ea346c142767abab360" exitCode=0
Jul 08 15:58:42.073796 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.073779    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:42.076938 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:42.076911    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fj5ch\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="02f0a621-4723-4898-9017-650d38aa0973" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:42.080053 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.080036    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:42.086525 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:42.086503    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="f7cceda7-701e-495c-937f-17aa125b4647" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:42.094542 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:42.094516    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fj5ch\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="02f0a621-4723-4898-9017-650d38aa0973" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:42.098992 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:42.098958    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vsbzs\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="f7cceda7-701e-495c-937f-17aa125b4647" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:42.173416 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.173386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8fjz\" (UniqueName: \"kubernetes.io/projected/f7cceda7-701e-495c-937f-17aa125b4647-kube-api-access-p8fjz\") pod \"f7cceda7-701e-495c-937f-17aa125b4647\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") "
Jul 08 15:58:42.173530 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.173423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42f8q\" (UniqueName: \"kubernetes.io/projected/02f0a621-4723-4898-9017-650d38aa0973-kube-api-access-42f8q\") pod \"02f0a621-4723-4898-9017-650d38aa0973\" (UID: \"02f0a621-4723-4898-9017-650d38aa0973\") "
Jul 08 15:58:42.173530 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.173482    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7cceda7-701e-495c-937f-17aa125b4647-extensions-socket-volume\") pod \"f7cceda7-701e-495c-937f-17aa125b4647\" (UID: \"f7cceda7-701e-495c-937f-17aa125b4647\") "
Jul 08 15:58:42.174004 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.173975    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7cceda7-701e-495c-937f-17aa125b4647-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f7cceda7-701e-495c-937f-17aa125b4647" (UID: "f7cceda7-701e-495c-937f-17aa125b4647"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:58:42.175342 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.175314    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7cceda7-701e-495c-937f-17aa125b4647-kube-api-access-p8fjz" (OuterVolumeSpecName: "kube-api-access-p8fjz") pod "f7cceda7-701e-495c-937f-17aa125b4647" (UID: "f7cceda7-701e-495c-937f-17aa125b4647"). InnerVolumeSpecName "kube-api-access-p8fjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:58:42.175421 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.175337    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f0a621-4723-4898-9017-650d38aa0973-kube-api-access-42f8q" (OuterVolumeSpecName: "kube-api-access-42f8q") pod "02f0a621-4723-4898-9017-650d38aa0973" (UID: "02f0a621-4723-4898-9017-650d38aa0973"). InnerVolumeSpecName "kube-api-access-42f8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:58:42.236012 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.235990    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:42.240911 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.240886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:42.268712 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.268683    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02f0a621-4723-4898-9017-650d38aa0973" path="/var/lib/kubelet/pods/02f0a621-4723-4898-9017-650d38aa0973/volumes"
Jul 08 15:58:42.269122 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.269099    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7cceda7-701e-495c-937f-17aa125b4647" path="/var/lib/kubelet/pods/f7cceda7-701e-495c-937f-17aa125b4647/volumes"
Jul 08 15:58:42.274571 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.274311    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7cceda7-701e-495c-937f-17aa125b4647-extensions-socket-volume\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:58:42.274571 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.274337    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8fjz\" (UniqueName: \"kubernetes.io/projected/f7cceda7-701e-495c-937f-17aa125b4647-kube-api-access-p8fjz\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:58:42.274571 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.274354    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42f8q\" (UniqueName: \"kubernetes.io/projected/02f0a621-4723-4898-9017-650d38aa0973-kube-api-access-42f8q\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:58:42.405189 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.405163    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"]
Jul 08 15:58:42.407311 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:42.407285    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1647dc6_9f0e_42ef_9645_8cbe3476f999.slice/crio-1cc4c20ae0d64ce60c5d749ad06c693f6d3c6dac6a4db84267ac74d9edafdd50 WatchSource:0}: Error finding container 1cc4c20ae0d64ce60c5d749ad06c693f6d3c6dac6a4db84267ac74d9edafdd50: Status 404 returned error can't find the container with id 1cc4c20ae0d64ce60c5d749ad06c693f6d3c6dac6a4db84267ac74d9edafdd50
Jul 08 15:58:42.416825 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:42.416806    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"]
Jul 08 15:58:42.420281 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:42.420248    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc135821d_4dc5_442f_a309_f57e373f71fd.slice/crio-55240a1bf63e3866bbd4262102b9818fa838b11a479618e161db71fe33280ea9 WatchSource:0}: Error finding container 55240a1bf63e3866bbd4262102b9818fa838b11a479618e161db71fe33280ea9: Status 404 returned error can't find the container with id 55240a1bf63e3866bbd4262102b9818fa838b11a479618e161db71fe33280ea9
Jul 08 15:58:43.038728 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.038639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj" event={"ID":"d1647dc6-9f0e-42ef-9645-8cbe3476f999","Type":"ContainerStarted","Data":"ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5"}
Jul 08 15:58:43.038728 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.038704    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:43.039175 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.038730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj" event={"ID":"d1647dc6-9f0e-42ef-9645-8cbe3476f999","Type":"ContainerStarted","Data":"1cc4c20ae0d64ce60c5d749ad06c693f6d3c6dac6a4db84267ac74d9edafdd50"}
Jul 08 15:58:43.040359 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.040326    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx" event={"ID":"c135821d-4dc5-442f-a309-f57e373f71fd","Type":"ContainerStarted","Data":"924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c"}
Jul 08 15:58:43.040504 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.040378    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx" event={"ID":"c135821d-4dc5-442f-a309-f57e373f71fd","Type":"ContainerStarted","Data":"55240a1bf63e3866bbd4262102b9818fa838b11a479618e161db71fe33280ea9"}
Jul 08 15:58:43.040504 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.040400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:43.041518 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.041500    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fj5ch"
Jul 08 15:58:43.041701 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.041500    2582 scope.go:117] "RemoveContainer" containerID="f7503a969892d8db47ee67eff7c06f14a593727128496540d6dd06f616f0459e"
Jul 08 15:58:43.043022 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.042996    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vsbzs"
Jul 08 15:58:43.049825 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.049799    2582 scope.go:117] "RemoveContainer" containerID="8fcc06052a1e12cd8cdd7782b953347d671c2661191f3ea346c142767abab360"
Jul 08 15:58:43.060262 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.060226    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj" podStartSLOduration=2.060213751 podStartE2EDuration="2.060213751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:43.059054046 +0000 UTC m=+453.394062456" watchObservedRunningTime="2026-07-08 15:58:43.060213751 +0000 UTC m=+453.395222162"
Jul 08 15:58:43.080630 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:43.080574    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx" podStartSLOduration=2.080563758 podStartE2EDuration="2.080563758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:43.078780776 +0000 UTC m=+453.413789227" watchObservedRunningTime="2026-07-08 15:58:43.080563758 +0000 UTC m=+453.415572168"
Jul 08 15:58:44.324830 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:44.324790    2582 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-jxbtz_kuadrant-system_4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460_0(35d753b092f4cca56b03ee879af5f4bb7ea1eac2fa577632dcf9286604a499e4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-jxbtz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 08 15:58:44.325084 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:44.324855    2582 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-jxbtz_kuadrant-system_4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460_0(35d753b092f4cca56b03ee879af5f4bb7ea1eac2fa577632dcf9286604a499e4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-jxbtz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:45.054197 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.054168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:45.062164 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.062139    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:45.064524 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:45.064500    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:45.099915 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.099883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8clfr\" (UniqueName: \"kubernetes.io/projected/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-kube-api-access-8clfr\") pod \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") "
Jul 08 15:58:45.100001 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.099937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-extensions-socket-volume\") pod \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\" (UID: \"4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460\") "
Jul 08 15:58:45.100231 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.100206    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460" (UID: "4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:58:45.102003 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.101978    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-kube-api-access-8clfr" (OuterVolumeSpecName: "kube-api-access-8clfr") pod "4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460" (UID: "4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460"). InnerVolumeSpecName "kube-api-access-8clfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:58:45.201194 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.201168    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-extensions-socket-volume\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:58:45.201194 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:45.201191    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8clfr\" (UniqueName: \"kubernetes.io/projected/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460-kube-api-access-8clfr\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:58:46.059946 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:46.059915    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:46.062590 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:46.062558    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:46.067773 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:46.067745    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jxbtz\" is forbidden: User \"system:node:ip-10-0-132-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-153.ec2.internal' and this object" podUID="4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jxbtz"
Jul 08 15:58:46.269664 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:46.269631    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460" path="/var/lib/kubelet/pods/4e8063e9-9bc1-4953-9aa0-a5cbb6cd2460/volumes"
Jul 08 15:58:54.051881 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.051844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:54.052418 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.052015    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:58:54.149684 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.149654    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"]
Jul 08 15:58:54.149917 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.149895    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx" podUID="c135821d-4dc5-442f-a309-f57e373f71fd" containerName="manager" containerID="cri-o://924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c" gracePeriod=10
Jul 08 15:58:54.354178 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.354147    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"]
Jul 08 15:58:54.354495 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.354482    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f0a621-4723-4898-9017-650d38aa0973" containerName="manager"
Jul 08 15:58:54.354541 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.354497    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f0a621-4723-4898-9017-650d38aa0973" containerName="manager"
Jul 08 15:58:54.354600 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.354561    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="02f0a621-4723-4898-9017-650d38aa0973" containerName="manager"
Jul 08 15:58:54.356467 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.356450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.373465 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.373417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/002b862a-af21-43b0-9888-95e1efc2aa60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r5vmp\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.373465 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.373463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k94db\" (UniqueName: \"kubernetes.io/projected/002b862a-af21-43b0-9888-95e1efc2aa60-kube-api-access-k94db\") pod \"kuadrant-operator-controller-manager-86878c769f-r5vmp\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.374668 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.374647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"]
Jul 08 15:58:54.393388 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.393369    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:54.474444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.474413    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c135821d-4dc5-442f-a309-f57e373f71fd-extensions-socket-volume\") pod \"c135821d-4dc5-442f-a309-f57e373f71fd\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") "
Jul 08 15:58:54.474613 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.474458    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw2c7\" (UniqueName: \"kubernetes.io/projected/c135821d-4dc5-442f-a309-f57e373f71fd-kube-api-access-qw2c7\") pod \"c135821d-4dc5-442f-a309-f57e373f71fd\" (UID: \"c135821d-4dc5-442f-a309-f57e373f71fd\") "
Jul 08 15:58:54.474613 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.474540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/002b862a-af21-43b0-9888-95e1efc2aa60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r5vmp\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.474613 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.474565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k94db\" (UniqueName: \"kubernetes.io/projected/002b862a-af21-43b0-9888-95e1efc2aa60-kube-api-access-k94db\") pod \"kuadrant-operator-controller-manager-86878c769f-r5vmp\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.474860 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.474837    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c135821d-4dc5-442f-a309-f57e373f71fd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c135821d-4dc5-442f-a309-f57e373f71fd" (UID: "c135821d-4dc5-442f-a309-f57e373f71fd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:58:54.474972 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.474948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/002b862a-af21-43b0-9888-95e1efc2aa60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r5vmp\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.476369 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.476344    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c135821d-4dc5-442f-a309-f57e373f71fd-kube-api-access-qw2c7" (OuterVolumeSpecName: "kube-api-access-qw2c7") pod "c135821d-4dc5-442f-a309-f57e373f71fd" (UID: "c135821d-4dc5-442f-a309-f57e373f71fd"). InnerVolumeSpecName "kube-api-access-qw2c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:58:54.483976 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.483953    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k94db\" (UniqueName: \"kubernetes.io/projected/002b862a-af21-43b0-9888-95e1efc2aa60-kube-api-access-k94db\") pod \"kuadrant-operator-controller-manager-86878c769f-r5vmp\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.575924 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.575862    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c135821d-4dc5-442f-a309-f57e373f71fd-extensions-socket-volume\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:58:54.575924 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.575885    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw2c7\" (UniqueName: \"kubernetes.io/projected/c135821d-4dc5-442f-a309-f57e373f71fd-kube-api-access-qw2c7\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:58:54.666440 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.666414    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:54.803146 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:54.803123    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"]
Jul 08 15:58:54.805430 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:58:54.805403    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002b862a_af21_43b0_9888_95e1efc2aa60.slice/crio-5dab232aaf0f6ba148536a89e87eec0d71bb60a2bce47a17fd1a8c4878739b9d WatchSource:0}: Error finding container 5dab232aaf0f6ba148536a89e87eec0d71bb60a2bce47a17fd1a8c4878739b9d: Status 404 returned error can't find the container with id 5dab232aaf0f6ba148536a89e87eec0d71bb60a2bce47a17fd1a8c4878739b9d
Jul 08 15:58:55.103231 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.103145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp" event={"ID":"002b862a-af21-43b0-9888-95e1efc2aa60","Type":"ContainerStarted","Data":"b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc"}
Jul 08 15:58:55.103231 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.103194    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp" event={"ID":"002b862a-af21-43b0-9888-95e1efc2aa60","Type":"ContainerStarted","Data":"5dab232aaf0f6ba148536a89e87eec0d71bb60a2bce47a17fd1a8c4878739b9d"}
Jul 08 15:58:55.103742 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.103245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:58:55.104621 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.104598    2582 generic.go:356] "Generic (PLEG): container finished" podID="c135821d-4dc5-442f-a309-f57e373f71fd" containerID="924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c" exitCode=0
Jul 08 15:58:55.104704 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.104628    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx" event={"ID":"c135821d-4dc5-442f-a309-f57e373f71fd","Type":"ContainerDied","Data":"924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c"}
Jul 08 15:58:55.104704 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.104647    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"
Jul 08 15:58:55.104704 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.104679    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx" event={"ID":"c135821d-4dc5-442f-a309-f57e373f71fd","Type":"ContainerDied","Data":"55240a1bf63e3866bbd4262102b9818fa838b11a479618e161db71fe33280ea9"}
Jul 08 15:58:55.104803 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.104710    2582 scope.go:117] "RemoveContainer" containerID="924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c"
Jul 08 15:58:55.113471 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.113457    2582 scope.go:117] "RemoveContainer" containerID="924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c"
Jul 08 15:58:55.113715 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:58:55.113698    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c\": container with ID starting with 924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c not found: ID does not exist" containerID="924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c"
Jul 08 15:58:55.113782 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.113720    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c"} err="failed to get container status \"924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c\": rpc error: code = NotFound desc = could not find container \"924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c\": container with ID starting with 924c8431d43b0177e50436d22ad82b76eb0c48368f46c95066b2e9c09e1c703c not found: ID does not exist"
Jul 08 15:58:55.156225 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.156181    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp" podStartSLOduration=1.156168353 podStartE2EDuration="1.156168353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:55.155221089 +0000 UTC m=+465.490229515" watchObservedRunningTime="2026-07-08 15:58:55.156168353 +0000 UTC m=+465.491176763"
Jul 08 15:58:55.179876 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.179851    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"]
Jul 08 15:58:55.187812 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:55.187791    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ksrx"]
Jul 08 15:58:56.268190 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:58:56.268154    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c135821d-4dc5-442f-a309-f57e373f71fd" path="/var/lib/kubelet/pods/c135821d-4dc5-442f-a309-f57e373f71fd/volumes"
Jul 08 15:59:06.111925 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.111894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 15:59:06.176831 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.176800    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"]
Jul 08 15:59:06.177015 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.176973    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj" podUID="d1647dc6-9f0e-42ef-9645-8cbe3476f999" containerName="manager" containerID="cri-o://ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5" gracePeriod=10
Jul 08 15:59:06.418140 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.418115    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:59:06.468987 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.468964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1647dc6-9f0e-42ef-9645-8cbe3476f999-extensions-socket-volume\") pod \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") "
Jul 08 15:59:06.469129 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.469006    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzkzz\" (UniqueName: \"kubernetes.io/projected/d1647dc6-9f0e-42ef-9645-8cbe3476f999-kube-api-access-nzkzz\") pod \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\" (UID: \"d1647dc6-9f0e-42ef-9645-8cbe3476f999\") "
Jul 08 15:59:06.469353 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.469328    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1647dc6-9f0e-42ef-9645-8cbe3476f999-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d1647dc6-9f0e-42ef-9645-8cbe3476f999" (UID: "d1647dc6-9f0e-42ef-9645-8cbe3476f999"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:59:06.470970 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.470944    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1647dc6-9f0e-42ef-9645-8cbe3476f999-kube-api-access-nzkzz" (OuterVolumeSpecName: "kube-api-access-nzkzz") pod "d1647dc6-9f0e-42ef-9645-8cbe3476f999" (UID: "d1647dc6-9f0e-42ef-9645-8cbe3476f999"). InnerVolumeSpecName "kube-api-access-nzkzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:59:06.570169 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.570140    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1647dc6-9f0e-42ef-9645-8cbe3476f999-extensions-socket-volume\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:59:06.570169 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:06.570163    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzkzz\" (UniqueName: \"kubernetes.io/projected/d1647dc6-9f0e-42ef-9645-8cbe3476f999-kube-api-access-nzkzz\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:59:07.168728 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.168697    2582 generic.go:356] "Generic (PLEG): container finished" podID="d1647dc6-9f0e-42ef-9645-8cbe3476f999" containerID="ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5" exitCode=0
Jul 08 15:59:07.169095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.168742    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"
Jul 08 15:59:07.169095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.168788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj" event={"ID":"d1647dc6-9f0e-42ef-9645-8cbe3476f999","Type":"ContainerDied","Data":"ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5"}
Jul 08 15:59:07.169095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.168835    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj" event={"ID":"d1647dc6-9f0e-42ef-9645-8cbe3476f999","Type":"ContainerDied","Data":"1cc4c20ae0d64ce60c5d749ad06c693f6d3c6dac6a4db84267ac74d9edafdd50"}
Jul 08 15:59:07.169095 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.168857    2582 scope.go:117] "RemoveContainer" containerID="ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5"
Jul 08 15:59:07.177009 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.176995    2582 scope.go:117] "RemoveContainer" containerID="ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5"
Jul 08 15:59:07.177269 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:59:07.177252    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5\": container with ID starting with ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5 not found: ID does not exist" containerID="ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5"
Jul 08 15:59:07.177308 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.177279    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5"} err="failed to get container status \"ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5\": rpc error: code = NotFound desc = could not find container \"ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5\": container with ID starting with ba84bff5da7721c6c335ffce6d9c8fb710d3beff58e28dbc1d733a36b2990ab5 not found: ID does not exist"
Jul 08 15:59:07.199904 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.199882    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"]
Jul 08 15:59:07.205921 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:07.205902    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bnzjj"]
Jul 08 15:59:08.267821 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:08.267788    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1647dc6-9f0e-42ef-9645-8cbe3476f999" path="/var/lib/kubelet/pods/d1647dc6-9f0e-42ef-9645-8cbe3476f999/volumes"
Jul 08 15:59:10.596059 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.596026    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"]
Jul 08 15:59:10.596508 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.596415    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c135821d-4dc5-442f-a309-f57e373f71fd" containerName="manager"
Jul 08 15:59:10.596508 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.596428    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c135821d-4dc5-442f-a309-f57e373f71fd" containerName="manager"
Jul 08 15:59:10.596508 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.596447    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1647dc6-9f0e-42ef-9645-8cbe3476f999" containerName="manager"
Jul 08 15:59:10.596508 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.596453    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1647dc6-9f0e-42ef-9645-8cbe3476f999" containerName="manager"
Jul 08 15:59:10.596508 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.596505    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c135821d-4dc5-442f-a309-f57e373f71fd" containerName="manager"
Jul 08 15:59:10.596785 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.596515    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1647dc6-9f0e-42ef-9645-8cbe3476f999" containerName="manager"
Jul 08 15:59:10.600932 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.600911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.603928 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.603912    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-c8cj7\""
Jul 08 15:59:10.619789 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.619765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"]
Jul 08 15:59:10.702008 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.701978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702008 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702190 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29b314d7-b614-49f8-95d6-50e5e048b850-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702190 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29b314d7-b614-49f8-95d6-50e5e048b850-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702190 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29b314d7-b614-49f8-95d6-50e5e048b850-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702307 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702386 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.702386 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.702337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmsqz\" (UniqueName: \"kubernetes.io/projected/29b314d7-b614-49f8-95d6-50e5e048b850-kube-api-access-tmsqz\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.802895 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.802859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.802895 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.802894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803104 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.802912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmsqz\" (UniqueName: \"kubernetes.io/projected/29b314d7-b614-49f8-95d6-50e5e048b850-kube-api-access-tmsqz\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803165 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803224 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803224 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29b314d7-b614-49f8-95d6-50e5e048b850-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803345 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29b314d7-b614-49f8-95d6-50e5e048b850-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803345 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803444 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29b314d7-b614-49f8-95d6-50e5e048b850-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803495 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803468    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803657 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803629    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.803838 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.803651    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.804049 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.804027    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.804130 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.804067    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29b314d7-b614-49f8-95d6-50e5e048b850-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.805528 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.805501    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29b314d7-b614-49f8-95d6-50e5e048b850-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.805765 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.805744    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29b314d7-b614-49f8-95d6-50e5e048b850-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.816257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.816209    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmsqz\" (UniqueName: \"kubernetes.io/projected/29b314d7-b614-49f8-95d6-50e5e048b850-kube-api-access-tmsqz\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.817305 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.817280    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29b314d7-b614-49f8-95d6-50e5e048b850-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j267w\" (UID: \"29b314d7-b614-49f8-95d6-50e5e048b850\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:10.910439 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:10.910375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:11.046423 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.046398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"]
Jul 08 15:59:11.048825 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:59:11.048798    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b314d7_b614_49f8_95d6_50e5e048b850.slice/crio-ad77e4ec86e91dcbb2b7dcc6a55b30b2c3ed98e87310dff5b316733334717140 WatchSource:0}: Error finding container ad77e4ec86e91dcbb2b7dcc6a55b30b2c3ed98e87310dff5b316733334717140: Status 404 returned error can't find the container with id ad77e4ec86e91dcbb2b7dcc6a55b30b2c3ed98e87310dff5b316733334717140
Jul 08 15:59:11.051029 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.050991    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:59:11.051103 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.051061    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:59:11.051103 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.051093    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 15:59:11.187984 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.187884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" event={"ID":"29b314d7-b614-49f8-95d6-50e5e048b850","Type":"ContainerStarted","Data":"a76a8de926fa7052859a6272438336bb22d0fbad78005e1d7f228ba50182e426"}
Jul 08 15:59:11.187984 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.187950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" event={"ID":"29b314d7-b614-49f8-95d6-50e5e048b850","Type":"ContainerStarted","Data":"ad77e4ec86e91dcbb2b7dcc6a55b30b2c3ed98e87310dff5b316733334717140"}
Jul 08 15:59:11.211977 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.211926    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" podStartSLOduration=1.211910281 podStartE2EDuration="1.211910281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:11.21083135 +0000 UTC m=+481.545839765" watchObservedRunningTime="2026-07-08 15:59:11.211910281 +0000 UTC m=+481.546918693"
Jul 08 15:59:11.911373 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:11.911324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:12.915992 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:12.915957    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:13.197709 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:13.197634    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:13.198641 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:13.198622    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 15:59:24.305519 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.305486    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"]
Jul 08 15:59:24.308967 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.308948    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.311623 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.311601    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 15:59:24.311623 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.311605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9xp52\""
Jul 08 15:59:24.322851 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.322832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"]
Jul 08 15:59:24.400295 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.400239    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"]
Jul 08 15:59:24.414679 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.414644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71a02b9b-b490-4092-b873-8d0e44b9be67-config-file\") pod \"limitador-limitador-64c94fd64f-s4hwt\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.414814 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.414679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76tb\" (UniqueName: \"kubernetes.io/projected/71a02b9b-b490-4092-b873-8d0e44b9be67-kube-api-access-c76tb\") pod \"limitador-limitador-64c94fd64f-s4hwt\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.515980 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.515941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71a02b9b-b490-4092-b873-8d0e44b9be67-config-file\") pod \"limitador-limitador-64c94fd64f-s4hwt\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.516149 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.515985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76tb\" (UniqueName: \"kubernetes.io/projected/71a02b9b-b490-4092-b873-8d0e44b9be67-kube-api-access-c76tb\") pod \"limitador-limitador-64c94fd64f-s4hwt\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.516848 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.516822    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71a02b9b-b490-4092-b873-8d0e44b9be67-config-file\") pod \"limitador-limitador-64c94fd64f-s4hwt\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.525419 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.525386    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76tb\" (UniqueName: \"kubernetes.io/projected/71a02b9b-b490-4092-b873-8d0e44b9be67-kube-api-access-c76tb\") pod \"limitador-limitador-64c94fd64f-s4hwt\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.619386 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.619318    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:24.752021 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:24.751998    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"]
Jul 08 15:59:24.753714 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:59:24.753689    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a02b9b_b490_4092_b873_8d0e44b9be67.slice/crio-2c5bc77ade506a278e4958b989351ae127ba1e6be99615b18bacfae72ccd0e2d WatchSource:0}: Error finding container 2c5bc77ade506a278e4958b989351ae127ba1e6be99615b18bacfae72ccd0e2d: Status 404 returned error can't find the container with id 2c5bc77ade506a278e4958b989351ae127ba1e6be99615b18bacfae72ccd0e2d
Jul 08 15:59:25.256506 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.256449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt" event={"ID":"71a02b9b-b490-4092-b873-8d0e44b9be67","Type":"ContainerStarted","Data":"2c5bc77ade506a278e4958b989351ae127ba1e6be99615b18bacfae72ccd0e2d"}
Jul 08 15:59:25.498192 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.498158    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gm77k"]
Jul 08 15:59:25.502682 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.502660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gm77k"
Jul 08 15:59:25.505363 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.505344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-664lc\""
Jul 08 15:59:25.509874 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.509852    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gm77k"]
Jul 08 15:59:25.627921 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.627891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lpw\" (UniqueName: \"kubernetes.io/projected/ad6f94ff-a610-4eae-8615-70cbd37d1e37-kube-api-access-g9lpw\") pod \"authorino-75d556bd77-gm77k\" (UID: \"ad6f94ff-a610-4eae-8615-70cbd37d1e37\") " pod="kuadrant-system/authorino-75d556bd77-gm77k"
Jul 08 15:59:25.729304 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.729273    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lpw\" (UniqueName: \"kubernetes.io/projected/ad6f94ff-a610-4eae-8615-70cbd37d1e37-kube-api-access-g9lpw\") pod \"authorino-75d556bd77-gm77k\" (UID: \"ad6f94ff-a610-4eae-8615-70cbd37d1e37\") " pod="kuadrant-system/authorino-75d556bd77-gm77k"
Jul 08 15:59:25.738235 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.738206    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lpw\" (UniqueName: \"kubernetes.io/projected/ad6f94ff-a610-4eae-8615-70cbd37d1e37-kube-api-access-g9lpw\") pod \"authorino-75d556bd77-gm77k\" (UID: \"ad6f94ff-a610-4eae-8615-70cbd37d1e37\") " pod="kuadrant-system/authorino-75d556bd77-gm77k"
Jul 08 15:59:25.812527 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:25.812495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gm77k"
Jul 08 15:59:26.001093 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:26.001061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gm77k"]
Jul 08 15:59:26.007058 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:59:26.007006    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad6f94ff_a610_4eae_8615_70cbd37d1e37.slice/crio-ca68e135a54340aa32c646aeee3a2361a40127a6758b2bb651db14731881ace0 WatchSource:0}: Error finding container ca68e135a54340aa32c646aeee3a2361a40127a6758b2bb651db14731881ace0: Status 404 returned error can't find the container with id ca68e135a54340aa32c646aeee3a2361a40127a6758b2bb651db14731881ace0
Jul 08 15:59:26.270133 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:26.270041    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gm77k" event={"ID":"ad6f94ff-a610-4eae-8615-70cbd37d1e37","Type":"ContainerStarted","Data":"ca68e135a54340aa32c646aeee3a2361a40127a6758b2bb651db14731881ace0"}
Jul 08 15:59:30.288482 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:30.288445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt" event={"ID":"71a02b9b-b490-4092-b873-8d0e44b9be67","Type":"ContainerStarted","Data":"0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655"}
Jul 08 15:59:30.288953 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:30.288522    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:30.289801 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:30.289780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gm77k" event={"ID":"ad6f94ff-a610-4eae-8615-70cbd37d1e37","Type":"ContainerStarted","Data":"61b15bcc434e7994275d90b545c735ae0fc013b7cf2b5b8a2fce48231443d938"}
Jul 08 15:59:30.310774 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:30.310731    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt" podStartSLOduration=1.350377019 podStartE2EDuration="6.310714087s" totalImagesPullingTime="4.960337068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:30.31017726 +0000 UTC m=+500.645185670" watchObservedRunningTime="2026-07-08 15:59:30.310714087 +0000 UTC m=+500.645722501"
Jul 08 15:59:30.330371 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:30.330327    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gm77k" podStartSLOduration=1.616156828 podStartE2EDuration="5.330314787s" totalImagesPullingTime="3.714157959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:30.32997346 +0000 UTC m=+500.664981873" watchObservedRunningTime="2026-07-08 15:59:30.330314787 +0000 UTC m=+500.665323197"
Jul 08 15:59:41.064341 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.064307    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"]
Jul 08 15:59:41.064752 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.064494    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt" podUID="71a02b9b-b490-4092-b873-8d0e44b9be67" containerName="limitador" containerID="cri-o://0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655" gracePeriod=30
Jul 08 15:59:41.065188 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.065167    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:41.618689 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.618665    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:41.762765 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.762698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71a02b9b-b490-4092-b873-8d0e44b9be67-config-file\") pod \"71a02b9b-b490-4092-b873-8d0e44b9be67\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") "
Jul 08 15:59:41.762896 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.762769    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c76tb\" (UniqueName: \"kubernetes.io/projected/71a02b9b-b490-4092-b873-8d0e44b9be67-kube-api-access-c76tb\") pod \"71a02b9b-b490-4092-b873-8d0e44b9be67\" (UID: \"71a02b9b-b490-4092-b873-8d0e44b9be67\") "
Jul 08 15:59:41.763089 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.763068    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71a02b9b-b490-4092-b873-8d0e44b9be67-config-file" (OuterVolumeSpecName: "config-file") pod "71a02b9b-b490-4092-b873-8d0e44b9be67" (UID: "71a02b9b-b490-4092-b873-8d0e44b9be67"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:59:41.764744 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.764714    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a02b9b-b490-4092-b873-8d0e44b9be67-kube-api-access-c76tb" (OuterVolumeSpecName: "kube-api-access-c76tb") pod "71a02b9b-b490-4092-b873-8d0e44b9be67" (UID: "71a02b9b-b490-4092-b873-8d0e44b9be67"). InnerVolumeSpecName "kube-api-access-c76tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:59:41.864263 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.864236    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c76tb\" (UniqueName: \"kubernetes.io/projected/71a02b9b-b490-4092-b873-8d0e44b9be67-kube-api-access-c76tb\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:59:41.864263 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:41.864259    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71a02b9b-b490-4092-b873-8d0e44b9be67-config-file\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:59:42.343207 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.343183    2582 generic.go:356] "Generic (PLEG): container finished" podID="71a02b9b-b490-4092-b873-8d0e44b9be67" containerID="0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655" exitCode=0
Jul 08 15:59:42.343541 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.343239    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"
Jul 08 15:59:42.343541 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.343267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt" event={"ID":"71a02b9b-b490-4092-b873-8d0e44b9be67","Type":"ContainerDied","Data":"0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655"}
Jul 08 15:59:42.343541 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.343322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s4hwt" event={"ID":"71a02b9b-b490-4092-b873-8d0e44b9be67","Type":"ContainerDied","Data":"2c5bc77ade506a278e4958b989351ae127ba1e6be99615b18bacfae72ccd0e2d"}
Jul 08 15:59:42.343541 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.343351    2582 scope.go:117] "RemoveContainer" containerID="0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655"
Jul 08 15:59:42.351890 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.351876    2582 scope.go:117] "RemoveContainer" containerID="0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655"
Jul 08 15:59:42.352124 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:59:42.352106    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655\": container with ID starting with 0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655 not found: ID does not exist" containerID="0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655"
Jul 08 15:59:42.352183 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.352131    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655"} err="failed to get container status \"0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655\": rpc error: code = NotFound desc = could not find container \"0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655\": container with ID starting with 0f90aefba7b4fd46c7aa847b676ae4fed5533bfb54fded7bb9695ab58a447655 not found: ID does not exist"
Jul 08 15:59:42.361378 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.361355    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"]
Jul 08 15:59:42.365033 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:42.365015    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s4hwt"]
Jul 08 15:59:44.253943 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.253912    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"]
Jul 08 15:59:44.254302 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.254236    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a02b9b-b490-4092-b873-8d0e44b9be67" containerName="limitador"
Jul 08 15:59:44.254302 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.254247    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a02b9b-b490-4092-b873-8d0e44b9be67" containerName="limitador"
Jul 08 15:59:44.254302 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.254301    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a02b9b-b490-4092-b873-8d0e44b9be67" containerName="limitador"
Jul 08 15:59:44.258512 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.258492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.261279 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.261258    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 15:59:44.261481 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.261466    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cnshp\""
Jul 08 15:59:44.262702 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.262682    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 15:59:44.262785 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.262701    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 15:59:44.270072 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.270050    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71a02b9b-b490-4092-b873-8d0e44b9be67" path="/var/lib/kubelet/pods/71a02b9b-b490-4092-b873-8d0e44b9be67/volumes"
Jul 08 15:59:44.270468 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.270449    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"]
Jul 08 15:59:44.385071 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.385039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tr6c\" (UniqueName: \"kubernetes.io/projected/96d2ccdc-9313-4c5d-9908-3aebf5fc6c81-kube-api-access-4tr6c\") pod \"postgres-69fb4594cf-qf5gx\" (UID: \"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.385245 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.385093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96d2ccdc-9313-4c5d-9908-3aebf5fc6c81-data\") pod \"postgres-69fb4594cf-qf5gx\" (UID: \"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.485637 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.485611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tr6c\" (UniqueName: \"kubernetes.io/projected/96d2ccdc-9313-4c5d-9908-3aebf5fc6c81-kube-api-access-4tr6c\") pod \"postgres-69fb4594cf-qf5gx\" (UID: \"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.485783 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.485664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96d2ccdc-9313-4c5d-9908-3aebf5fc6c81-data\") pod \"postgres-69fb4594cf-qf5gx\" (UID: \"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.485972 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.485957    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96d2ccdc-9313-4c5d-9908-3aebf5fc6c81-data\") pod \"postgres-69fb4594cf-qf5gx\" (UID: \"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.494531 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.494504    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tr6c\" (UniqueName: \"kubernetes.io/projected/96d2ccdc-9313-4c5d-9908-3aebf5fc6c81-kube-api-access-4tr6c\") pod \"postgres-69fb4594cf-qf5gx\" (UID: \"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.569886 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.569855    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:44.698470 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:44.698445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"]
Jul 08 15:59:44.700521 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:59:44.700494    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d2ccdc_9313_4c5d_9908_3aebf5fc6c81.slice/crio-583c4a1c6ad09630f7b314728c944febfbf50d2cb64c2aa59d1f8e2d1e72015c WatchSource:0}: Error finding container 583c4a1c6ad09630f7b314728c944febfbf50d2cb64c2aa59d1f8e2d1e72015c: Status 404 returned error can't find the container with id 583c4a1c6ad09630f7b314728c944febfbf50d2cb64c2aa59d1f8e2d1e72015c
Jul 08 15:59:45.359325 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:45.359292    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx" event={"ID":"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81","Type":"ContainerStarted","Data":"583c4a1c6ad09630f7b314728c944febfbf50d2cb64c2aa59d1f8e2d1e72015c"}
Jul 08 15:59:50.386353 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:50.386320    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx" event={"ID":"96d2ccdc-9313-4c5d-9908-3aebf5fc6c81","Type":"ContainerStarted","Data":"d0a3335c55573a19378075b380e1dc72571588feee3664a9ab2452eac432db7c"}
Jul 08 15:59:50.386739 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:50.386439    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:50.413513 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:50.413472    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx" podStartSLOduration=1.4404344629999999 podStartE2EDuration="6.413459764s" totalImagesPullingTime="4.973025301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:50.412879405 +0000 UTC m=+520.747887816" watchObservedRunningTime="2026-07-08 15:59:50.413459764 +0000 UTC m=+520.748468175"
Jul 08 15:59:56.420540 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:56.420514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qf5gx"
Jul 08 15:59:56.984692 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:56.984659    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dps5b"]
Jul 08 15:59:56.989820 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:56.989799    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dps5b"
Jul 08 15:59:56.998670 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:56.998648    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dps5b"]
Jul 08 15:59:57.081505 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:57.081472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crjd9\" (UniqueName: \"kubernetes.io/projected/9666640d-748d-4280-a7a0-18a0f51479ac-kube-api-access-crjd9\") pod \"authorino-5d4b67c446-dps5b\" (UID: \"9666640d-748d-4280-a7a0-18a0f51479ac\") " pod="kuadrant-system/authorino-5d4b67c446-dps5b"
Jul 08 15:59:57.182796 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:57.182767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crjd9\" (UniqueName: \"kubernetes.io/projected/9666640d-748d-4280-a7a0-18a0f51479ac-kube-api-access-crjd9\") pod \"authorino-5d4b67c446-dps5b\" (UID: \"9666640d-748d-4280-a7a0-18a0f51479ac\") " pod="kuadrant-system/authorino-5d4b67c446-dps5b"
Jul 08 15:59:57.191257 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:57.191233    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crjd9\" (UniqueName: \"kubernetes.io/projected/9666640d-748d-4280-a7a0-18a0f51479ac-kube-api-access-crjd9\") pod \"authorino-5d4b67c446-dps5b\" (UID: \"9666640d-748d-4280-a7a0-18a0f51479ac\") " pod="kuadrant-system/authorino-5d4b67c446-dps5b"
Jul 08 15:59:57.260014 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:57.259952    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dps5b"]
Jul 08 15:59:57.260244 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:57.260230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dps5b"
Jul 08 15:59:57.399676 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:57.399651    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dps5b"]
Jul 08 15:59:57.401777 ip-10-0-132-153 kubenswrapper[2582]: W0708 15:59:57.401749    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9666640d_748d_4280_a7a0_18a0f51479ac.slice/crio-2e26c936dfe7cbafe388a2c24f68b8bcb11773af3c079cb07a0885276a2a02ab WatchSource:0}: Error finding container 2e26c936dfe7cbafe388a2c24f68b8bcb11773af3c079cb07a0885276a2a02ab: Status 404 returned error can't find the container with id 2e26c936dfe7cbafe388a2c24f68b8bcb11773af3c079cb07a0885276a2a02ab
Jul 08 15:59:57.416784 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:57.416756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dps5b" event={"ID":"9666640d-748d-4280-a7a0-18a0f51479ac","Type":"ContainerStarted","Data":"2e26c936dfe7cbafe388a2c24f68b8bcb11773af3c079cb07a0885276a2a02ab"}
Jul 08 15:59:58.423118 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:58.423085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dps5b" event={"ID":"9666640d-748d-4280-a7a0-18a0f51479ac","Type":"ContainerStarted","Data":"dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f"}
Jul 08 15:59:58.423564 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:58.423133    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-dps5b" podUID="9666640d-748d-4280-a7a0-18a0f51479ac" containerName="authorino" containerID="cri-o://dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f" gracePeriod=30
Jul 08 15:59:58.442658 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:58.442607    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-dps5b" podStartSLOduration=1.816869699 podStartE2EDuration="2.442592037s" totalImagesPullingTime="625.722338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:58.442235681 +0000 UTC m=+528.777244105" watchObservedRunningTime="2026-07-08 15:59:58.442592037 +0000 UTC m=+528.777600438"
Jul 08 15:59:58.688268 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:58.688208    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dps5b"
Jul 08 15:59:58.799073 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:58.799041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crjd9\" (UniqueName: \"kubernetes.io/projected/9666640d-748d-4280-a7a0-18a0f51479ac-kube-api-access-crjd9\") pod \"9666640d-748d-4280-a7a0-18a0f51479ac\" (UID: \"9666640d-748d-4280-a7a0-18a0f51479ac\") "
Jul 08 15:59:58.801079 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:58.801047    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9666640d-748d-4280-a7a0-18a0f51479ac-kube-api-access-crjd9" (OuterVolumeSpecName: "kube-api-access-crjd9") pod "9666640d-748d-4280-a7a0-18a0f51479ac" (UID: "9666640d-748d-4280-a7a0-18a0f51479ac"). InnerVolumeSpecName "kube-api-access-crjd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:59:58.899983 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:58.899955    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crjd9\" (UniqueName: \"kubernetes.io/projected/9666640d-748d-4280-a7a0-18a0f51479ac-kube-api-access-crjd9\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 15:59:59.200954 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.200925    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gm77k"]
Jul 08 15:59:59.201114 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.201092    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gm77k" podUID="ad6f94ff-a610-4eae-8615-70cbd37d1e37" containerName="authorino" containerID="cri-o://61b15bcc434e7994275d90b545c735ae0fc013b7cf2b5b8a2fce48231443d938" gracePeriod=30
Jul 08 15:59:59.428942 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.428901    2582 generic.go:356] "Generic (PLEG): container finished" podID="ad6f94ff-a610-4eae-8615-70cbd37d1e37" containerID="61b15bcc434e7994275d90b545c735ae0fc013b7cf2b5b8a2fce48231443d938" exitCode=0
Jul 08 15:59:59.429327 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.428978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gm77k" event={"ID":"ad6f94ff-a610-4eae-8615-70cbd37d1e37","Type":"ContainerDied","Data":"61b15bcc434e7994275d90b545c735ae0fc013b7cf2b5b8a2fce48231443d938"}
Jul 08 15:59:59.430331 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.430307    2582 generic.go:356] "Generic (PLEG): container finished" podID="9666640d-748d-4280-a7a0-18a0f51479ac" containerID="dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f" exitCode=0
Jul 08 15:59:59.430454 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.430367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dps5b" event={"ID":"9666640d-748d-4280-a7a0-18a0f51479ac","Type":"ContainerDied","Data":"dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f"}
Jul 08 15:59:59.430454 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.430377    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dps5b"
Jul 08 15:59:59.430454 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.430408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dps5b" event={"ID":"9666640d-748d-4280-a7a0-18a0f51479ac","Type":"ContainerDied","Data":"2e26c936dfe7cbafe388a2c24f68b8bcb11773af3c079cb07a0885276a2a02ab"}
Jul 08 15:59:59.430454 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.430430    2582 scope.go:117] "RemoveContainer" containerID="dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f"
Jul 08 15:59:59.439394 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.439374    2582 scope.go:117] "RemoveContainer" containerID="dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f"
Jul 08 15:59:59.439692 ip-10-0-132-153 kubenswrapper[2582]: E0708 15:59:59.439669    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f\": container with ID starting with dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f not found: ID does not exist" containerID="dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f"
Jul 08 15:59:59.439783 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.439704    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f"} err="failed to get container status \"dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f\": rpc error: code = NotFound desc = could not find container \"dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f\": container with ID starting with dd0c91d8278a1826b30c8a5b3155a66601d1b6b3631a5ce31e9a6b45a5b8808f not found: ID does not exist"
Jul 08 15:59:59.453067 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.453002    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dps5b"]
Jul 08 15:59:59.458511 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.458490    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dps5b"]
Jul 08 15:59:59.496060 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.496037    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gm77k"
Jul 08 15:59:59.606598 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.606552    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9lpw\" (UniqueName: \"kubernetes.io/projected/ad6f94ff-a610-4eae-8615-70cbd37d1e37-kube-api-access-g9lpw\") pod \"ad6f94ff-a610-4eae-8615-70cbd37d1e37\" (UID: \"ad6f94ff-a610-4eae-8615-70cbd37d1e37\") "
Jul 08 15:59:59.608601 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.608539    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad6f94ff-a610-4eae-8615-70cbd37d1e37-kube-api-access-g9lpw" (OuterVolumeSpecName: "kube-api-access-g9lpw") pod "ad6f94ff-a610-4eae-8615-70cbd37d1e37" (UID: "ad6f94ff-a610-4eae-8615-70cbd37d1e37"). InnerVolumeSpecName "kube-api-access-g9lpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:59:59.707296 ip-10-0-132-153 kubenswrapper[2582]: I0708 15:59:59.707229    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9lpw\" (UniqueName: \"kubernetes.io/projected/ad6f94ff-a610-4eae-8615-70cbd37d1e37-kube-api-access-g9lpw\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:00:00.269735 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:00.269700    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9666640d-748d-4280-a7a0-18a0f51479ac" path="/var/lib/kubelet/pods/9666640d-748d-4280-a7a0-18a0f51479ac/volumes"
Jul 08 16:00:00.436021 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:00.435992    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gm77k"
Jul 08 16:00:00.436449 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:00.436027    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gm77k" event={"ID":"ad6f94ff-a610-4eae-8615-70cbd37d1e37","Type":"ContainerDied","Data":"ca68e135a54340aa32c646aeee3a2361a40127a6758b2bb651db14731881ace0"}
Jul 08 16:00:00.436449 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:00.436076    2582 scope.go:117] "RemoveContainer" containerID="61b15bcc434e7994275d90b545c735ae0fc013b7cf2b5b8a2fce48231443d938"
Jul 08 16:00:00.453210 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:00.453179    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gm77k"]
Jul 08 16:00:00.455404 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:00.455379    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gm77k"]
Jul 08 16:00:02.268778 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:02.268707    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad6f94ff-a610-4eae-8615-70cbd37d1e37" path="/var/lib/kubelet/pods/ad6f94ff-a610-4eae-8615-70cbd37d1e37/volumes"
Jul 08 16:00:03.703337 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.703306    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-589c8fb594-drd2n"]
Jul 08 16:00:03.703732 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.703688    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9666640d-748d-4280-a7a0-18a0f51479ac" containerName="authorino"
Jul 08 16:00:03.703732 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.703701    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9666640d-748d-4280-a7a0-18a0f51479ac" containerName="authorino"
Jul 08 16:00:03.703732 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.703718    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad6f94ff-a610-4eae-8615-70cbd37d1e37" containerName="authorino"
Jul 08 16:00:03.703732 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.703724    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad6f94ff-a610-4eae-8615-70cbd37d1e37" containerName="authorino"
Jul 08 16:00:03.703854 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.703780    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad6f94ff-a610-4eae-8615-70cbd37d1e37" containerName="authorino"
Jul 08 16:00:03.703854 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.703787    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9666640d-748d-4280-a7a0-18a0f51479ac" containerName="authorino"
Jul 08 16:00:03.884207 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.884174    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-589c8fb594-drd2n"]
Jul 08 16:00:03.884374 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.884275    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:03.886884 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.886858    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 16:00:03.887035 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.886898    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 16:00:03.887035 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.886932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fjwvt\""
Jul 08 16:00:03.895365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.895336    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78b877666-xrnjw"]
Jul 08 16:00:03.898162 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.898144    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:03.908951 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.908929    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b877666-xrnjw"]
Jul 08 16:00:03.946646 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.946618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrcwh\" (UniqueName: \"kubernetes.io/projected/5bf5a5b8-bfed-4c73-973b-0d79af747709-kube-api-access-wrcwh\") pod \"maas-controller-589c8fb594-drd2n\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") " pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:03.946768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.946655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srdbw\" (UniqueName: \"kubernetes.io/projected/c6ffaa59-5910-48c0-a838-01c92879fca2-kube-api-access-srdbw\") pod \"maas-controller-78b877666-xrnjw\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") " pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:03.946768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.946716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert\") pod \"maas-controller-78b877666-xrnjw\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") " pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:03.946768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:03.946749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert\") pod \"maas-controller-589c8fb594-drd2n\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") " pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:04.047346 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.047281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrcwh\" (UniqueName: \"kubernetes.io/projected/5bf5a5b8-bfed-4c73-973b-0d79af747709-kube-api-access-wrcwh\") pod \"maas-controller-589c8fb594-drd2n\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") " pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:04.047346 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.047314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srdbw\" (UniqueName: \"kubernetes.io/projected/c6ffaa59-5910-48c0-a838-01c92879fca2-kube-api-access-srdbw\") pod \"maas-controller-78b877666-xrnjw\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") " pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:04.047346 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.047340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert\") pod \"maas-controller-78b877666-xrnjw\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") " pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:04.047604 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.047360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert\") pod \"maas-controller-589c8fb594-drd2n\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") " pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:04.047604 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:00:04.047460    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 16:00:04.047604 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:00:04.047460    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 16:00:04.047604 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:00:04.047518    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert podName:c6ffaa59-5910-48c0-a838-01c92879fca2 nodeName:}" failed. No retries permitted until 2026-07-08 16:00:04.547503075 +0000 UTC m=+534.882511469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert") pod "maas-controller-78b877666-xrnjw" (UID: "c6ffaa59-5910-48c0-a838-01c92879fca2") : secret "maas-controller-webhook-cert" not found
Jul 08 16:00:04.047792 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:00:04.047624    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert podName:5bf5a5b8-bfed-4c73-973b-0d79af747709 nodeName:}" failed. No retries permitted until 2026-07-08 16:00:04.547604028 +0000 UTC m=+534.882612430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert") pod "maas-controller-589c8fb594-drd2n" (UID: "5bf5a5b8-bfed-4c73-973b-0d79af747709") : secret "maas-controller-webhook-cert" not found
Jul 08 16:00:04.056642 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.056623    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srdbw\" (UniqueName: \"kubernetes.io/projected/c6ffaa59-5910-48c0-a838-01c92879fca2-kube-api-access-srdbw\") pod \"maas-controller-78b877666-xrnjw\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") " pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:04.056865 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.056847    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrcwh\" (UniqueName: \"kubernetes.io/projected/5bf5a5b8-bfed-4c73-973b-0d79af747709-kube-api-access-wrcwh\") pod \"maas-controller-589c8fb594-drd2n\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") " pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:04.551906 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.551873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert\") pod \"maas-controller-78b877666-xrnjw\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") " pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:04.552082 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.551915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert\") pod \"maas-controller-589c8fb594-drd2n\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") " pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:04.554596 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.554545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert\") pod \"maas-controller-78b877666-xrnjw\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") " pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:04.554869 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.554599    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert\") pod \"maas-controller-589c8fb594-drd2n\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") " pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:04.797645 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.797601    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:04.808322 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.808299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:04.937151 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.937122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-589c8fb594-drd2n"]
Jul 08 16:00:04.939829 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:00:04.939790    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf5a5b8_bfed_4c73_973b_0d79af747709.slice/crio-a1e42171c3a7b3e73763807813e1e83a23017e6fee04f90682312ca9ab1fca59 WatchSource:0}: Error finding container a1e42171c3a7b3e73763807813e1e83a23017e6fee04f90682312ca9ab1fca59: Status 404 returned error can't find the container with id a1e42171c3a7b3e73763807813e1e83a23017e6fee04f90682312ca9ab1fca59
Jul 08 16:00:04.962154 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:04.962129    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b877666-xrnjw"]
Jul 08 16:00:04.964372 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:00:04.964337    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ffaa59_5910_48c0_a838_01c92879fca2.slice/crio-75c4a1592fc827ae53c044b745828062853ad931c98bc35c811436ebe36a0ce9 WatchSource:0}: Error finding container 75c4a1592fc827ae53c044b745828062853ad931c98bc35c811436ebe36a0ce9: Status 404 returned error can't find the container with id 75c4a1592fc827ae53c044b745828062853ad931c98bc35c811436ebe36a0ce9
Jul 08 16:00:05.463859 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:05.463826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b877666-xrnjw" event={"ID":"c6ffaa59-5910-48c0-a838-01c92879fca2","Type":"ContainerStarted","Data":"75c4a1592fc827ae53c044b745828062853ad931c98bc35c811436ebe36a0ce9"}
Jul 08 16:00:05.464944 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:05.464919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589c8fb594-drd2n" event={"ID":"5bf5a5b8-bfed-4c73-973b-0d79af747709","Type":"ContainerStarted","Data":"a1e42171c3a7b3e73763807813e1e83a23017e6fee04f90682312ca9ab1fca59"}
Jul 08 16:00:07.475506 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:07.475425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589c8fb594-drd2n" event={"ID":"5bf5a5b8-bfed-4c73-973b-0d79af747709","Type":"ContainerStarted","Data":"c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222"}
Jul 08 16:00:07.475971 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:07.475542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:07.476976 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:07.476937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b877666-xrnjw" event={"ID":"c6ffaa59-5910-48c0-a838-01c92879fca2","Type":"ContainerStarted","Data":"71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4"}
Jul 08 16:00:07.477098 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:07.477082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:07.508836 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:07.508790    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-589c8fb594-drd2n" podStartSLOduration=2.359663378 podStartE2EDuration="4.508774243s" totalImagesPullingTime="2.149110865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:07.507951012 +0000 UTC m=+537.842959436" watchObservedRunningTime="2026-07-08 16:00:07.508774243 +0000 UTC m=+537.843782688"
Jul 08 16:00:07.538101 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:07.538050    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78b877666-xrnjw" podStartSLOduration=2.410987284 podStartE2EDuration="4.538032343s" totalImagesPullingTime="2.127045059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:07.535866993 +0000 UTC m=+537.870875415" watchObservedRunningTime="2026-07-08 16:00:07.538032343 +0000 UTC m=+537.873040758"
Jul 08 16:00:18.487492 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.487459    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:00:18.487961 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.487660    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:18.575544 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.575517    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-589c8fb594-drd2n"]
Jul 08 16:00:18.575745 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.575725    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-589c8fb594-drd2n" podUID="5bf5a5b8-bfed-4c73-973b-0d79af747709" containerName="manager" containerID="cri-o://c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222" gracePeriod=30
Jul 08 16:00:18.811231 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.811207    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:18.867514 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.867489    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert\") pod \"5bf5a5b8-bfed-4c73-973b-0d79af747709\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") "
Jul 08 16:00:18.867664 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.867550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrcwh\" (UniqueName: \"kubernetes.io/projected/5bf5a5b8-bfed-4c73-973b-0d79af747709-kube-api-access-wrcwh\") pod \"5bf5a5b8-bfed-4c73-973b-0d79af747709\" (UID: \"5bf5a5b8-bfed-4c73-973b-0d79af747709\") "
Jul 08 16:00:18.869624 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.869599    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5bf5a5b8-bfed-4c73-973b-0d79af747709" (UID: "5bf5a5b8-bfed-4c73-973b-0d79af747709"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:00:18.869709 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.869648    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf5a5b8-bfed-4c73-973b-0d79af747709-kube-api-access-wrcwh" (OuterVolumeSpecName: "kube-api-access-wrcwh") pod "5bf5a5b8-bfed-4c73-973b-0d79af747709" (UID: "5bf5a5b8-bfed-4c73-973b-0d79af747709"). InnerVolumeSpecName "kube-api-access-wrcwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:00:18.969118 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.969090    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf5a5b8-bfed-4c73-973b-0d79af747709-webhook-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:00:18.969118 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:18.969114    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrcwh\" (UniqueName: \"kubernetes.io/projected/5bf5a5b8-bfed-4c73-973b-0d79af747709-kube-api-access-wrcwh\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:00:19.533834 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.533800    2582 generic.go:356] "Generic (PLEG): container finished" podID="5bf5a5b8-bfed-4c73-973b-0d79af747709" containerID="c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222" exitCode=0
Jul 08 16:00:19.534264 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.533864    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589c8fb594-drd2n"
Jul 08 16:00:19.534264 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.533885    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589c8fb594-drd2n" event={"ID":"5bf5a5b8-bfed-4c73-973b-0d79af747709","Type":"ContainerDied","Data":"c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222"}
Jul 08 16:00:19.534264 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.533982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589c8fb594-drd2n" event={"ID":"5bf5a5b8-bfed-4c73-973b-0d79af747709","Type":"ContainerDied","Data":"a1e42171c3a7b3e73763807813e1e83a23017e6fee04f90682312ca9ab1fca59"}
Jul 08 16:00:19.534264 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.534014    2582 scope.go:117] "RemoveContainer" containerID="c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222"
Jul 08 16:00:19.542398 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.542376    2582 scope.go:117] "RemoveContainer" containerID="c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222"
Jul 08 16:00:19.542698 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:00:19.542679    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222\": container with ID starting with c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222 not found: ID does not exist" containerID="c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222"
Jul 08 16:00:19.542769 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.542705    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222"} err="failed to get container status \"c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222\": rpc error: code = NotFound desc = could not find container \"c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222\": container with ID starting with c8db3da2a07c804f8038655ee7560c44189e9b672e825c8301898a3dc2d1d222 not found: ID does not exist"
Jul 08 16:00:19.556272 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.556249    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-589c8fb594-drd2n"]
Jul 08 16:00:19.560137 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:19.560118    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-589c8fb594-drd2n"]
Jul 08 16:00:20.269472 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:20.269445    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf5a5b8-bfed-4c73-973b-0d79af747709" path="/var/lib/kubelet/pods/5bf5a5b8-bfed-4c73-973b-0d79af747709/volumes"
Jul 08 16:00:40.296980 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.296945    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"]
Jul 08 16:00:40.297407 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.297293    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf5a5b8-bfed-4c73-973b-0d79af747709" containerName="manager"
Jul 08 16:00:40.297407 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.297304    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf5a5b8-bfed-4c73-973b-0d79af747709" containerName="manager"
Jul 08 16:00:40.297407 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.297356    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf5a5b8-bfed-4c73-973b-0d79af747709" containerName="manager"
Jul 08 16:00:40.299820 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.299803    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.303012 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.302989    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4gvf8\""
Jul 08 16:00:40.303297 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.303281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 16:00:40.317210 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.317184    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"]
Jul 08 16:00:40.450190 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.450156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd91527-98ce-44f3-b211-67d691d1cf27-openshift-service-ca\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.450364 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.450268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fd91527-98ce-44f3-b211-67d691d1cf27-maas-api-tls\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.450364 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.450311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbbd\" (UniqueName: \"kubernetes.io/projected/3fd91527-98ce-44f3-b211-67d691d1cf27-kube-api-access-tmbbd\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.551432 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.551349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbbd\" (UniqueName: \"kubernetes.io/projected/3fd91527-98ce-44f3-b211-67d691d1cf27-kube-api-access-tmbbd\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.551432 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.551394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd91527-98ce-44f3-b211-67d691d1cf27-openshift-service-ca\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.551657 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.551450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fd91527-98ce-44f3-b211-67d691d1cf27-maas-api-tls\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.552175 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.552156    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fd91527-98ce-44f3-b211-67d691d1cf27-openshift-service-ca\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.553872 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.553854    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fd91527-98ce-44f3-b211-67d691d1cf27-maas-api-tls\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.568552 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.568525    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbbd\" (UniqueName: \"kubernetes.io/projected/3fd91527-98ce-44f3-b211-67d691d1cf27-kube-api-access-tmbbd\") pod \"maas-api-94dd5bb54-g2npc\" (UID: \"3fd91527-98ce-44f3-b211-67d691d1cf27\") " pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.610380 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.610356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:40.745888 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.745836    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"]
Jul 08 16:00:40.748695 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:00:40.748655    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd91527_98ce_44f3_b211_67d691d1cf27.slice/crio-12f18687b4788897720ab97a65643a403b005bccf082d0debdab92116e95ce5d WatchSource:0}: Error finding container 12f18687b4788897720ab97a65643a403b005bccf082d0debdab92116e95ce5d: Status 404 returned error can't find the container with id 12f18687b4788897720ab97a65643a403b005bccf082d0debdab92116e95ce5d
Jul 08 16:00:40.934567 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.934490    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-kgfvb"]
Jul 08 16:00:40.937531 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.937504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:40.940674 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.940654    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 16:00:40.948422 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.948400    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-kgfvb"]
Jul 08 16:00:40.974837 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.974809    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-szn5n"]
Jul 08 16:00:40.977190 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.977175    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:40.980215 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.980197    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-q44kl\""
Jul 08 16:00:40.988174 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:40.988154    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-szn5n"]
Jul 08 16:00:41.055370 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.055341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5kck\" (UniqueName: \"kubernetes.io/projected/14a1415d-1d25-452a-8149-10ac569fd603-kube-api-access-q5kck\") pod \"payload-pre-processing-7964457696-kgfvb\" (UID: \"14a1415d-1d25-452a-8149-10ac569fd603\") " pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:41.055520 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.055426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a1415d-1d25-452a-8149-10ac569fd603-plugins-config-volume\") pod \"payload-pre-processing-7964457696-kgfvb\" (UID: \"14a1415d-1d25-452a-8149-10ac569fd603\") " pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:41.156659 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.156616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5kck\" (UniqueName: \"kubernetes.io/projected/14a1415d-1d25-452a-8149-10ac569fd603-kube-api-access-q5kck\") pod \"payload-pre-processing-7964457696-kgfvb\" (UID: \"14a1415d-1d25-452a-8149-10ac569fd603\") " pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:41.156879 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.156703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh68c\" (UniqueName: \"kubernetes.io/projected/f1da2a09-6206-4b59-9b01-fca48acd1097-kube-api-access-xh68c\") pod \"payload-processing-58f86c7798-szn5n\" (UID: \"f1da2a09-6206-4b59-9b01-fca48acd1097\") " pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:41.156879 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.156737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1da2a09-6206-4b59-9b01-fca48acd1097-plugins-config-volume\") pod \"payload-processing-58f86c7798-szn5n\" (UID: \"f1da2a09-6206-4b59-9b01-fca48acd1097\") " pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:41.156879 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.156769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a1415d-1d25-452a-8149-10ac569fd603-plugins-config-volume\") pod \"payload-pre-processing-7964457696-kgfvb\" (UID: \"14a1415d-1d25-452a-8149-10ac569fd603\") " pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:41.157462 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.157443    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a1415d-1d25-452a-8149-10ac569fd603-plugins-config-volume\") pod \"payload-pre-processing-7964457696-kgfvb\" (UID: \"14a1415d-1d25-452a-8149-10ac569fd603\") " pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:41.165458 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.165434    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5kck\" (UniqueName: \"kubernetes.io/projected/14a1415d-1d25-452a-8149-10ac569fd603-kube-api-access-q5kck\") pod \"payload-pre-processing-7964457696-kgfvb\" (UID: \"14a1415d-1d25-452a-8149-10ac569fd603\") " pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:41.249135 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.249059    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:41.259944 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.259848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1da2a09-6206-4b59-9b01-fca48acd1097-plugins-config-volume\") pod \"payload-processing-58f86c7798-szn5n\" (UID: \"f1da2a09-6206-4b59-9b01-fca48acd1097\") " pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:41.260041 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.260020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh68c\" (UniqueName: \"kubernetes.io/projected/f1da2a09-6206-4b59-9b01-fca48acd1097-kube-api-access-xh68c\") pod \"payload-processing-58f86c7798-szn5n\" (UID: \"f1da2a09-6206-4b59-9b01-fca48acd1097\") " pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:41.260805 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.260785    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1da2a09-6206-4b59-9b01-fca48acd1097-plugins-config-volume\") pod \"payload-processing-58f86c7798-szn5n\" (UID: \"f1da2a09-6206-4b59-9b01-fca48acd1097\") " pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:41.268506 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.268482    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh68c\" (UniqueName: \"kubernetes.io/projected/f1da2a09-6206-4b59-9b01-fca48acd1097-kube-api-access-xh68c\") pod \"payload-processing-58f86c7798-szn5n\" (UID: \"f1da2a09-6206-4b59-9b01-fca48acd1097\") " pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:41.287223 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.287202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:41.421055 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.420977    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-kgfvb"]
Jul 08 16:00:41.423091 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:00:41.423039    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a1415d_1d25_452a_8149_10ac569fd603.slice/crio-263751f2f7b428c95db8e4494192423a441a87bf4c7c6a2f6e7b446182e73f40 WatchSource:0}: Error finding container 263751f2f7b428c95db8e4494192423a441a87bf4c7c6a2f6e7b446182e73f40: Status 404 returned error can't find the container with id 263751f2f7b428c95db8e4494192423a441a87bf4c7c6a2f6e7b446182e73f40
Jul 08 16:00:41.444082 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.444064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-szn5n"]
Jul 08 16:00:41.445842 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:00:41.445820    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1da2a09_6206_4b59_9b01_fca48acd1097.slice/crio-da1fd61f0e9150f9c8299b19d05d6ccb0f51ed14fb9c61d95c94acb2a358d261 WatchSource:0}: Error finding container da1fd61f0e9150f9c8299b19d05d6ccb0f51ed14fb9c61d95c94acb2a358d261: Status 404 returned error can't find the container with id da1fd61f0e9150f9c8299b19d05d6ccb0f51ed14fb9c61d95c94acb2a358d261
Jul 08 16:00:41.635982 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.635949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb" event={"ID":"14a1415d-1d25-452a-8149-10ac569fd603","Type":"ContainerStarted","Data":"263751f2f7b428c95db8e4494192423a441a87bf4c7c6a2f6e7b446182e73f40"}
Jul 08 16:00:41.637141 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.637120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc" event={"ID":"3fd91527-98ce-44f3-b211-67d691d1cf27","Type":"ContainerStarted","Data":"12f18687b4788897720ab97a65643a403b005bccf082d0debdab92116e95ce5d"}
Jul 08 16:00:41.638165 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:41.638143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-szn5n" event={"ID":"f1da2a09-6206-4b59-9b01-fca48acd1097","Type":"ContainerStarted","Data":"da1fd61f0e9150f9c8299b19d05d6ccb0f51ed14fb9c61d95c94acb2a358d261"}
Jul 08 16:00:43.652997 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.652949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb" event={"ID":"14a1415d-1d25-452a-8149-10ac569fd603","Type":"ContainerStarted","Data":"2851eef630704d25e1b276c21d66eb1e4d28c6d8f1f39316c6cecbf65ecd455c"}
Jul 08 16:00:43.653906 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.653878    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:00:43.655651 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.655618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc" event={"ID":"3fd91527-98ce-44f3-b211-67d691d1cf27","Type":"ContainerStarted","Data":"290174c572854e91ea836c894942caadd6ec8ef8e876224e466afcd22154fbb6"}
Jul 08 16:00:43.656196 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.656170    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:43.658003 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.657980    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-szn5n" event={"ID":"f1da2a09-6206-4b59-9b01-fca48acd1097","Type":"ContainerStarted","Data":"45b649ebe461abe5bbe5fbfae6933d8716aaa0a836b1f95df32100e09a839e36"}
Jul 08 16:00:43.658306 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.658263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:43.672301 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.672251    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb" podStartSLOduration=1.840263426 podStartE2EDuration="3.672232009s" totalImagesPullingTime="1.831968583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:43.66962284 +0000 UTC m=+574.004631242" watchObservedRunningTime="2026-07-08 16:00:43.672232009 +0000 UTC m=+574.007240424"
Jul 08 16:00:43.689791 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.689734    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc" podStartSLOduration=1.196243255 podStartE2EDuration="3.689716558s" totalImagesPullingTime="2.493473303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:43.686539665 +0000 UTC m=+574.021548077" watchObservedRunningTime="2026-07-08 16:00:43.689716558 +0000 UTC m=+574.024724972"
Jul 08 16:00:43.702707 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:43.702660    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-szn5n" podStartSLOduration=1.905699814 podStartE2EDuration="3.70264718s" totalImagesPullingTime="1.796947366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:43.700998545 +0000 UTC m=+574.036006958" watchObservedRunningTime="2026-07-08 16:00:43.70264718 +0000 UTC m=+574.037655590"
Jul 08 16:00:49.688250 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:49.688220    2582 generic.go:356] "Generic (PLEG): container finished" podID="29b314d7-b614-49f8-95d6-50e5e048b850" containerID="a76a8de926fa7052859a6272438336bb22d0fbad78005e1d7f228ba50182e426" exitCode=0
Jul 08 16:00:49.688573 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:49.688300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" event={"ID":"29b314d7-b614-49f8-95d6-50e5e048b850","Type":"ContainerDied","Data":"a76a8de926fa7052859a6272438336bb22d0fbad78005e1d7f228ba50182e426"}
Jul 08 16:00:49.688728 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:49.688714    2582 scope.go:117] "RemoveContainer" containerID="a76a8de926fa7052859a6272438336bb22d0fbad78005e1d7f228ba50182e426"
Jul 08 16:00:49.689799 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:49.689773    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:00:49.689869 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:49.689844    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:00:49.689913 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:49.689878    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:00:50.675427 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:50.675353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-94dd5bb54-g2npc"
Jul 08 16:00:50.695450 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:50.695422    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" event={"ID":"29b314d7-b614-49f8-95d6-50e5e048b850","Type":"ContainerStarted","Data":"2e9276ff2b783b2693c0937906101c0fd82437c9012eddf84a703c4141a82471"}
Jul 08 16:00:50.910913 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:50.910868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 16:00:50.911218 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:50.911195    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j267w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 16:00:50.911313 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:50.911249    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" podUID="29b314d7-b614-49f8-95d6-50e5e048b850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 16:00:51.911388 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:51.911352    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j267w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 16:00:51.911804 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:51.911403    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" podUID="29b314d7-b614-49f8-95d6-50e5e048b850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 16:00:52.910969 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:52.910895    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j267w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 16:00:52.911132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:52.910973    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" podUID="29b314d7-b614-49f8-95d6-50e5e048b850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 16:00:53.911572 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:53.911535    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j267w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 16:00:53.911962 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:53.911618    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w" podUID="29b314d7-b614-49f8-95d6-50e5e048b850" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 16:00:54.667017 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:54.666982    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-szn5n"
Jul 08 16:00:54.915056 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:54.915028    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 16:00:54.915458 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:54.915411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 16:00:54.916204 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:54.916184    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j267w"
Jul 08 16:00:55.670967 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:00:55.670941    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-kgfvb"
Jul 08 16:01:13.774107 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.774074    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"]
Jul 08 16:01:13.776964 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.776946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.780251 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.780230    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gjc5h\""
Jul 08 16:01:13.780251 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.780239    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 16:01:13.780433 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.780253    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 16:01:13.780433 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.780246    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 16:01:13.790183 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.790163    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"]
Jul 08 16:01:13.836731 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.836701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.836731 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.836732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmj8\" (UniqueName: \"kubernetes.io/projected/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-kube-api-access-slmj8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.836943 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.836765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.836943 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.836873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.836943 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.836925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.837078 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.836971    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938379 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938531 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938531 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938531 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938531 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmj8\" (UniqueName: \"kubernetes.io/projected/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-kube-api-access-slmj8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938531 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938870 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938843    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938981 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938900    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.938981 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.938967    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.940547 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.940527    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.940911 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.940892    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:13.951403 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:13.951383    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmj8\" (UniqueName: \"kubernetes.io/projected/bd94ff07-bb2c-4b9e-b39f-275ea79d6f68-kube-api-access-slmj8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sz5xc\" (UID: \"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:14.087529 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:14.087499    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:14.222787 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:14.222762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"]
Jul 08 16:01:14.224210 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:01:14.224185    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd94ff07_bb2c_4b9e_b39f_275ea79d6f68.slice/crio-ecfd18f239c4c3adc5879dd3658c077adaeb0d4ad6fd5b2a9b00c7c1e434efba WatchSource:0}: Error finding container ecfd18f239c4c3adc5879dd3658c077adaeb0d4ad6fd5b2a9b00c7c1e434efba: Status 404 returned error can't find the container with id ecfd18f239c4c3adc5879dd3658c077adaeb0d4ad6fd5b2a9b00c7c1e434efba
Jul 08 16:01:14.811094 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:14.811060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc" event={"ID":"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68","Type":"ContainerStarted","Data":"ecfd18f239c4c3adc5879dd3658c077adaeb0d4ad6fd5b2a9b00c7c1e434efba"}
Jul 08 16:01:24.860877 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:24.860841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc" event={"ID":"bd94ff07-bb2c-4b9e-b39f-275ea79d6f68","Type":"ContainerStarted","Data":"358b6090f0fb96e02fb5ec83067a4af6c1f3b2279f35edab8581a0ddcb995686"}
Jul 08 16:01:24.881270 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:24.881223    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc" podStartSLOduration=1.862404591 podStartE2EDuration="11.881208444s" totalImagesPullingTime="10.018803853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:24.880904566 +0000 UTC m=+615.215912977" watchObservedRunningTime="2026-07-08 16:01:24.881208444 +0000 UTC m=+615.216216877"
Jul 08 16:01:29.893710 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.893674    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"]
Jul 08 16:01:29.898035 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.898016    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:29.900644 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.900615    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 16:01:29.910150 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.910116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"]
Jul 08 16:01:29.972873 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.972842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:29.973041 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.972897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:29.973041 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.972959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:29.973041 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.972993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0992665a-875a-473f-8ced-f03fb04ba6df-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:29.973200 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.973051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf7d8\" (UniqueName: \"kubernetes.io/projected/0992665a-875a-473f-8ced-f03fb04ba6df-kube-api-access-nf7d8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:29.973200 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:29.973107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.074519 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.074484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.074737 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.074605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.074737 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.074689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0992665a-875a-473f-8ced-f03fb04ba6df-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.074867 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.074736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf7d8\" (UniqueName: \"kubernetes.io/projected/0992665a-875a-473f-8ced-f03fb04ba6df-kube-api-access-nf7d8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.074867 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.074801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.074867 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.074840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.075011 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.074974    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.075296 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.075244    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.075452 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.075384    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.077490 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.077463    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0992665a-875a-473f-8ced-f03fb04ba6df-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.077593 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.077530    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0992665a-875a-473f-8ced-f03fb04ba6df-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.083710 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.083689    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf7d8\" (UniqueName: \"kubernetes.io/projected/0992665a-875a-473f-8ced-f03fb04ba6df-kube-api-access-nf7d8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wdn8\" (UID: \"0992665a-875a-473f-8ced-f03fb04ba6df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.208853 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.208778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:30.347515 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.347484    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"]
Jul 08 16:01:30.349693 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:01:30.349667    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0992665a_875a_473f_8ced_f03fb04ba6df.slice/crio-2a30f2b988bfcb13ad7f1614f1115b83ccf24120aa151365f16edeccfaa63ed6 WatchSource:0}: Error finding container 2a30f2b988bfcb13ad7f1614f1115b83ccf24120aa151365f16edeccfaa63ed6: Status 404 returned error can't find the container with id 2a30f2b988bfcb13ad7f1614f1115b83ccf24120aa151365f16edeccfaa63ed6
Jul 08 16:01:30.351103 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.351085    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:01:30.891722 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.891682    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8" event={"ID":"0992665a-875a-473f-8ced-f03fb04ba6df","Type":"ContainerStarted","Data":"611e98264167412a7b4f4bf44874237b4a7a18e834bf2574fb08da74f5167f8d"}
Jul 08 16:01:30.891876 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.891747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8" event={"ID":"0992665a-875a-473f-8ced-f03fb04ba6df","Type":"ContainerStarted","Data":"2a30f2b988bfcb13ad7f1614f1115b83ccf24120aa151365f16edeccfaa63ed6"}
Jul 08 16:01:30.910803 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:30.910759    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8" podStartSLOduration=1.475289435 podStartE2EDuration="1.910744382s" totalImagesPullingTime="435.454947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:30.909828307 +0000 UTC m=+621.244836718" watchObservedRunningTime="2026-07-08 16:01:30.910744382 +0000 UTC m=+621.245752823"
Jul 08 16:01:34.088291 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:34.088202    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:34.088291 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:34.088275    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:34.100691 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:34.100671    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:34.925001 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:34.924971    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sz5xc"
Jul 08 16:01:40.209225 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:40.209174    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:40.209671 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:40.209271    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:40.221689 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:40.221659    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:01:40.951210 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:01:40.951185    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wdn8"
Jul 08 16:02:01.583106 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.583064    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"]
Jul 08 16:02:01.587115 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.587090    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.589868 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.589838    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 16:02:01.598199 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.598175    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"]
Jul 08 16:02:01.648687 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.648662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/997b87d2-7712-4a43-a267-acd93f88caf4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.648828 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.648700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.648828 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.648718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.648828 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.648742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.648947 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.648827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62zhf\" (UniqueName: \"kubernetes.io/projected/997b87d2-7712-4a43-a267-acd93f88caf4-kube-api-access-62zhf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.648947 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.648868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.749946 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.749903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750143 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62zhf\" (UniqueName: \"kubernetes.io/projected/997b87d2-7712-4a43-a267-acd93f88caf4-kube-api-access-62zhf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750211 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750265 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/997b87d2-7712-4a43-a267-acd93f88caf4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750319 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750564 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750689 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750653    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750790 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750766    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.750951 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.750918    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.753310 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.753274    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/997b87d2-7712-4a43-a267-acd93f88caf4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.753517 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.753490    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/997b87d2-7712-4a43-a267-acd93f88caf4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.762976 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.762947    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62zhf\" (UniqueName: \"kubernetes.io/projected/997b87d2-7712-4a43-a267-acd93f88caf4-kube-api-access-62zhf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q\" (UID: \"997b87d2-7712-4a43-a267-acd93f88caf4\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:01.899416 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:01.899334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:02.032354 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:02.032312    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"]
Jul 08 16:02:02.034819 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:02:02.034792    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod997b87d2_7712_4a43_a267_acd93f88caf4.slice/crio-5a6dbcc801d2f47932fe307088a023e0f71154a534bec65f4a453cad4d222744 WatchSource:0}: Error finding container 5a6dbcc801d2f47932fe307088a023e0f71154a534bec65f4a453cad4d222744: Status 404 returned error can't find the container with id 5a6dbcc801d2f47932fe307088a023e0f71154a534bec65f4a453cad4d222744
Jul 08 16:02:02.042132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:02.042102    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q" event={"ID":"997b87d2-7712-4a43-a267-acd93f88caf4","Type":"ContainerStarted","Data":"5a6dbcc801d2f47932fe307088a023e0f71154a534bec65f4a453cad4d222744"}
Jul 08 16:02:03.048280 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:03.048228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q" event={"ID":"997b87d2-7712-4a43-a267-acd93f88caf4","Type":"ContainerStarted","Data":"5e715e95e2e7884baad1f355c335e682574e16ea09f2109a390876395ccc0d90"}
Jul 08 16:02:03.067756 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:03.067710    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q" podStartSLOduration=1.8707340970000002 podStartE2EDuration="2.067695247s" totalImagesPullingTime="196.96115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:03.065530232 +0000 UTC m=+653.400538645" watchObservedRunningTime="2026-07-08 16:02:03.067695247 +0000 UTC m=+653.402703657"
Jul 08 16:02:11.900018 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:11.899984    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:11.900387 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:11.900029    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:11.912501 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:11.912471    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:02:12.101853 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:02:12.101827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q"
Jul 08 16:04:41.479021 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.478943    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b877666-xrnjw"]
Jul 08 16:04:41.479612 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.479153    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-78b877666-xrnjw" podUID="c6ffaa59-5910-48c0-a838-01c92879fca2" containerName="manager" containerID="cri-o://71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4" gracePeriod=30
Jul 08 16:04:41.728052 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.728030    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:04:41.819381 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.819349    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6ffaa59-5910-48c0-a838-01c92879fca2" containerID="71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4" exitCode=0
Jul 08 16:04:41.819550 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.819393    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b877666-xrnjw"
Jul 08 16:04:41.819550 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.819392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b877666-xrnjw" event={"ID":"c6ffaa59-5910-48c0-a838-01c92879fca2","Type":"ContainerDied","Data":"71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4"}
Jul 08 16:04:41.819550 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.819460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b877666-xrnjw" event={"ID":"c6ffaa59-5910-48c0-a838-01c92879fca2","Type":"ContainerDied","Data":"75c4a1592fc827ae53c044b745828062853ad931c98bc35c811436ebe36a0ce9"}
Jul 08 16:04:41.819550 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.819492    2582 scope.go:117] "RemoveContainer" containerID="71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4"
Jul 08 16:04:41.827754 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.827732    2582 scope.go:117] "RemoveContainer" containerID="71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4"
Jul 08 16:04:41.828006 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:04:41.827989    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4\": container with ID starting with 71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4 not found: ID does not exist" containerID="71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4"
Jul 08 16:04:41.828051 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.828019    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4"} err="failed to get container status \"71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4\": rpc error: code = NotFound desc = could not find container \"71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4\": container with ID starting with 71e90deb4988d87c593e8f9a95daeeab4175669b20b54e1e9a21ca35405719d4 not found: ID does not exist"
Jul 08 16:04:41.844911 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.844892    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srdbw\" (UniqueName: \"kubernetes.io/projected/c6ffaa59-5910-48c0-a838-01c92879fca2-kube-api-access-srdbw\") pod \"c6ffaa59-5910-48c0-a838-01c92879fca2\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") "
Jul 08 16:04:41.845015 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.844962    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert\") pod \"c6ffaa59-5910-48c0-a838-01c92879fca2\" (UID: \"c6ffaa59-5910-48c0-a838-01c92879fca2\") "
Jul 08 16:04:41.846865 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.846838    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c6ffaa59-5910-48c0-a838-01c92879fca2" (UID: "c6ffaa59-5910-48c0-a838-01c92879fca2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:04:41.846946 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.846858    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ffaa59-5910-48c0-a838-01c92879fca2-kube-api-access-srdbw" (OuterVolumeSpecName: "kube-api-access-srdbw") pod "c6ffaa59-5910-48c0-a838-01c92879fca2" (UID: "c6ffaa59-5910-48c0-a838-01c92879fca2"). InnerVolumeSpecName "kube-api-access-srdbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:04:41.945753 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.945724    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srdbw\" (UniqueName: \"kubernetes.io/projected/c6ffaa59-5910-48c0-a838-01c92879fca2-kube-api-access-srdbw\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:04:41.945753 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:41.945749    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6ffaa59-5910-48c0-a838-01c92879fca2-webhook-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:04:42.142595 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.142559    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b877666-xrnjw"]
Jul 08 16:04:42.146391 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.146369    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78b877666-xrnjw"]
Jul 08 16:04:42.269740 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.269713    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ffaa59-5910-48c0-a838-01c92879fca2" path="/var/lib/kubelet/pods/c6ffaa59-5910-48c0-a838-01c92879fca2/volumes"
Jul 08 16:04:42.903123 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.903089    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78b877666-vfljw"]
Jul 08 16:04:42.903689 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.903669    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ffaa59-5910-48c0-a838-01c92879fca2" containerName="manager"
Jul 08 16:04:42.903778 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.903690    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ffaa59-5910-48c0-a838-01c92879fca2" containerName="manager"
Jul 08 16:04:42.903832 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.903809    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ffaa59-5910-48c0-a838-01c92879fca2" containerName="manager"
Jul 08 16:04:42.908151 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.908129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:42.910719 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.910702    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 16:04:42.911611 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.911569    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fjwvt\""
Jul 08 16:04:42.911684 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.911571    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 16:04:42.918061 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.918041    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b877666-vfljw"]
Jul 08 16:04:42.953232 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.953205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/251e731e-4e27-4c77-851b-e011717c3ced-webhook-cert\") pod \"maas-controller-78b877666-vfljw\" (UID: \"251e731e-4e27-4c77-851b-e011717c3ced\") " pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:42.953337 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:42.953290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwbc\" (UniqueName: \"kubernetes.io/projected/251e731e-4e27-4c77-851b-e011717c3ced-kube-api-access-rqwbc\") pod \"maas-controller-78b877666-vfljw\" (UID: \"251e731e-4e27-4c77-851b-e011717c3ced\") " pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:43.054531 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:43.054506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/251e731e-4e27-4c77-851b-e011717c3ced-webhook-cert\") pod \"maas-controller-78b877666-vfljw\" (UID: \"251e731e-4e27-4c77-851b-e011717c3ced\") " pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:43.054659 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:43.054559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwbc\" (UniqueName: \"kubernetes.io/projected/251e731e-4e27-4c77-851b-e011717c3ced-kube-api-access-rqwbc\") pod \"maas-controller-78b877666-vfljw\" (UID: \"251e731e-4e27-4c77-851b-e011717c3ced\") " pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:43.056874 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:43.056852    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/251e731e-4e27-4c77-851b-e011717c3ced-webhook-cert\") pod \"maas-controller-78b877666-vfljw\" (UID: \"251e731e-4e27-4c77-851b-e011717c3ced\") " pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:43.063427 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:43.063405    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwbc\" (UniqueName: \"kubernetes.io/projected/251e731e-4e27-4c77-851b-e011717c3ced-kube-api-access-rqwbc\") pod \"maas-controller-78b877666-vfljw\" (UID: \"251e731e-4e27-4c77-851b-e011717c3ced\") " pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:43.218930 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:43.218847    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:43.352631 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:43.352607    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b877666-vfljw"]
Jul 08 16:04:43.354686 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:04:43.354651    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251e731e_4e27_4c77_851b_e011717c3ced.slice/crio-6a092526f0964e4abfff9a99abd0f9454620ed5db77c164f674ba58b40e74c75 WatchSource:0}: Error finding container 6a092526f0964e4abfff9a99abd0f9454620ed5db77c164f674ba58b40e74c75: Status 404 returned error can't find the container with id 6a092526f0964e4abfff9a99abd0f9454620ed5db77c164f674ba58b40e74c75
Jul 08 16:04:43.831824 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:43.831793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b877666-vfljw" event={"ID":"251e731e-4e27-4c77-851b-e011717c3ced","Type":"ContainerStarted","Data":"6a092526f0964e4abfff9a99abd0f9454620ed5db77c164f674ba58b40e74c75"}
Jul 08 16:04:44.845051 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:44.844997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b877666-vfljw" event={"ID":"251e731e-4e27-4c77-851b-e011717c3ced","Type":"ContainerStarted","Data":"74650d2a4ecdbe1ba475e94375608e5cf12f576392e38f8805653c182c37a96e"}
Jul 08 16:04:44.845524 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:44.845166    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:04:44.866971 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:44.866931    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78b877666-vfljw" podStartSLOduration=2.402989462 podStartE2EDuration="2.866919066s" totalImagesPullingTime="463.929604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:44.865186339 +0000 UTC m=+815.200194749" watchObservedRunningTime="2026-07-08 16:04:44.866919066 +0000 UTC m=+815.201927477"
Jul 08 16:04:55.856278 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:04:55.856245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78b877666-vfljw"
Jul 08 16:09:34.944547 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:34.944515    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"]
Jul 08 16:09:34.945151 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:34.944714    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp" podUID="002b862a-af21-43b0-9888-95e1efc2aa60" containerName="manager" containerID="cri-o://b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc" gracePeriod=10
Jul 08 16:09:37.497059 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:37.497035    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 16:09:37.613273 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:37.613198    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k94db\" (UniqueName: \"kubernetes.io/projected/002b862a-af21-43b0-9888-95e1efc2aa60-kube-api-access-k94db\") pod \"002b862a-af21-43b0-9888-95e1efc2aa60\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") "
Jul 08 16:09:37.613273 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:37.613259    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/002b862a-af21-43b0-9888-95e1efc2aa60-extensions-socket-volume\") pod \"002b862a-af21-43b0-9888-95e1efc2aa60\" (UID: \"002b862a-af21-43b0-9888-95e1efc2aa60\") "
Jul 08 16:09:37.613656 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:37.613631    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/002b862a-af21-43b0-9888-95e1efc2aa60-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "002b862a-af21-43b0-9888-95e1efc2aa60" (UID: "002b862a-af21-43b0-9888-95e1efc2aa60"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:09:37.615265 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:37.615243    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002b862a-af21-43b0-9888-95e1efc2aa60-kube-api-access-k94db" (OuterVolumeSpecName: "kube-api-access-k94db") pod "002b862a-af21-43b0-9888-95e1efc2aa60" (UID: "002b862a-af21-43b0-9888-95e1efc2aa60"). InnerVolumeSpecName "kube-api-access-k94db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:09:37.714045 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:37.714015    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k94db\" (UniqueName: \"kubernetes.io/projected/002b862a-af21-43b0-9888-95e1efc2aa60-kube-api-access-k94db\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:09:37.714045 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:37.714040    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/002b862a-af21-43b0-9888-95e1efc2aa60-extensions-socket-volume\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:09:38.267532 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.267492    2582 generic.go:356] "Generic (PLEG): container finished" podID="002b862a-af21-43b0-9888-95e1efc2aa60" containerID="b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc" exitCode=0
Jul 08 16:09:38.267718 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.267612    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"
Jul 08 16:09:38.268609 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.268561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp" event={"ID":"002b862a-af21-43b0-9888-95e1efc2aa60","Type":"ContainerDied","Data":"b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc"}
Jul 08 16:09:38.268691 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.268630    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp" event={"ID":"002b862a-af21-43b0-9888-95e1efc2aa60","Type":"ContainerDied","Data":"5dab232aaf0f6ba148536a89e87eec0d71bb60a2bce47a17fd1a8c4878739b9d"}
Jul 08 16:09:38.268691 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.268655    2582 scope.go:117] "RemoveContainer" containerID="b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc"
Jul 08 16:09:38.278738 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.278690    2582 scope.go:117] "RemoveContainer" containerID="b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc"
Jul 08 16:09:38.278976 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:09:38.278952    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc\": container with ID starting with b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc not found: ID does not exist" containerID="b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc"
Jul 08 16:09:38.279059 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.278986    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc"} err="failed to get container status \"b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc\": rpc error: code = NotFound desc = could not find container \"b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc\": container with ID starting with b7010410ed5051a1a50944166183db5807de136f8b5456efed661904cb042edc not found: ID does not exist"
Jul 08 16:09:38.301619 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.301593    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"]
Jul 08 16:09:38.305355 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:38.305321    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r5vmp"]
Jul 08 16:09:40.268773 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:09:40.268744    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002b862a-af21-43b0-9888-95e1efc2aa60" path="/var/lib/kubelet/pods/002b862a-af21-43b0-9888-95e1efc2aa60/volumes"
Jul 08 16:10:36.128954 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.128875    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"]
Jul 08 16:10:36.129327 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.129274    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="002b862a-af21-43b0-9888-95e1efc2aa60" containerName="manager"
Jul 08 16:10:36.129327 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.129286    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="002b862a-af21-43b0-9888-95e1efc2aa60" containerName="manager"
Jul 08 16:10:36.129395 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.129362    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="002b862a-af21-43b0-9888-95e1efc2aa60" containerName="manager"
Jul 08 16:10:36.133441 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.133421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.136650 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.136635    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t64wh\""
Jul 08 16:10:36.151934 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.151906    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"]
Jul 08 16:10:36.314950 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.314920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c959de83-79a1-42da-a1e4-bcc51fb10e58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jcdjf\" (UID: \"c959de83-79a1-42da-a1e4-bcc51fb10e58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.314950 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.314950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sthb\" (UniqueName: \"kubernetes.io/projected/c959de83-79a1-42da-a1e4-bcc51fb10e58-kube-api-access-7sthb\") pod \"kuadrant-operator-controller-manager-86878c769f-jcdjf\" (UID: \"c959de83-79a1-42da-a1e4-bcc51fb10e58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.415633 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.415550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c959de83-79a1-42da-a1e4-bcc51fb10e58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jcdjf\" (UID: \"c959de83-79a1-42da-a1e4-bcc51fb10e58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.415633 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.415595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sthb\" (UniqueName: \"kubernetes.io/projected/c959de83-79a1-42da-a1e4-bcc51fb10e58-kube-api-access-7sthb\") pod \"kuadrant-operator-controller-manager-86878c769f-jcdjf\" (UID: \"c959de83-79a1-42da-a1e4-bcc51fb10e58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.416002 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.415974    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c959de83-79a1-42da-a1e4-bcc51fb10e58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jcdjf\" (UID: \"c959de83-79a1-42da-a1e4-bcc51fb10e58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.424981 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.424960    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sthb\" (UniqueName: \"kubernetes.io/projected/c959de83-79a1-42da-a1e4-bcc51fb10e58-kube-api-access-7sthb\") pod \"kuadrant-operator-controller-manager-86878c769f-jcdjf\" (UID: \"c959de83-79a1-42da-a1e4-bcc51fb10e58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.443487 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.443453    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:36.579445 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:36.579420    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"]
Jul 08 16:10:36.581880 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:10:36.581854    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc959de83_79a1_42da_a1e4_bcc51fb10e58.slice/crio-58e3cfa01ae35e28bc7f588a633021706e720749fff6e2c8b0fdefffd012fd7d WatchSource:0}: Error finding container 58e3cfa01ae35e28bc7f588a633021706e720749fff6e2c8b0fdefffd012fd7d: Status 404 returned error can't find the container with id 58e3cfa01ae35e28bc7f588a633021706e720749fff6e2c8b0fdefffd012fd7d
Jul 08 16:10:37.545676 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:37.545639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf" event={"ID":"c959de83-79a1-42da-a1e4-bcc51fb10e58","Type":"ContainerStarted","Data":"990e538c7bdfef2c9f161b314b710f06d148121e017613911b6ac621fbeeace3"}
Jul 08 16:10:37.546141 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:37.545695    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf" event={"ID":"c959de83-79a1-42da-a1e4-bcc51fb10e58","Type":"ContainerStarted","Data":"58e3cfa01ae35e28bc7f588a633021706e720749fff6e2c8b0fdefffd012fd7d"}
Jul 08 16:10:37.546141 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:37.545733    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:10:37.567819 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:37.567777    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf" podStartSLOduration=1.567762562 podStartE2EDuration="1.567762562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:10:37.565418001 +0000 UTC m=+1167.900426412" watchObservedRunningTime="2026-07-08 16:10:37.567762562 +0000 UTC m=+1167.902770974"
Jul 08 16:10:48.553422 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:10:48.553387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jcdjf"
Jul 08 16:16:54.776261 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.776230    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"]
Jul 08 16:16:54.779835 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.779813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.782220 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.782198    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6820fd9e-openshift-default-dockercfg-vhmmm\""
Jul 08 16:16:54.795853 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.795829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"]
Jul 08 16:16:54.808727 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.808703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-envoy\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.808846 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.808777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-podinfo\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.808911 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.808849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-credential-socket\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.808911 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.808884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkg59\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-kube-api-access-wkg59\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.809018 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.808917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-token\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.809018 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.808969    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istiod-ca-cert\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.809018 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.809002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-data\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.809145 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.809031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-certs\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.809145 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.809101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-socket\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910315 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910282    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istiod-ca-cert\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910315 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-data\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910539 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-certs\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910539 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-socket\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910539 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-envoy\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910539 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-podinfo\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910539 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-credential-socket\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910815 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkg59\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-kube-api-access-wkg59\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910815 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-token\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910920 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910829    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-data\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.910920 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910881    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-certs\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.911041 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.910981    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-socket\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.911134 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.911114    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istiod-ca-cert\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.911197 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.911125    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-credential-socket\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.912826 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.912803    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-envoy\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.913061 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.913042    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-podinfo\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.920368 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.920340    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkg59\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-kube-api-access-wkg59\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:54.920795 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:54.920776    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-token\") pod \"e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") " pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:55.089929 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.089897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:55.232620 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.232573    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"]
Jul 08 16:16:55.234926 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:16:55.234887    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b6bad8_0b6f_4b8b_8f7c_49554b15db70.slice/crio-3be63e1498ba8226fed25427efcf273b2b0934164154b410d0cda3f1d9bfb809 WatchSource:0}: Error finding container 3be63e1498ba8226fed25427efcf273b2b0934164154b410d0cda3f1d9bfb809: Status 404 returned error can't find the container with id 3be63e1498ba8226fed25427efcf273b2b0934164154b410d0cda3f1d9bfb809
Jul 08 16:16:55.237289 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.237254    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:16:55.237379 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.237363    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:16:55.237441 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.237406    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:16:55.378163 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.378082    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h" event={"ID":"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70","Type":"ContainerStarted","Data":"affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871"}
Jul 08 16:16:55.378163 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.378138    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h" event={"ID":"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70","Type":"ContainerStarted","Data":"3be63e1498ba8226fed25427efcf273b2b0934164154b410d0cda3f1d9bfb809"}
Jul 08 16:16:55.404923 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:55.404867    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h" podStartSLOduration=1.404846265 podStartE2EDuration="1.404846265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:16:55.401527006 +0000 UTC m=+1545.736535421" watchObservedRunningTime="2026-07-08 16:16:55.404846265 +0000 UTC m=+1545.739854677"
Jul 08 16:16:56.091113 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:56.091074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:56.096136 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:56.096113    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:56.383130 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:56.383050    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:16:56.384083 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:16:56.384068    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:17:01.172609 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:01.172557    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"]
Jul 08 16:17:01.173070 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:01.172763    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h" podUID="b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" containerName="istio-proxy" containerID="cri-o://affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871" gracePeriod=30
Jul 08 16:17:08.029677 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.029645    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:17:08.135602 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135503    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-token\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.135602 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-certs\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.135821 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135648    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istiod-ca-cert\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.135821 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135704    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-podinfo\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.135821 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135734    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-data\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.135821 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-socket\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.135821 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135808    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkg59\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-kube-api-access-wkg59\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.136079 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135841    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-envoy\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.136079 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135864    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-credential-socket\") pod \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\" (UID: \"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70\") "
Jul 08 16:17:08.136079 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.135895    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:08.138124 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.138060    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-certs\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.138289 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.138128    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:17:08.138289 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.138264    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:17:08.140190 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.138677    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:08.140190 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.136263    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:08.146184 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.140290    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:17:08.146184 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.140544    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-kube-api-access-wkg59" (OuterVolumeSpecName: "kube-api-access-wkg59") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "kube-api-access-wkg59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:17:08.146184 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.143698    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:08.146922 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.146898    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" (UID: "b2b6bad8-0b6f-4b8b-8f7c-49554b15db70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:08.239242 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239205    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-token\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.239242 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239231    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istiod-ca-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.239242 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239242    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-podinfo\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.239242 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239250    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-data\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.239481 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239259    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-workload-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.239481 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239268    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkg59\" (UniqueName: \"kubernetes.io/projected/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-kube-api-access-wkg59\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.239481 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239278    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-istio-envoy\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.239481 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.239286    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70-credential-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:08.445199 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.445106    2582 generic.go:356] "Generic (PLEG): container finished" podID="b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" containerID="affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871" exitCode=0
Jul 08 16:17:08.445199 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.445172    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"
Jul 08 16:17:08.445394 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.445193    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h" event={"ID":"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70","Type":"ContainerDied","Data":"affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871"}
Jul 08 16:17:08.445394 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.445251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h" event={"ID":"b2b6bad8-0b6f-4b8b-8f7c-49554b15db70","Type":"ContainerDied","Data":"3be63e1498ba8226fed25427efcf273b2b0934164154b410d0cda3f1d9bfb809"}
Jul 08 16:17:08.445394 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.445273    2582 scope.go:117] "RemoveContainer" containerID="affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871"
Jul 08 16:17:08.454275 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.454257    2582 scope.go:117] "RemoveContainer" containerID="affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871"
Jul 08 16:17:08.454548 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:17:08.454529    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871\": container with ID starting with affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871 not found: ID does not exist" containerID="affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871"
Jul 08 16:17:08.454609 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.454556    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871"} err="failed to get container status \"affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871\": rpc error: code = NotFound desc = could not find container \"affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871\": container with ID starting with affeae5d6a661c6442965c32249bf5b78e22a00f32e7942b6beee223a85e8871 not found: ID does not exist"
Jul 08 16:17:08.464069 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.464048    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"]
Jul 08 16:17:08.467708 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.467687    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6820fd9e-openshift-default-5b9fb8968c-7lf4h"]
Jul 08 16:17:08.897756 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.897725    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"]
Jul 08 16:17:08.898131 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.898118    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" containerName="istio-proxy"
Jul 08 16:17:08.898194 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.898133    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" containerName="istio-proxy"
Jul 08 16:17:08.898247 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.898195    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" containerName="istio-proxy"
Jul 08 16:17:08.900903 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.900880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:08.903538 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.903519    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-36118105-serving-cert\""
Jul 08 16:17:08.918337 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:08.918312    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"]
Jul 08 16:17:09.045778 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.045745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a6fc701-75d5-403c-a770-82331a7956c1-openshift-service-ca\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.046105 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.045827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvxfh\" (UniqueName: \"kubernetes.io/projected/5a6fc701-75d5-403c-a770-82331a7956c1-kube-api-access-cvxfh\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.046105 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.045886    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a6fc701-75d5-403c-a770-82331a7956c1-maas-api-tls\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.146913 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.146881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a6fc701-75d5-403c-a770-82331a7956c1-maas-api-tls\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.147064 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.146930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a6fc701-75d5-403c-a770-82331a7956c1-openshift-service-ca\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.147064 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.146984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvxfh\" (UniqueName: \"kubernetes.io/projected/5a6fc701-75d5-403c-a770-82331a7956c1-kube-api-access-cvxfh\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.147659 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.147635    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a6fc701-75d5-403c-a770-82331a7956c1-openshift-service-ca\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.149312 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.149257    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a6fc701-75d5-403c-a770-82331a7956c1-maas-api-tls\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.157088 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.157059    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvxfh\" (UniqueName: \"kubernetes.io/projected/5a6fc701-75d5-403c-a770-82331a7956c1-kube-api-access-cvxfh\") pod \"maas-api-e2e-ait-36118105-cf6f85dc8-6f626\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.211551 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.211527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:09.353007 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.352974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"]
Jul 08 16:17:09.354777 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:17:09.354750    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6fc701_75d5_403c_a770_82331a7956c1.slice/crio-5a165e230d0562e5f7c132293eee696acc3aab1c154eb2885e8ea0a2fd09d90d WatchSource:0}: Error finding container 5a165e230d0562e5f7c132293eee696acc3aab1c154eb2885e8ea0a2fd09d90d: Status 404 returned error can't find the container with id 5a165e230d0562e5f7c132293eee696acc3aab1c154eb2885e8ea0a2fd09d90d
Jul 08 16:17:09.356518 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.356501    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:17:09.451624 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:09.451529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626" event={"ID":"5a6fc701-75d5-403c-a770-82331a7956c1","Type":"ContainerStarted","Data":"5a165e230d0562e5f7c132293eee696acc3aab1c154eb2885e8ea0a2fd09d90d"}
Jul 08 16:17:10.268098 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:10.268066    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b6bad8-0b6f-4b8b-8f7c-49554b15db70" path="/var/lib/kubelet/pods/b2b6bad8-0b6f-4b8b-8f7c-49554b15db70/volumes"
Jul 08 16:17:10.459301 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:10.459268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626" event={"ID":"5a6fc701-75d5-403c-a770-82331a7956c1","Type":"ContainerStarted","Data":"9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3"}
Jul 08 16:17:10.459462 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:10.459389    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:10.477965 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:10.477917    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626" podStartSLOduration=2.085249712 podStartE2EDuration="2.47790353s" totalImagesPullingTime="392.653818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:17:10.477749889 +0000 UTC m=+1560.812758301" watchObservedRunningTime="2026-07-08 16:17:10.47790353 +0000 UTC m=+1560.812911941"
Jul 08 16:17:14.086613 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.086566    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"]
Jul 08 16:17:14.087048 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.086790    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626" podUID="5a6fc701-75d5-403c-a770-82331a7956c1" containerName="maas-api" containerID="cri-o://9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3" gracePeriod=30
Jul 08 16:17:14.093379 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.093356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:14.341356 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.341300    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:14.479592 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.479554    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a6fc701-75d5-403c-a770-82331a7956c1" containerID="9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3" exitCode=0
Jul 08 16:17:14.479781 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.479608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626" event={"ID":"5a6fc701-75d5-403c-a770-82331a7956c1","Type":"ContainerDied","Data":"9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3"}
Jul 08 16:17:14.479781 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.479632    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"
Jul 08 16:17:14.479781 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.479660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626" event={"ID":"5a6fc701-75d5-403c-a770-82331a7956c1","Type":"ContainerDied","Data":"5a165e230d0562e5f7c132293eee696acc3aab1c154eb2885e8ea0a2fd09d90d"}
Jul 08 16:17:14.479781 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.479683    2582 scope.go:117] "RemoveContainer" containerID="9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3"
Jul 08 16:17:14.487934 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.487918    2582 scope.go:117] "RemoveContainer" containerID="9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3"
Jul 08 16:17:14.488160 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:17:14.488145    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3\": container with ID starting with 9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3 not found: ID does not exist" containerID="9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3"
Jul 08 16:17:14.488210 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.488168    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3"} err="failed to get container status \"9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3\": rpc error: code = NotFound desc = could not find container \"9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3\": container with ID starting with 9a0a034d118ded6d89c50b65114dc937f0574fd957873dd42d002e56f2cd67f3 not found: ID does not exist"
Jul 08 16:17:14.494673 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.494654    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvxfh\" (UniqueName: \"kubernetes.io/projected/5a6fc701-75d5-403c-a770-82331a7956c1-kube-api-access-cvxfh\") pod \"5a6fc701-75d5-403c-a770-82331a7956c1\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") "
Jul 08 16:17:14.494769 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.494716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a6fc701-75d5-403c-a770-82331a7956c1-maas-api-tls\") pod \"5a6fc701-75d5-403c-a770-82331a7956c1\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") "
Jul 08 16:17:14.494769 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.494750    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a6fc701-75d5-403c-a770-82331a7956c1-openshift-service-ca\") pod \"5a6fc701-75d5-403c-a770-82331a7956c1\" (UID: \"5a6fc701-75d5-403c-a770-82331a7956c1\") "
Jul 08 16:17:14.495124 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.495104    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a6fc701-75d5-403c-a770-82331a7956c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a6fc701-75d5-403c-a770-82331a7956c1" (UID: "5a6fc701-75d5-403c-a770-82331a7956c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:17:14.496731 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.496704    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a6fc701-75d5-403c-a770-82331a7956c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a6fc701-75d5-403c-a770-82331a7956c1" (UID: "5a6fc701-75d5-403c-a770-82331a7956c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:17:14.496811 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.496758    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a6fc701-75d5-403c-a770-82331a7956c1-kube-api-access-cvxfh" (OuterVolumeSpecName: "kube-api-access-cvxfh") pod "5a6fc701-75d5-403c-a770-82331a7956c1" (UID: "5a6fc701-75d5-403c-a770-82331a7956c1"). InnerVolumeSpecName "kube-api-access-cvxfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:17:14.595890 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.595823    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvxfh\" (UniqueName: \"kubernetes.io/projected/5a6fc701-75d5-403c-a770-82331a7956c1-kube-api-access-cvxfh\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:14.595890 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.595849    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a6fc701-75d5-403c-a770-82331a7956c1-maas-api-tls\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:14.595890 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.595860    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a6fc701-75d5-403c-a770-82331a7956c1-openshift-service-ca\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:14.803455 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.803425    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"]
Jul 08 16:17:14.806666 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:14.806643    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36118105-cf6f85dc8-6f626"]
Jul 08 16:17:16.268822 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:16.268783    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a6fc701-75d5-403c-a770-82331a7956c1" path="/var/lib/kubelet/pods/5a6fc701-75d5-403c-a770-82331a7956c1/volumes"
Jul 08 16:17:26.511650 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.511617    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"]
Jul 08 16:17:26.512039 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.512025    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a6fc701-75d5-403c-a770-82331a7956c1" containerName="maas-api"
Jul 08 16:17:26.512084 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.512041    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a6fc701-75d5-403c-a770-82331a7956c1" containerName="maas-api"
Jul 08 16:17:26.512119 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.512107    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a6fc701-75d5-403c-a770-82331a7956c1" containerName="maas-api"
Jul 08 16:17:26.516299 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.516277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.518790 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.518770    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-326e35c8-openshift-default-dockercfg-p2m72\""
Jul 08 16:17:26.534062 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.534038    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"]
Jul 08 16:17:26.605687 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.605654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-data\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.605854 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.605752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-socket\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.605854 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.605780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-credential-socket\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.605854 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.605798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-certs\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.605854 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.605825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-podinfo\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.606003 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.605897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-token\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.606003 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.605939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxd6t\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-kube-api-access-fxd6t\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.606075 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.606012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istiod-ca-cert\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.606075 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.606036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-envoy\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707171 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istiod-ca-cert\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707171 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-envoy\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707417 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-data\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707417 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-socket\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707417 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-credential-socket\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707417 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-certs\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707417 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-podinfo\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707417 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-token\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707417 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxd6t\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-kube-api-access-fxd6t\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707780 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707686    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-socket\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707875 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707848    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-credential-socket\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.707932 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.707908    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-data\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.708059 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.708035    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istiod-ca-cert\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.708151 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.708134    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-certs\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.709699 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.709666    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-envoy\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.709818 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.709798    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-podinfo\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.716693 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.716670    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-token\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.716957 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.716936    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxd6t\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-kube-api-access-fxd6t\") pod \"e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") " pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.826756 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.826716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:26.973264 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.973239    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"]
Jul 08 16:17:26.974827 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:17:26.974790    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a8a09a_1dfa_4079_b63d_cafb5277cc05.slice/crio-c378b089ea82639a96cc9bb04788483f2ccbe0e4429cebc116686e18d3159ae5 WatchSource:0}: Error finding container c378b089ea82639a96cc9bb04788483f2ccbe0e4429cebc116686e18d3159ae5: Status 404 returned error can't find the container with id c378b089ea82639a96cc9bb04788483f2ccbe0e4429cebc116686e18d3159ae5
Jul 08 16:17:26.977008 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.976979    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:17:26.977073 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.977041    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:17:26.977073 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:26.977067    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:17:27.547872 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:27.547825    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl" event={"ID":"a7a8a09a-1dfa-4079-b63d-cafb5277cc05","Type":"ContainerStarted","Data":"ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35"}
Jul 08 16:17:27.548332 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:27.547919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl" event={"ID":"a7a8a09a-1dfa-4079-b63d-cafb5277cc05","Type":"ContainerStarted","Data":"c378b089ea82639a96cc9bb04788483f2ccbe0e4429cebc116686e18d3159ae5"}
Jul 08 16:17:27.570173 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:27.570118    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl" podStartSLOduration=1.5701029530000001 podStartE2EDuration="1.570102953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:17:27.568393967 +0000 UTC m=+1577.903402374" watchObservedRunningTime="2026-07-08 16:17:27.570102953 +0000 UTC m=+1577.905111364"
Jul 08 16:17:27.826932 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:27.826896    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:28.832407 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:28.832378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:29.559880 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:29.559846    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:29.560881 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:29.560864    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:32.242837 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:32.242797    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"]
Jul 08 16:17:32.573256 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:32.573196    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl" podUID="a7a8a09a-1dfa-4079-b63d-cafb5277cc05" containerName="istio-proxy" containerID="cri-o://ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35" gracePeriod=30
Jul 08 16:17:37.826850 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.826826    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:37.903102 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903025    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-credential-socket\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903102 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903069    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-socket\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903102 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903093    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-token\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903109    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxd6t\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-kube-api-access-fxd6t\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-envoy\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903172    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-certs\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903206    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istiod-ca-cert\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903233    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-podinfo\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903313    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:37.903365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903323    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-data\") pod \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\" (UID: \"a7a8a09a-1dfa-4079-b63d-cafb5277cc05\") "
Jul 08 16:17:37.903768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903374    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:37.903768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903539    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:37.903768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903646    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:17:37.903768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903723    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:37.903954 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903802    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istiod-ca-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:37.903954 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903821    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-data\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:37.903954 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903834    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-credential-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:37.903954 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.903850    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:37.905277 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.905253    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:17:37.905382 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.905287    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:17:37.905791 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.905772    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:17:37.905864 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:37.905791    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-kube-api-access-fxd6t" (OuterVolumeSpecName: "kube-api-access-fxd6t") pod "a7a8a09a-1dfa-4079-b63d-cafb5277cc05" (UID: "a7a8a09a-1dfa-4079-b63d-cafb5277cc05"). InnerVolumeSpecName "kube-api-access-fxd6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:17:38.004704 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.004667    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-token\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:38.004704 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.004696    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxd6t\" (UniqueName: \"kubernetes.io/projected/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-kube-api-access-fxd6t\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:38.004704 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.004709    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-envoy\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:38.004924 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.004717    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-workload-certs\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:38.004924 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.004725    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a8a09a-1dfa-4079-b63d-cafb5277cc05-istio-podinfo\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:17:38.603764 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.603729    2582 generic.go:356] "Generic (PLEG): container finished" podID="a7a8a09a-1dfa-4079-b63d-cafb5277cc05" containerID="ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35" exitCode=0
Jul 08 16:17:38.603960 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.603794    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"
Jul 08 16:17:38.603960 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.603810    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl" event={"ID":"a7a8a09a-1dfa-4079-b63d-cafb5277cc05","Type":"ContainerDied","Data":"ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35"}
Jul 08 16:17:38.603960 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.603895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl" event={"ID":"a7a8a09a-1dfa-4079-b63d-cafb5277cc05","Type":"ContainerDied","Data":"c378b089ea82639a96cc9bb04788483f2ccbe0e4429cebc116686e18d3159ae5"}
Jul 08 16:17:38.603960 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.603920    2582 scope.go:117] "RemoveContainer" containerID="ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35"
Jul 08 16:17:38.612827 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.612809    2582 scope.go:117] "RemoveContainer" containerID="ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35"
Jul 08 16:17:38.613080 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:17:38.613062    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35\": container with ID starting with ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35 not found: ID does not exist" containerID="ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35"
Jul 08 16:17:38.613140 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.613094    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35"} err="failed to get container status \"ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35\": rpc error: code = NotFound desc = could not find container \"ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35\": container with ID starting with ec615ee48e05bd1913dc4f95bffaf5ab17e6a9da7e4953bd4e3bee56ec623a35 not found: ID does not exist"
Jul 08 16:17:38.624416 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.624389    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"]
Jul 08 16:17:38.634522 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:38.634493    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-326e35c8-openshift-default-7dcd849d95-dmldl"]
Jul 08 16:17:40.269074 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:17:40.269040    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7a8a09a-1dfa-4079-b63d-cafb5277cc05" path="/var/lib/kubelet/pods/a7a8a09a-1dfa-4079-b63d-cafb5277cc05/volumes"
Jul 08 16:19:18.839844 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.839809    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"]
Jul 08 16:19:18.840403 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.840386    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7a8a09a-1dfa-4079-b63d-cafb5277cc05" containerName="istio-proxy"
Jul 08 16:19:18.840473 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.840406    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7a8a09a-1dfa-4079-b63d-cafb5277cc05" containerName="istio-proxy"
Jul 08 16:19:18.840517 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.840510    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7a8a09a-1dfa-4079-b63d-cafb5277cc05" containerName="istio-proxy"
Jul 08 16:19:18.843830 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.843809    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:18.846504 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.846482    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-74123113-serving-cert\""
Jul 08 16:19:18.853522 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.853499    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"]
Jul 08 16:19:18.905853 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.905817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlbdz\" (UniqueName: \"kubernetes.io/projected/c046d821-b07f-41fc-bd02-e24b2230337c-kube-api-access-mlbdz\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:18.905988 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.905933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c046d821-b07f-41fc-bd02-e24b2230337c-maas-api-tls\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:18.905988 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:18.905957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c046d821-b07f-41fc-bd02-e24b2230337c-openshift-service-ca\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.006864 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.006832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c046d821-b07f-41fc-bd02-e24b2230337c-maas-api-tls\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.006864 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.006866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c046d821-b07f-41fc-bd02-e24b2230337c-openshift-service-ca\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.007084 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.006925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlbdz\" (UniqueName: \"kubernetes.io/projected/c046d821-b07f-41fc-bd02-e24b2230337c-kube-api-access-mlbdz\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.007661 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.007639    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c046d821-b07f-41fc-bd02-e24b2230337c-openshift-service-ca\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.009365 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.009343    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c046d821-b07f-41fc-bd02-e24b2230337c-maas-api-tls\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.021242 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.021216    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlbdz\" (UniqueName: \"kubernetes.io/projected/c046d821-b07f-41fc-bd02-e24b2230337c-kube-api-access-mlbdz\") pod \"maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.155009 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.154929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:19.293694 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:19.293668    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"]
Jul 08 16:19:19.295462 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:19:19.295434    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc046d821_b07f_41fc_bd02_e24b2230337c.slice/crio-6d9c6acf5be98a438ad6a88a93e95dd4df9c83e803534647b8a36f0de8c13ac3 WatchSource:0}: Error finding container 6d9c6acf5be98a438ad6a88a93e95dd4df9c83e803534647b8a36f0de8c13ac3: Status 404 returned error can't find the container with id 6d9c6acf5be98a438ad6a88a93e95dd4df9c83e803534647b8a36f0de8c13ac3
Jul 08 16:19:20.084349 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:20.084312    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht" event={"ID":"c046d821-b07f-41fc-bd02-e24b2230337c","Type":"ContainerStarted","Data":"3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f"}
Jul 08 16:19:20.084768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:20.084359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht" event={"ID":"c046d821-b07f-41fc-bd02-e24b2230337c","Type":"ContainerStarted","Data":"6d9c6acf5be98a438ad6a88a93e95dd4df9c83e803534647b8a36f0de8c13ac3"}
Jul 08 16:19:20.084768 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:20.084410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:20.103661 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:20.103617    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht" podStartSLOduration=1.49952007 podStartE2EDuration="2.103558469s" totalImagesPullingTime="604.038399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:19:20.10269037 +0000 UTC m=+1690.437698793" watchObservedRunningTime="2026-07-08 16:19:20.103558469 +0000 UTC m=+1690.438566880"
Jul 08 16:19:26.095054 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:26.095025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:31.227155 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.227116    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"]
Jul 08 16:19:31.227622 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.227352    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht" podUID="c046d821-b07f-41fc-bd02-e24b2230337c" containerName="maas-api" containerID="cri-o://3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f" gracePeriod=30
Jul 08 16:19:31.480561 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.480503    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:31.618002 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.617972    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlbdz\" (UniqueName: \"kubernetes.io/projected/c046d821-b07f-41fc-bd02-e24b2230337c-kube-api-access-mlbdz\") pod \"c046d821-b07f-41fc-bd02-e24b2230337c\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") "
Jul 08 16:19:31.618189 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.618011    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c046d821-b07f-41fc-bd02-e24b2230337c-maas-api-tls\") pod \"c046d821-b07f-41fc-bd02-e24b2230337c\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") "
Jul 08 16:19:31.618189 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.618080    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c046d821-b07f-41fc-bd02-e24b2230337c-openshift-service-ca\") pod \"c046d821-b07f-41fc-bd02-e24b2230337c\" (UID: \"c046d821-b07f-41fc-bd02-e24b2230337c\") "
Jul 08 16:19:31.618560 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.618528    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c046d821-b07f-41fc-bd02-e24b2230337c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c046d821-b07f-41fc-bd02-e24b2230337c" (UID: "c046d821-b07f-41fc-bd02-e24b2230337c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:19:31.620094 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.620060    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c046d821-b07f-41fc-bd02-e24b2230337c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c046d821-b07f-41fc-bd02-e24b2230337c" (UID: "c046d821-b07f-41fc-bd02-e24b2230337c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:19:31.620195 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.620114    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c046d821-b07f-41fc-bd02-e24b2230337c-kube-api-access-mlbdz" (OuterVolumeSpecName: "kube-api-access-mlbdz") pod "c046d821-b07f-41fc-bd02-e24b2230337c" (UID: "c046d821-b07f-41fc-bd02-e24b2230337c"). InnerVolumeSpecName "kube-api-access-mlbdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:19:31.718905 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.718878    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlbdz\" (UniqueName: \"kubernetes.io/projected/c046d821-b07f-41fc-bd02-e24b2230337c-kube-api-access-mlbdz\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:19:31.718905 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.718902    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c046d821-b07f-41fc-bd02-e24b2230337c-maas-api-tls\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:19:31.718905 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:31.718911    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c046d821-b07f-41fc-bd02-e24b2230337c-openshift-service-ca\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:19:32.144409 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.144336    2582 generic.go:356] "Generic (PLEG): container finished" podID="c046d821-b07f-41fc-bd02-e24b2230337c" containerID="3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f" exitCode=0
Jul 08 16:19:32.144409 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.144383    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"
Jul 08 16:19:32.144621 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.144421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht" event={"ID":"c046d821-b07f-41fc-bd02-e24b2230337c","Type":"ContainerDied","Data":"3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f"}
Jul 08 16:19:32.144621 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.144472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht" event={"ID":"c046d821-b07f-41fc-bd02-e24b2230337c","Type":"ContainerDied","Data":"6d9c6acf5be98a438ad6a88a93e95dd4df9c83e803534647b8a36f0de8c13ac3"}
Jul 08 16:19:32.144621 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.144495    2582 scope.go:117] "RemoveContainer" containerID="3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f"
Jul 08 16:19:32.153538 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.153524    2582 scope.go:117] "RemoveContainer" containerID="3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f"
Jul 08 16:19:32.153822 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:19:32.153802    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f\": container with ID starting with 3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f not found: ID does not exist" containerID="3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f"
Jul 08 16:19:32.153914 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.153833    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f"} err="failed to get container status \"3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f\": rpc error: code = NotFound desc = could not find container \"3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f\": container with ID starting with 3725468ae4a9000dc6f8c3efb11baaf3753ec4f0548d29368718f8b71fa5de9f not found: ID does not exist"
Jul 08 16:19:32.168616 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.168593    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"]
Jul 08 16:19:32.179160 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.179139    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-74123113-5dbdb4b5bd-5plht"]
Jul 08 16:19:32.268609 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:19:32.268562    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c046d821-b07f-41fc-bd02-e24b2230337c" path="/var/lib/kubelet/pods/c046d821-b07f-41fc-bd02-e24b2230337c/volumes"
Jul 08 16:22:51.673847 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.673749    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"]
Jul 08 16:22:51.676148 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.674322    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c046d821-b07f-41fc-bd02-e24b2230337c" containerName="maas-api"
Jul 08 16:22:51.676148 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.674336    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c046d821-b07f-41fc-bd02-e24b2230337c" containerName="maas-api"
Jul 08 16:22:51.676148 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.674438    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c046d821-b07f-41fc-bd02-e24b2230337c" containerName="maas-api"
Jul 08 16:22:51.677773 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.677751    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.680705 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.680683    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-029815-openshift-default-dockercfg-64c4n\""
Jul 08 16:22:51.688897 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.688876    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"]
Jul 08 16:22:51.737491 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-podinfo\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737667 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6rz7\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-kube-api-access-r6rz7\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737667 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-credential-socket\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737769 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-socket\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737769 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-data\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737769 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-token\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737982 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istiod-ca-cert\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737982 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-certs\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.737982 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.737901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-envoy\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.838755 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-data\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.838755 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-token\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839006 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istiod-ca-cert\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839006 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-certs\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839006 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-envoy\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839006 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-podinfo\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839006 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rz7\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-kube-api-access-r6rz7\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839006 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.838957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-credential-socket\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839313 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.839031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-socket\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839313 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.839185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-data\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839313 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.839253    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-certs\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839545 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.839524    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-socket\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839751 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.839726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-credential-socket\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.839897 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.839879    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istiod-ca-cert\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.841494 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.841460    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-envoy\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.841643 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.841617    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-podinfo\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.848330 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.848304    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6rz7\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-kube-api-access-r6rz7\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.848788 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.848769    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-token\") pod \"e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") " pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:51.989211 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:51.989129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:52.137056 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:52.137031    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"]
Jul 08 16:22:52.138837 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:22:52.138805    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fd4f41_db3f_4e53_b309_ac25d42fae1e.slice/crio-08a0979ed11f9058b838e42b40643b6b5fd1328781f11f049a8394c381a07036 WatchSource:0}: Error finding container 08a0979ed11f9058b838e42b40643b6b5fd1328781f11f049a8394c381a07036: Status 404 returned error can't find the container with id 08a0979ed11f9058b838e42b40643b6b5fd1328781f11f049a8394c381a07036
Jul 08 16:22:52.141411 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:52.141383    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:22:52.141490 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:52.141443    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:22:52.141490 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:52.141470    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:22:53.102146 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:53.102113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" event={"ID":"94fd4f41-db3f-4e53-b309-ac25d42fae1e","Type":"ContainerStarted","Data":"6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf"}
Jul 08 16:22:53.102639 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:53.102166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" event={"ID":"94fd4f41-db3f-4e53-b309-ac25d42fae1e","Type":"ContainerStarted","Data":"08a0979ed11f9058b838e42b40643b6b5fd1328781f11f049a8394c381a07036"}
Jul 08 16:22:53.128419 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:53.128372    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podStartSLOduration=2.128357522 podStartE2EDuration="2.128357522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:22:53.12712438 +0000 UTC m=+1903.462132790" watchObservedRunningTime="2026-07-08 16:22:53.128357522 +0000 UTC m=+1903.463365933"
Jul 08 16:22:53.990315 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:53.990278    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:53.995151 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:53.995124    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:54.106883 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:54.106851    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:22:54.107700 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:22:54.107680    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:23:09.108159 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.108128    2582 patch_prober.go:28] interesting pod/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 08 16:23:09.108533 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.108195    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 08 16:23:09.191517 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.191486    2582 generic.go:356] "Generic (PLEG): container finished" podID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerID="6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf" exitCode=0
Jul 08 16:23:09.191664 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.191558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" event={"ID":"94fd4f41-db3f-4e53-b309-ac25d42fae1e","Type":"ContainerDied","Data":"6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf"}
Jul 08 16:23:09.191958 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.191942    2582 scope.go:117] "RemoveContainer" containerID="6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf"
Jul 08 16:23:09.192941 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.192915    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:23:09.193000 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.192991    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:23:09.193036 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:09.193025    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:23:10.198627 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:10.198592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" event={"ID":"94fd4f41-db3f-4e53-b309-ac25d42fae1e","Type":"ContainerStarted","Data":"d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552"}
Jul 08 16:23:10.990252 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:10.990219    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:23:10.990448 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:10.990400    2582 patch_prober.go:28] interesting pod/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 08 16:23:10.990511 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:10.990463    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 08 16:23:11.989844 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:11.989806    2582 patch_prober.go:28] interesting pod/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 08 16:23:11.990249 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:11.989862    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 08 16:23:12.990469 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:12.990425    2582 patch_prober.go:28] interesting pod/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 08 16:23:12.990877 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:12.990492    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 08 16:23:13.990319 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:13.990282    2582 patch_prober.go:28] interesting pod/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 08 16:23:13.990502 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:13.990336    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 08 16:23:14.993935 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:14.993906    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:23:14.994386 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:14.994248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:23:14.994873 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:23:14.994855    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:24:55.367930 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:24:55.367899    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"]
Jul 08 16:24:55.368474 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:24:55.368101    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy" containerID="cri-o://d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552" gracePeriod=30
Jul 08 16:24:59.996161 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:24:59.996124    2582 patch_prober.go:28] interesting pod/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 16:24:59.996538 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:24:59.996199    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:25:00.615066 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.615036    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:25:00.686793 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.686721    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-data\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.686793 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.686781    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-envoy\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687009 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.686813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6rz7\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-kube-api-access-r6rz7\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687009 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.686860    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-podinfo\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687009 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.686889    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-certs\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687009 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.686965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-credential-socket\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687009 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.686987    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-token\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687288 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istiod-ca-cert\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687288 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-socket\") pod \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\" (UID: \"94fd4f41-db3f-4e53-b309-ac25d42fae1e\") "
Jul 08 16:25:00.687385 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687292    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:00.687440 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687419    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-credential-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.687520 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687490    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:00.687652 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687620    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:00.687652 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687646    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:00.687818 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.687678    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:25:00.689139 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.689102    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:00.689276 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.689256    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:25:00.689470 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.689449    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:25:00.689542 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.689449    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-kube-api-access-r6rz7" (OuterVolumeSpecName: "kube-api-access-r6rz7") pod "94fd4f41-db3f-4e53-b309-ac25d42fae1e" (UID: "94fd4f41-db3f-4e53-b309-ac25d42fae1e"). InnerVolumeSpecName "kube-api-access-r6rz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:25:00.752830 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.752800    2582 generic.go:356] "Generic (PLEG): container finished" podID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerID="d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552" exitCode=0
Jul 08 16:25:00.752976 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.752839    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" event={"ID":"94fd4f41-db3f-4e53-b309-ac25d42fae1e","Type":"ContainerDied","Data":"d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552"}
Jul 08 16:25:00.752976 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.752854    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"
Jul 08 16:25:00.752976 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.752882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf" event={"ID":"94fd4f41-db3f-4e53-b309-ac25d42fae1e","Type":"ContainerDied","Data":"08a0979ed11f9058b838e42b40643b6b5fd1328781f11f049a8394c381a07036"}
Jul 08 16:25:00.752976 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.752904    2582 scope.go:117] "RemoveContainer" containerID="d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552"
Jul 08 16:25:00.762196 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.762180    2582 scope.go:117] "RemoveContainer" containerID="6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf"
Jul 08 16:25:00.770317 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.770297    2582 scope.go:117] "RemoveContainer" containerID="d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552"
Jul 08 16:25:00.770573 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:25:00.770555    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552\": container with ID starting with d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552 not found: ID does not exist" containerID="d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552"
Jul 08 16:25:00.770650 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.770596    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552"} err="failed to get container status \"d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552\": rpc error: code = NotFound desc = could not find container \"d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552\": container with ID starting with d0d474b604db6a88a21bdba07ed22998f19354e67c792ec7fda841475ef08552 not found: ID does not exist"
Jul 08 16:25:00.770650 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.770614    2582 scope.go:117] "RemoveContainer" containerID="6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf"
Jul 08 16:25:00.770863 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:25:00.770846    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf\": container with ID starting with 6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf not found: ID does not exist" containerID="6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf"
Jul 08 16:25:00.770904 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.770869    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf"} err="failed to get container status \"6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf\": rpc error: code = NotFound desc = could not find container \"6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf\": container with ID starting with 6a7f1e63f41069899e6059aad3a06c5860f8c1dc271608f5a46e48eb8c80eddf not found: ID does not exist"
Jul 08 16:25:00.788449 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788431    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-data\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.788449 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788449    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-envoy\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.788573 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788457    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6rz7\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-kube-api-access-r6rz7\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.788573 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788467    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-podinfo\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.788573 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788476    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-certs\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.788573 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788484    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istio-token\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.788573 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788492    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94fd4f41-db3f-4e53-b309-ac25d42fae1e-istiod-ca-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.788573 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.788499    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94fd4f41-db3f-4e53-b309-ac25d42fae1e-workload-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:00.789520 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.789500    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"]
Jul 08 16:25:00.803716 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:00.803698    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-029815-openshift-default-57dc7fb9cc-k9mzf"]
Jul 08 16:25:02.269319 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:02.269283    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" path="/var/lib/kubelet/pods/94fd4f41-db3f-4e53-b309-ac25d42fae1e/volumes"
Jul 08 16:25:05.466635 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.466599    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"]
Jul 08 16:25:05.467222 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.467196    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy"
Jul 08 16:25:05.467222 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.467223    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy"
Jul 08 16:25:05.467423 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.467344    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy"
Jul 08 16:25:05.467423 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.467358    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy"
Jul 08 16:25:05.472156 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.472138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.475346 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.475324    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5689eb-openshift-default-dockercfg-c9f2g\""
Jul 08 16:25:05.483559 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.483537    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"]
Jul 08 16:25:05.531352 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-credential-socket\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531506 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-envoy\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531506 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-podinfo\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531506 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-token\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531506 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-data\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531715 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-certs\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531715 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtkv6\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-kube-api-access-xtkv6\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531715 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ae8aae-a981-48e1-a621-289987c0d3c5-istiod-ca-cert\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.531715 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.531642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-socket\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.632529 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.632493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-credential-socket\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.632722 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.632567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-envoy\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.632722 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.632611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-podinfo\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.632722 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.632635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-token\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.632997 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.632965    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-credential-socket\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.633109 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.632998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-data\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.633109 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.633039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-certs\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.633109 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.633064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtkv6\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-kube-api-access-xtkv6\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.633263 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.633112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ae8aae-a981-48e1-a621-289987c0d3c5-istiod-ca-cert\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.633263 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.633180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-socket\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.633730 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.633703    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-data\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.633879 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.633745    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-certs\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.634112 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.634089    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ae8aae-a981-48e1-a621-289987c0d3c5-istiod-ca-cert\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.634219 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.634199    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-socket\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.635110 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.635090    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-envoy\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.635460 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.635443    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-podinfo\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.645959 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.645935    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-token\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.647518 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.647499    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtkv6\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-kube-api-access-xtkv6\") pod \"e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") " pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.783834 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.783755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:05.935728 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.935698    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"]
Jul 08 16:25:05.938673 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:25:05.938646    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ae8aae_a981_48e1_a621_289987c0d3c5.slice/crio-0f63d5a299a9499b5755bbf8703be11df1b4eb5c4b5650016ebcf93bf88e5376 WatchSource:0}: Error finding container 0f63d5a299a9499b5755bbf8703be11df1b4eb5c4b5650016ebcf93bf88e5376: Status 404 returned error can't find the container with id 0f63d5a299a9499b5755bbf8703be11df1b4eb5c4b5650016ebcf93bf88e5376
Jul 08 16:25:05.941141 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.941111    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:05.941219 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.941178    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:05.941219 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:05.941205    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:06.786678 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:06.786641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" event={"ID":"e8ae8aae-a981-48e1-a621-289987c0d3c5","Type":"ContainerStarted","Data":"578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b"}
Jul 08 16:25:06.787056 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:06.786691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" event={"ID":"e8ae8aae-a981-48e1-a621-289987c0d3c5","Type":"ContainerStarted","Data":"0f63d5a299a9499b5755bbf8703be11df1b4eb5c4b5650016ebcf93bf88e5376"}
Jul 08 16:25:06.813680 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:06.813630    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" podStartSLOduration=1.81361559 podStartE2EDuration="1.81361559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:25:06.811843015 +0000 UTC m=+2037.146851425" watchObservedRunningTime="2026-07-08 16:25:06.81361559 +0000 UTC m=+2037.148624001"
Jul 08 16:25:07.784064 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:07.784030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:07.788955 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:07.788929    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:07.792287 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:07.792259    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:07.793099 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:07.793080    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:23.834735 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:23.834691    2582 patch_prober.go:28] interesting pod/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 16:25:23.835109 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:23.834762    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 16:25:24.886328 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:24.886295    2582 generic.go:356] "Generic (PLEG): container finished" podID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerID="578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b" exitCode=0
Jul 08 16:25:24.886873 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:24.886369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" event={"ID":"e8ae8aae-a981-48e1-a621-289987c0d3c5","Type":"ContainerDied","Data":"578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b"}
Jul 08 16:25:24.886940 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:24.886900    2582 scope.go:117] "RemoveContainer" containerID="578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b"
Jul 08 16:25:24.888031 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:24.888002    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:24.888104 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:24.888084    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:24.888144 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:24.888128    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:25.893646 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:25.893611    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" event={"ID":"e8ae8aae-a981-48e1-a621-289987c0d3c5","Type":"ContainerStarted","Data":"99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402"}
Jul 08 16:25:26.783916 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:26.783876    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:26.784169 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:26.784115    2582 patch_prober.go:28] interesting pod/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 08 16:25:26.784216 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:26.784161    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 08 16:25:27.785022 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:27.784984    2582 patch_prober.go:28] interesting pod/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 08 16:25:27.785412 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:27.785040    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 08 16:25:28.784085 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:28.784052    2582 patch_prober.go:28] interesting pod/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 08 16:25:28.784256 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:28.784102    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 08 16:25:29.787212 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:29.787178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:29.787623 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:29.787587    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:29.788310 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:29.788289    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:36.411357 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:36.411275    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"]
Jul 08 16:25:36.411808 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:36.411524    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy" containerID="cri-o://99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402" gracePeriod=30
Jul 08 16:25:41.670692 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.670667    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:41.771874 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.771798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-credential-socket\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.771874 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.771851    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-token\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.771874 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.771874    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-envoy\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.772132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.771919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-podinfo\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.772132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.771934    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-data\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.772132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.771964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtkv6\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-kube-api-access-xtkv6\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.772132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.771985    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-certs\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.772132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772010    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ae8aae-a981-48e1-a621-289987c0d3c5-istiod-ca-cert\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.772132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772061    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:41.772132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772103    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-socket\") pod \"e8ae8aae-a981-48e1-a621-289987c0d3c5\" (UID: \"e8ae8aae-a981-48e1-a621-289987c0d3c5\") "
Jul 08 16:25:41.772571 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772261    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:41.772571 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772432    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ae8aae-a981-48e1-a621-289987c0d3c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:25:41.772571 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772480    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-credential-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.772571 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772501    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-certs\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.772810 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772752    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:41.773026 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.772988    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:41.774206 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.774173    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:25:41.774316 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.774229    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-kube-api-access-xtkv6" (OuterVolumeSpecName: "kube-api-access-xtkv6") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "kube-api-access-xtkv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:25:41.774459 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.774439    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:25:41.774562 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.774476    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8ae8aae-a981-48e1-a621-289987c0d3c5" (UID: "e8ae8aae-a981-48e1-a621-289987c0d3c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:25:41.873709 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.873682    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-podinfo\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.873709 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.873709    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-data\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.873915 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.873722    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtkv6\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-kube-api-access-xtkv6\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.873915 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.873736    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ae8aae-a981-48e1-a621-289987c0d3c5-istiod-ca-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.873915 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.873748    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-workload-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.873915 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.873759    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-token\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.873915 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.873771    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ae8aae-a981-48e1-a621-289987c0d3c5-istio-envoy\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:25:41.973977 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.973940    2582 generic.go:356] "Generic (PLEG): container finished" podID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerID="99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402" exitCode=0
Jul 08 16:25:41.974132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.974001    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"
Jul 08 16:25:41.974132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.974028    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" event={"ID":"e8ae8aae-a981-48e1-a621-289987c0d3c5","Type":"ContainerDied","Data":"99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402"}
Jul 08 16:25:41.974132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.974110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7" event={"ID":"e8ae8aae-a981-48e1-a621-289987c0d3c5","Type":"ContainerDied","Data":"0f63d5a299a9499b5755bbf8703be11df1b4eb5c4b5650016ebcf93bf88e5376"}
Jul 08 16:25:41.974251 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.974133    2582 scope.go:117] "RemoveContainer" containerID="99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402"
Jul 08 16:25:41.983408 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.983391    2582 scope.go:117] "RemoveContainer" containerID="578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b"
Jul 08 16:25:41.991383 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.991367    2582 scope.go:117] "RemoveContainer" containerID="99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402"
Jul 08 16:25:41.991637 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:25:41.991619    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402\": container with ID starting with 99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402 not found: ID does not exist" containerID="99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402"
Jul 08 16:25:41.991701 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.991645    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402"} err="failed to get container status \"99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402\": rpc error: code = NotFound desc = could not find container \"99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402\": container with ID starting with 99ed70d18d2650afbd94b280f9243defff1a88c6c559d44013c9c6ecbae43402 not found: ID does not exist"
Jul 08 16:25:41.991701 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.991661    2582 scope.go:117] "RemoveContainer" containerID="578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b"
Jul 08 16:25:41.991888 ip-10-0-132-153 kubenswrapper[2582]: E0708 16:25:41.991873    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b\": container with ID starting with 578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b not found: ID does not exist" containerID="578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b"
Jul 08 16:25:41.991935 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.991891    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b"} err="failed to get container status \"578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b\": rpc error: code = NotFound desc = could not find container \"578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b\": container with ID starting with 578983d5255cc7071e562d708c07dada283d69fea794f92466216491debc5e4b not found: ID does not exist"
Jul 08 16:25:41.996689 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:41.996666    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"]
Jul 08 16:25:42.002732 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:42.002712    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5689eb-openshift-default-65bd984459-x7qk7"]
Jul 08 16:25:42.269462 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:42.269429    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" path="/var/lib/kubelet/pods/e8ae8aae-a981-48e1-a621-289987c0d3c5/volumes"
Jul 08 16:25:45.618682 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.618641    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"]
Jul 08 16:25:45.619192 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.619059    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy"
Jul 08 16:25:45.619192 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.619074    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy"
Jul 08 16:25:45.619192 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.619085    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy"
Jul 08 16:25:45.619192 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.619093    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fd4f41-db3f-4e53-b309-ac25d42fae1e" containerName="istio-proxy"
Jul 08 16:25:45.619192 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.619181    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy"
Jul 08 16:25:45.622203 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.622181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.628046 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.628022    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f77711-openshift-default-dockercfg-n969h\""
Jul 08 16:25:45.639606 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.639565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"]
Jul 08 16:25:45.705037 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-socket\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705217 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-credential-socket\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705217 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-token\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705217 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-certs\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705217 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-envoy\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705433 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-data\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705433 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-podinfo\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705433 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istiod-ca-cert\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.705433 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.705411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g94n\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-kube-api-access-7g94n\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806446 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-podinfo\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806446 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istiod-ca-cert\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806756 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g94n\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-kube-api-access-7g94n\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806756 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-socket\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806756 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-credential-socket\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806756 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-token\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806966 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-certs\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.806966 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.806847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-envoy\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.807076 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.807031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-socket\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.807128 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.807108    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-certs\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.807270 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.807248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-data\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.807335 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.807289    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istiod-ca-cert\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.807390 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.807366    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-data\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.807622 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.807600    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-credential-socket\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.808969 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.808946    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-envoy\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.809085 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.809070    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-podinfo\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.824922 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.824895    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g94n\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-kube-api-access-7g94n\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.825008 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.824921    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-token\") pod \"e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") " pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:45.933825 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:45.933742    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:46.086259 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:46.086228    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"]
Jul 08 16:25:46.089500 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:25:46.089472    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4556dcc9_2f29_43b2_ba82_8c6d4edd2e25.slice/crio-becf44a33b6d925e43124dede377e44b2f2008ba8039f1c40d4869888165b30c WatchSource:0}: Error finding container becf44a33b6d925e43124dede377e44b2f2008ba8039f1c40d4869888165b30c: Status 404 returned error can't find the container with id becf44a33b6d925e43124dede377e44b2f2008ba8039f1c40d4869888165b30c
Jul 08 16:25:46.091534 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:46.091502    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:46.091663 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:46.091604    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:46.091663 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:46.091653    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:25:47.002209 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:47.002163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" event={"ID":"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25","Type":"ContainerStarted","Data":"9d9593f1a1f21d80ea5edd0a008560bfeac030b373afd0bf058b2e4db7145e8b"}
Jul 08 16:25:47.002669 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:47.002228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" event={"ID":"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25","Type":"ContainerStarted","Data":"becf44a33b6d925e43124dede377e44b2f2008ba8039f1c40d4869888165b30c"}
Jul 08 16:25:47.037990 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:47.037923    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podStartSLOduration=2.03790591 podStartE2EDuration="2.03790591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:25:47.034167168 +0000 UTC m=+2077.369175579" watchObservedRunningTime="2026-07-08 16:25:47.03790591 +0000 UTC m=+2077.372914321"
Jul 08 16:25:47.933967 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:47.933929    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:47.939132 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:47.939104    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:48.007333 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:48.007297    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:25:48.008098 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:25:48.008082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:26:03.131274 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:03.131229    2582 patch_prober.go:28] interesting pod/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:60794->10.134.0.57:15021: read: connection reset by peer" start-of-body=
Jul 08 16:26:03.131881 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:03.131312    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:60794->10.134.0.57:15021: read: connection reset by peer"
Jul 08 16:26:04.094662 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:04.094628    2582 generic.go:356] "Generic (PLEG): container finished" podID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerID="9d9593f1a1f21d80ea5edd0a008560bfeac030b373afd0bf058b2e4db7145e8b" exitCode=0
Jul 08 16:26:04.094867 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:04.094671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" event={"ID":"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25","Type":"ContainerDied","Data":"9d9593f1a1f21d80ea5edd0a008560bfeac030b373afd0bf058b2e4db7145e8b"}
Jul 08 16:26:04.095236 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:04.095203    2582 scope.go:117] "RemoveContainer" containerID="9d9593f1a1f21d80ea5edd0a008560bfeac030b373afd0bf058b2e4db7145e8b"
Jul 08 16:26:04.096716 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:04.096641    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:26:04.096831 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:04.096734    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:26:04.096831 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:04.096781    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 16:26:05.100885 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:05.100851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" event={"ID":"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25","Type":"ContainerStarted","Data":"1d866831a684e949a2f1966588682475743ee741f3d3d4d62750efed8a8a0446"}
Jul 08 16:26:05.934762 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:05.934732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:26:05.935048 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:05.934773    2582 patch_prober.go:28] interesting pod/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 16:26:05.935208 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:05.935186    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 16:26:06.934298 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:06.934265    2582 patch_prober.go:28] interesting pod/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 16:26:06.934916 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:06.934883    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 16:26:07.934734 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:07.934688    2582 patch_prober.go:28] interesting pod/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 16:26:07.935215 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:07.934762    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 16:26:08.934677 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:08.934640    2582 patch_prober.go:28] interesting pod/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 16:26:08.934972 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:08.934945    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 16:26:09.938746 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:09.938700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:26:09.939176 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:09.938980    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:26:09.939686 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:26:09.939667    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:31:45.353260 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.353178    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277386160"]
Jul 08 16:31:45.355815 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.353754    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy"
Jul 08 16:31:45.355815 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.353771    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy"
Jul 08 16:31:45.355815 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.353833    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ae8aae-a981-48e1-a621-289987c0d3c5" containerName="istio-proxy"
Jul 08 16:31:45.356649 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.356632    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160"
Jul 08 16:31:45.364745 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.364723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277386160"]
Jul 08 16:31:45.449705 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.449677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv2wz\" (UniqueName: \"kubernetes.io/projected/fee4d6ef-a589-4f4a-af1b-cf3ac1586969-kube-api-access-hv2wz\") pod \"test-curl-7569-140099277386160\" (UID: \"fee4d6ef-a589-4f4a-af1b-cf3ac1586969\") " pod="odh-ai-gateway-infra/test-curl-7569-140099277386160"
Jul 08 16:31:45.551157 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.551126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv2wz\" (UniqueName: \"kubernetes.io/projected/fee4d6ef-a589-4f4a-af1b-cf3ac1586969-kube-api-access-hv2wz\") pod \"test-curl-7569-140099277386160\" (UID: \"fee4d6ef-a589-4f4a-af1b-cf3ac1586969\") " pod="odh-ai-gateway-infra/test-curl-7569-140099277386160"
Jul 08 16:31:45.559449 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.559421    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv2wz\" (UniqueName: \"kubernetes.io/projected/fee4d6ef-a589-4f4a-af1b-cf3ac1586969-kube-api-access-hv2wz\") pod \"test-curl-7569-140099277386160\" (UID: \"fee4d6ef-a589-4f4a-af1b-cf3ac1586969\") " pod="odh-ai-gateway-infra/test-curl-7569-140099277386160"
Jul 08 16:31:45.666805 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.666723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160"
Jul 08 16:31:45.799979 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.799953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277386160"]
Jul 08 16:31:45.802626 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:31:45.802597    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfee4d6ef_a589_4f4a_af1b_cf3ac1586969.slice/crio-5e50c187b8787ef845dcba0f24fe96fa57f13a6e6326efdb349fbb03d17d4dd5 WatchSource:0}: Error finding container 5e50c187b8787ef845dcba0f24fe96fa57f13a6e6326efdb349fbb03d17d4dd5: Status 404 returned error can't find the container with id 5e50c187b8787ef845dcba0f24fe96fa57f13a6e6326efdb349fbb03d17d4dd5
Jul 08 16:31:45.803931 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.803911    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:31:45.818273 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:45.818250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160" event={"ID":"fee4d6ef-a589-4f4a-af1b-cf3ac1586969","Type":"ContainerStarted","Data":"5e50c187b8787ef845dcba0f24fe96fa57f13a6e6326efdb349fbb03d17d4dd5"}
Jul 08 16:31:46.824499 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:46.824467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160" event={"ID":"fee4d6ef-a589-4f4a-af1b-cf3ac1586969","Type":"ContainerStarted","Data":"bf4b632a1e7c07005987c595f99d4b1077c22421136d2e873ef7c8ead1b9a7a8"}
Jul 08 16:31:46.841741 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:46.841660    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160" podStartSLOduration=1.064136606 podStartE2EDuration="1.841646097s" totalImagesPullingTime="777.509491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:31:46.839622495 +0000 UTC m=+2437.174630909" watchObservedRunningTime="2026-07-08 16:31:46.841646097 +0000 UTC m=+2437.176654507"
Jul 08 16:31:56.874107 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:56.874071    2582 generic.go:356] "Generic (PLEG): container finished" podID="fee4d6ef-a589-4f4a-af1b-cf3ac1586969" containerID="bf4b632a1e7c07005987c595f99d4b1077c22421136d2e873ef7c8ead1b9a7a8" exitCode=28
Jul 08 16:31:56.874474 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:56.874121    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160" event={"ID":"fee4d6ef-a589-4f4a-af1b-cf3ac1586969","Type":"ContainerDied","Data":"bf4b632a1e7c07005987c595f99d4b1077c22421136d2e873ef7c8ead1b9a7a8"}
Jul 08 16:31:58.020076 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.020051    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160"
Jul 08 16:31:58.057156 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.057021    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv2wz\" (UniqueName: \"kubernetes.io/projected/fee4d6ef-a589-4f4a-af1b-cf3ac1586969-kube-api-access-hv2wz\") pod \"fee4d6ef-a589-4f4a-af1b-cf3ac1586969\" (UID: \"fee4d6ef-a589-4f4a-af1b-cf3ac1586969\") "
Jul 08 16:31:58.059523 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.059492    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee4d6ef-a589-4f4a-af1b-cf3ac1586969-kube-api-access-hv2wz" (OuterVolumeSpecName: "kube-api-access-hv2wz") pod "fee4d6ef-a589-4f4a-af1b-cf3ac1586969" (UID: "fee4d6ef-a589-4f4a-af1b-cf3ac1586969"). InnerVolumeSpecName "kube-api-access-hv2wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:58.060455 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.060435    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277386160"]
Jul 08 16:31:58.063479 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.063458    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277386160"]
Jul 08 16:31:58.158485 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.158403    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv2wz\" (UniqueName: \"kubernetes.io/projected/fee4d6ef-a589-4f4a-af1b-cf3ac1586969-kube-api-access-hv2wz\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:31:58.269186 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.269144    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fee4d6ef-a589-4f4a-af1b-cf3ac1586969" path="/var/lib/kubelet/pods/fee4d6ef-a589-4f4a-af1b-cf3ac1586969/volumes"
Jul 08 16:31:58.884904 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.884876    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277386160"
Jul 08 16:31:58.884904 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:31:58.884894    2582 scope.go:117] "RemoveContainer" containerID="bf4b632a1e7c07005987c595f99d4b1077c22421136d2e873ef7c8ead1b9a7a8"
Jul 08 16:32:24.916849 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:24.916814    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"]
Jul 08 16:32:24.917403 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:24.917090    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy" containerID="cri-o://1d866831a684e949a2f1966588682475743ee741f3d3d4d62750efed8a8a0446" gracePeriod=30
Jul 08 16:32:24.940868 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:24.940830    2582 patch_prober.go:28] interesting pod/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 16:32:24.941018 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:24.940890    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:32:30.040456 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.040419    2582 generic.go:356] "Generic (PLEG): container finished" podID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerID="1d866831a684e949a2f1966588682475743ee741f3d3d4d62750efed8a8a0446" exitCode=0
Jul 08 16:32:30.040456 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.040455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" event={"ID":"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25","Type":"ContainerDied","Data":"1d866831a684e949a2f1966588682475743ee741f3d3d4d62750efed8a8a0446"}
Jul 08 16:32:30.040971 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.040534    2582 scope.go:117] "RemoveContainer" containerID="9d9593f1a1f21d80ea5edd0a008560bfeac030b373afd0bf058b2e4db7145e8b"
Jul 08 16:32:30.044922 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.044901    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8trgd_0ba10f3c-1b8d-4f0b-abf8-87c945ea4567/manager/0.log"
Jul 08 16:32:30.163311 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.163285    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9ffrh_89898794-9b11-43d5-881b-9c649ee731d9/manager/0.log"
Jul 08 16:32:30.185151 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.185101    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:32:30.273883 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.273860    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78b877666-vfljw_251e731e-4e27-4c77-851b-e011717c3ced/manager/0.log"
Jul 08 16:32:30.336008 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.335980    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-token\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336155 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istiod-ca-cert\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336155 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336077    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-credential-socket\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336155 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336094    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-envoy\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336155 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336111    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-data\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336155 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336143    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g94n\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-kube-api-access-7g94n\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336416 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336197    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-socket\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336416 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-podinfo\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336416 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336287    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-certs\") pod \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\" (UID: \"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25\") "
Jul 08 16:32:30.336416 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336398    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:32:30.336657 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336500    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:32:30.336758 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336739    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:32:30.336967 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.336943    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:32:30.337276 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.337252    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istiod-ca-cert\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.337383 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.337281    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-credential-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.337383 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.337296    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-socket\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.337383 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.337311    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-workload-certs\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.337609 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.337562    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-data" (OuterVolumeSpecName: "istio-data") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:32:30.338452 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.338420    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-token" (OuterVolumeSpecName: "istio-token") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:32:30.338452 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.338422    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:32:30.338599 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.338516    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-kube-api-access-7g94n" (OuterVolumeSpecName: "kube-api-access-7g94n") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "kube-api-access-7g94n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:32:30.338658 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.338568    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" (UID: "4556dcc9-2f29-43b2-ba82-8c6d4edd2e25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:32:30.386800 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.386778    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fsk44_818ecf57-d215-4e7d-98b2-55e8011c50a0/server/0.log"
Jul 08 16:32:30.438546 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.438459    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-envoy\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.438546 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.438488    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-data\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.438546 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.438502    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g94n\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-kube-api-access-7g94n\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.438546 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.438518    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-podinfo\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.438546 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.438531    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25-istio-token\") on node \"ip-10-0-132-153.ec2.internal\" DevicePath \"\""
Jul 08 16:32:30.504834 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.504807    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j2m56_949b136a-314b-4d4b-98f5-8499a235a8ba/manager/0.log"
Jul 08 16:32:30.618345 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.618324    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-4rj78_e9a50bda-ad66-4746-b48e-2cc5fa2d4dda/copy-manifests/0.log"
Jul 08 16:32:30.624762 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:30.624743    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-4rj78_e9a50bda-ad66-4746-b48e-2cc5fa2d4dda/manager/0.log"
Jul 08 16:32:31.047951 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:31.047920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv" event={"ID":"4556dcc9-2f29-43b2-ba82-8c6d4edd2e25","Type":"ContainerDied","Data":"becf44a33b6d925e43124dede377e44b2f2008ba8039f1c40d4869888165b30c"}
Jul 08 16:32:31.047951 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:31.047947    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"
Jul 08 16:32:31.048497 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:31.047978    2582 scope.go:117] "RemoveContainer" containerID="1d866831a684e949a2f1966588682475743ee741f3d3d4d62750efed8a8a0446"
Jul 08 16:32:31.070074 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:31.070047    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"]
Jul 08 16:32:31.074457 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:31.074432    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f77711-openshift-default-66b4848b59-lhbgv"]
Jul 08 16:32:32.268560 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:32.268528    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" path="/var/lib/kubelet/pods/4556dcc9-2f29-43b2-ba82-8c6d4edd2e25/volumes"
Jul 08 16:32:32.285765 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:32.285742    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-slvnx_2106d375-d28f-438d-b319-9a9c38d61d4f/manager/0.log"
Jul 08 16:32:32.400035 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:32.400010    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-j6fbb_82e8a8a5-de1c-4518-98ef-713a26c80956/manager/0.log"
Jul 08 16:32:32.639670 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:32.639643    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-clf2j_1dc7fd5d-e33c-42b6-a99d-4769f3c982fd/registry-server/0.log"
Jul 08 16:32:32.759331 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:32.759302    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jcdjf_c959de83-79a1-42da-a1e4-bcc51fb10e58/manager/0.log"
Jul 08 16:32:33.358159 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:33.358130    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgd5s_5db36d26-c9ed-43fb-9ac9-1c88a0a9876e/istio-proxy/0.log"
Jul 08 16:32:33.588007 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:33.587975    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-dh5nk_2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd/kube-auth-proxy/0.log"
Jul 08 16:32:33.819256 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:33.819231    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j267w_29b314d7-b614-49f8-95d6-50e5e048b850/istio-proxy/1.log"
Jul 08 16:32:33.937429 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:33.937402    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-kgfvb_14a1415d-1d25-452a-8149-10ac569fd603/payload-pre-processing/0.log"
Jul 08 16:32:34.053784 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:34.053752    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-szn5n_f1da2a09-6206-4b59-9b01-fca48acd1097/payload-processing/0.log"
Jul 08 16:32:34.628882 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:34.628857    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-sz5xc_bd94ff07-bb2c-4b9e-b39f-275ea79d6f68/main/0.log"
Jul 08 16:32:34.739336 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:34.739308    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7wdn8_0992665a-875a-473f-8ced-f03fb04ba6df/main/0.log"
Jul 08 16:32:35.097698 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:35.097670    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-kjl2q_997b87d2-7712-4a43-a267-acd93f88caf4/main/0.log"
Jul 08 16:32:42.227428 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:42.227400    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rk9tn_3e61b13c-f4ff-475d-98fa-0811b52489c9/global-pull-secret-syncer/0.log"
Jul 08 16:32:42.352824 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:42.352791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8vzcx_d97ff5eb-3ed3-4d90-a6cf-07821cfca55a/konnectivity-agent/0.log"
Jul 08 16:32:42.433931 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:42.433905    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-153.ec2.internal_76f545655aaf67c28ab8f818d0661269/haproxy/0.log"
Jul 08 16:32:47.561274 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:47.561247    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-slvnx_2106d375-d28f-438d-b319-9a9c38d61d4f/manager/0.log"
Jul 08 16:32:47.593123 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:47.593100    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-j6fbb_82e8a8a5-de1c-4518-98ef-713a26c80956/manager/0.log"
Jul 08 16:32:47.672634 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:47.672607    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-clf2j_1dc7fd5d-e33c-42b6-a99d-4769f3c982fd/registry-server/0.log"
Jul 08 16:32:47.787592 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:47.787535    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jcdjf_c959de83-79a1-42da-a1e4-bcc51fb10e58/manager/0.log"
Jul 08 16:32:49.878287 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:49.878255    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-z57rb_c09fdcdc-95af-430d-8071-adbf5edc1378/monitoring-plugin/0.log"
Jul 08 16:32:50.020468 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:50.020392    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-smghm_404a01b5-78d3-493f-b2f7-b7e9ca8f139c/node-exporter/0.log"
Jul 08 16:32:50.058641 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:50.058616    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-smghm_404a01b5-78d3-493f-b2f7-b7e9ca8f139c/kube-rbac-proxy/0.log"
Jul 08 16:32:50.080626 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:50.080573    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-smghm_404a01b5-78d3-493f-b2f7-b7e9ca8f139c/init-textfile/0.log"
Jul 08 16:32:50.525345 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:50.525315    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddd858755-5ctvj_3533ec01-e272-40cb-942d-0dcb99e8acc7/telemeter-client/0.log"
Jul 08 16:32:50.548563 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:50.548538    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddd858755-5ctvj_3533ec01-e272-40cb-942d-0dcb99e8acc7/reload/0.log"
Jul 08 16:32:50.573202 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:50.573175    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddd858755-5ctvj_3533ec01-e272-40cb-942d-0dcb99e8acc7/kube-rbac-proxy/0.log"
Jul 08 16:32:52.831220 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831194    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"]
Jul 08 16:32:52.831734 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831695    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy"
Jul 08 16:32:52.831734 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831720    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy"
Jul 08 16:32:52.831945 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831743    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee4d6ef-a589-4f4a-af1b-cf3ac1586969" containerName="test-curl-7569-140099277386160"
Jul 08 16:32:52.831945 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831752    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee4d6ef-a589-4f4a-af1b-cf3ac1586969" containerName="test-curl-7569-140099277386160"
Jul 08 16:32:52.831945 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831770    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy"
Jul 08 16:32:52.831945 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831778    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy"
Jul 08 16:32:52.831945 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831867    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy"
Jul 08 16:32:52.831945 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831877    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4556dcc9-2f29-43b2-ba82-8c6d4edd2e25" containerName="istio-proxy"
Jul 08 16:32:52.831945 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.831886    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fee4d6ef-a589-4f4a-af1b-cf3ac1586969" containerName="test-curl-7569-140099277386160"
Jul 08 16:32:52.834979 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.834960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:52.837657 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.837637    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7sqg6\"/\"default-dockercfg-89vfp\""
Jul 08 16:32:52.838188 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.838169    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7sqg6\"/\"openshift-service-ca.crt\""
Jul 08 16:32:52.838513 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.838497    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7sqg6\"/\"kube-root-ca.crt\""
Jul 08 16:32:52.843689 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.843665    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"]
Jul 08 16:32:52.931808 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.931777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-podres\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:52.932011 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.931867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7s8q\" (UniqueName: \"kubernetes.io/projected/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-kube-api-access-p7s8q\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:52.932011 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.931954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-lib-modules\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:52.932011 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.931996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-proc\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:52.932157 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:52.932030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-sys\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.032947 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.032911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-proc\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.032947 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.032949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-sys\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.033193 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.032969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-podres\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.033193 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.033037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7s8q\" (UniqueName: \"kubernetes.io/projected/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-kube-api-access-p7s8q\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.033193 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.033049    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-proc\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.033193 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.033061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-sys\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.033193 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.033070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-lib-modules\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.033193 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.033166    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-lib-modules\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.033439 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.033203    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-podres\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.041238 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.041219    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7s8q\" (UniqueName: \"kubernetes.io/projected/8a5c8b68-b037-433e-9d31-b63bb5ddc36a-kube-api-access-p7s8q\") pod \"perf-node-gather-daemonset-xgfng\" (UID: \"8a5c8b68-b037-433e-9d31-b63bb5ddc36a\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.145378 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.145302    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:53.155223 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.155195    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-548567875c-4skf2_999dbc4e-b0d4-4828-98e8-b5467386c30a/console/0.log"
Jul 08 16:32:53.285600 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:53.285552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"]
Jul 08 16:32:53.287858 ip-10-0-132-153 kubenswrapper[2582]: W0708 16:32:53.287830    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a5c8b68_b037_433e_9d31_b63bb5ddc36a.slice/crio-a6d82807ea577cfe00cf2187ccb07aaa6c1b342d9de3d21213a8e42b28a2ff85 WatchSource:0}: Error finding container a6d82807ea577cfe00cf2187ccb07aaa6c1b342d9de3d21213a8e42b28a2ff85: Status 404 returned error can't find the container with id a6d82807ea577cfe00cf2187ccb07aaa6c1b342d9de3d21213a8e42b28a2ff85
Jul 08 16:32:54.168447 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:54.168406    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng" event={"ID":"8a5c8b68-b037-433e-9d31-b63bb5ddc36a","Type":"ContainerStarted","Data":"21c43ac0c125f5f157c7fa182471e3482fb282565d57a01a7edc70c47341f71f"}
Jul 08 16:32:54.168850 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:54.168468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng" event={"ID":"8a5c8b68-b037-433e-9d31-b63bb5ddc36a","Type":"ContainerStarted","Data":"a6d82807ea577cfe00cf2187ccb07aaa6c1b342d9de3d21213a8e42b28a2ff85"}
Jul 08 16:32:54.168850 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:54.168508    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:32:54.185964 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:54.185920    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng" podStartSLOduration=2.18590507 podStartE2EDuration="2.18590507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:32:54.184320937 +0000 UTC m=+2504.519329349" watchObservedRunningTime="2026-07-08 16:32:54.18590507 +0000 UTC m=+2504.520913480"
Jul 08 16:32:54.835654 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:54.835622    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8xnhs_c0c4fae1-b722-44bf-8e8a-ac14c732b1d0/dns/0.log"
Jul 08 16:32:54.856662 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:54.856634    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8xnhs_c0c4fae1-b722-44bf-8e8a-ac14c732b1d0/kube-rbac-proxy/0.log"
Jul 08 16:32:55.026416 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:55.026384    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j78nd_c685588d-0142-42ca-992a-18d4ec25cb8c/dns-node-resolver/0.log"
Jul 08 16:32:55.621685 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:55.621657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qwt6_4e0d6ed7-9388-4031-b5c7-fe89d32f7907/node-ca/0.log"
Jul 08 16:32:56.604415 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:56.604384    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgd5s_5db36d26-c9ed-43fb-9ac9-1c88a0a9876e/istio-proxy/0.log"
Jul 08 16:32:56.829283 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:56.829252    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-dh5nk_2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd/kube-auth-proxy/0.log"
Jul 08 16:32:56.883435 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:56.883364    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j267w_29b314d7-b614-49f8-95d6-50e5e048b850/istio-proxy/0.log"
Jul 08 16:32:56.910837 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:56.910792    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j267w_29b314d7-b614-49f8-95d6-50e5e048b850/istio-proxy/1.log"
Jul 08 16:32:56.951144 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:56.951117    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-kgfvb_14a1415d-1d25-452a-8149-10ac569fd603/payload-pre-processing/0.log"
Jul 08 16:32:56.996502 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:56.996477    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-szn5n_f1da2a09-6206-4b59-9b01-fca48acd1097/payload-processing/0.log"
Jul 08 16:32:57.786562 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:57.786535    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p6x6r_d22e1688-1c81-446d-bacd-9267421e8538/serve-healthcheck-canary/0.log"
Jul 08 16:32:58.444383 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:58.444354    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trww9_6ea18122-ff82-4685-9fd0-0a8622439b62/kube-rbac-proxy/0.log"
Jul 08 16:32:58.469023 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:58.469000    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trww9_6ea18122-ff82-4685-9fd0-0a8622439b62/exporter/0.log"
Jul 08 16:32:58.492093 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:32:58.492073    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trww9_6ea18122-ff82-4685-9fd0-0a8622439b62/extractor/0.log"
Jul 08 16:33:00.183980 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:00.183956    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-xgfng"
Jul 08 16:33:00.695369 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:00.695345    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8trgd_0ba10f3c-1b8d-4f0b-abf8-87c945ea4567/manager/0.log"
Jul 08 16:33:00.833862 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:00.833830    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9ffrh_89898794-9b11-43d5-881b-9c649ee731d9/manager/0.log"
Jul 08 16:33:00.924415 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:00.924383    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78b877666-vfljw_251e731e-4e27-4c77-851b-e011717c3ced/manager/0.log"
Jul 08 16:33:00.950551 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:00.950471    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fsk44_818ecf57-d215-4e7d-98b2-55e8011c50a0/server/0.log"
Jul 08 16:33:01.017311 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:01.017259    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j2m56_949b136a-314b-4d4b-98f5-8499a235a8ba/manager/0.log"
Jul 08 16:33:01.044873 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:01.044847    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-4rj78_e9a50bda-ad66-4746-b48e-2cc5fa2d4dda/manager/0.log"
Jul 08 16:33:01.064886 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:01.064860    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-4rj78_e9a50bda-ad66-4746-b48e-2cc5fa2d4dda/copy-manifests/0.log"
Jul 08 16:33:02.413710 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:02.413623    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-l4zkr_b93c6f84-fed0-4a92-940f-18ad3432c3ab/openshift-lws-operator/0.log"
Jul 08 16:33:02.798290 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:02.798190    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgd5s_5db36d26-c9ed-43fb-9ac9-1c88a0a9876e/istio-proxy/0.log"
Jul 08 16:33:03.009906 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:03.009876    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-dh5nk_2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd/kube-auth-proxy/0.log"
Jul 08 16:33:03.075283 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:03.075249    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j267w_29b314d7-b614-49f8-95d6-50e5e048b850/istio-proxy/0.log"
Jul 08 16:33:03.103130 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:03.103104    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j267w_29b314d7-b614-49f8-95d6-50e5e048b850/istio-proxy/1.log"
Jul 08 16:33:03.135012 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:03.134971    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-kgfvb_14a1415d-1d25-452a-8149-10ac569fd603/payload-pre-processing/0.log"
Jul 08 16:33:03.171259 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:03.171232    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-szn5n_f1da2a09-6206-4b59-9b01-fca48acd1097/payload-processing/0.log"
Jul 08 16:33:04.512401 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:04.512327    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgd5s_5db36d26-c9ed-43fb-9ac9-1c88a0a9876e/istio-proxy/0.log"
Jul 08 16:33:04.715377 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:04.715353    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-dh5nk_2d27e5f0-98d8-44d8-a0fc-ed7d60584bbd/kube-auth-proxy/0.log"
Jul 08 16:33:04.757568 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:04.757543    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j267w_29b314d7-b614-49f8-95d6-50e5e048b850/istio-proxy/0.log"
Jul 08 16:33:04.785388 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:04.785310    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j267w_29b314d7-b614-49f8-95d6-50e5e048b850/istio-proxy/1.log"
Jul 08 16:33:04.817990 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:04.817959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-kgfvb_14a1415d-1d25-452a-8149-10ac569fd603/payload-pre-processing/0.log"
Jul 08 16:33:04.860622 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:04.860570    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-szn5n_f1da2a09-6206-4b59-9b01-fca48acd1097/payload-processing/0.log"
Jul 08 16:33:09.656693 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.656664    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qr5mc_d59b06dc-437a-4526-8372-6ba146f1a161/kube-multus-additional-cni-plugins/0.log"
Jul 08 16:33:09.677686 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.677662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qr5mc_d59b06dc-437a-4526-8372-6ba146f1a161/egress-router-binary-copy/0.log"
Jul 08 16:33:09.698072 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.698050    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qr5mc_d59b06dc-437a-4526-8372-6ba146f1a161/cni-plugins/0.log"
Jul 08 16:33:09.718692 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.718675    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qr5mc_d59b06dc-437a-4526-8372-6ba146f1a161/bond-cni-plugin/0.log"
Jul 08 16:33:09.746933 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.746918    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qr5mc_d59b06dc-437a-4526-8372-6ba146f1a161/routeoverride-cni/0.log"
Jul 08 16:33:09.773241 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.773222    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qr5mc_d59b06dc-437a-4526-8372-6ba146f1a161/whereabouts-cni-bincopy/0.log"
Jul 08 16:33:09.794452 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.794430    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qr5mc_d59b06dc-437a-4526-8372-6ba146f1a161/whereabouts-cni/0.log"
Jul 08 16:33:09.829848 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.829822    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b6gdj_2e4bc244-edd0-43af-8ed9-3e5ddc0474c7/kube-multus/0.log"
Jul 08 16:33:09.969048 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.968981    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8f8fs_13cc6289-8a1b-4347-9687-113b9395d3cb/network-metrics-daemon/0.log"
Jul 08 16:33:09.987086 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:09.987069    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8f8fs_13cc6289-8a1b-4347-9687-113b9395d3cb/kube-rbac-proxy/0.log"
Jul 08 16:33:11.321631 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:11.321602    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4l47_ff233a99-4d07-47cb-9f03-e153bf26f76e/ovn-controller/0.log"
Jul 08 16:33:11.342221 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:11.342198    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4l47_ff233a99-4d07-47cb-9f03-e153bf26f76e/ovn-acl-logging/0.log"
Jul 08 16:33:11.369094 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:11.369076    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4l47_ff233a99-4d07-47cb-9f03-e153bf26f76e/kube-rbac-proxy-node/0.log"
Jul 08 16:33:11.389799 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:11.389765    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4l47_ff233a99-4d07-47cb-9f03-e153bf26f76e/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 16:33:11.411771 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:11.411739    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4l47_ff233a99-4d07-47cb-9f03-e153bf26f76e/northd/0.log"
Jul 08 16:33:11.432108 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:11.432090    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4l47_ff233a99-4d07-47cb-9f03-e153bf26f76e/nbdb/0.log"
Jul 08 16:33:11.453133 ip-10-0-132-153 kubenswrapper[2582]: I0708 16:33:11.453101    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4l47_ff233a99-4d07-47cb-9f03-e153bf26f76e/sbdb/0.log"