Jul 14 19:49:41.046414 ip-10-0-139-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 19:49:41.046427 ip-10-0-139-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 19:49:41.046438 ip-10-0-139-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 19:49:41.046761 ip-10-0-139-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 19:49:51.116230 ip-10-0-139-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 19:49:51.116247 ip-10-0-139-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4a0ec29cda4f4e5894a0d1de43ef0c68 --
Jul 14 19:51:27.230476 ip-10-0-139-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.674922    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679007    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679018    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679021    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679025    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679027    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679030    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679033    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:27.753587 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679035    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679038    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679041    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679044    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679047    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679049    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679053    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679055    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679057    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679065    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679068    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679070    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679073    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679075    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679078    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679080    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679083    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679085    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679088    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679092    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:27.979636 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679095    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:27.757433 ip-10-0-139-187 systemd[1]: Started Kubernetes Kubelet.
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679098    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679100    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679103    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679106    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679108    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679111    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679114    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679117    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679120    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679123    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679126    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679128    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679131    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679150    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679155    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679157    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679160    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679163    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679166    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:27.990961 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679169    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679174    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679178    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679181    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679184    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679188    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679191    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679194    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679197    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679199    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679202    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679204    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679207    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679209    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679212    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679214    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679217    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679219    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679222    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679224    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:27.992667 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679228    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679230    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679233    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679236    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679238    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679241    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679243    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679246    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679249    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679252    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679254    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679258    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679261    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679264    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679267    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679270    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679272    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679275    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679278    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:27.994047 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679280    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679283    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679285    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679287    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679290    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679292    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679295    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679297    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679300    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679304    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679307    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679310    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679313    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679971    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679979    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679983    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679986    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679989    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679992    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:27.994921 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679995    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.679998    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680001    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680004    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680006    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680009    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680012    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680014    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680017    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680019    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680022    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680027    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680029    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680032    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680035    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680037    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680040    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680043    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680045    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680049    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:27.995831 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680053    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680056    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680060    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680062    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680065    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680068    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680071    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680074    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680077    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680080    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680082    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680085    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680089    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680092    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680094    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680097    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680100    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680102    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680105    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680107    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:27.996696 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680110    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680113    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680115    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680119    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680121    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680124    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680127    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680129    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680151    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680157    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680161    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680163    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680166    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680168    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680171    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680173    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680176    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680179    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680181    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:27.997613 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680184    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680186    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680189    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680191    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680194    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680198    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680200    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680203    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680205    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680208    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680210    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680213    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680215    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680218    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680221    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680224    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680228    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680231    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680233    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680236    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:27.998510 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680238    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680241    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680243    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680246    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680248    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680251    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680253    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680256    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680258    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680261    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680263    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680266    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680268    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680271    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680610    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680614    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680617    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680621    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680624    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680626    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:27.999620 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680629    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680632    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680634    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680637    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680640    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680642    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680645    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680648    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680652    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680655    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680657    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680660    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680664    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680668    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680670    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680673    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680676    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680679    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680682    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:28.000532 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680685    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680687    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680690    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680693    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680696    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680699    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680703    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680706    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680709    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680712    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680716    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680719    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680721    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680724    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680727    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680729    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680732    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680734    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680737    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680740    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:28.001427 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680742    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680747    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680750    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680752    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680755    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680757    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680760    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680762    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680765    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680767    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680770    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680772    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680775    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680777    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680780    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680782    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680785    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680787    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680790    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680793    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:28.002347 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680795    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680797    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680801    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680804    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680806    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680809    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680813    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680815    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680817    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680820    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680822    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680825    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680827    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680830    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680833    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680836    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680839    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680841    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680844    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680846    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:28.003555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680849    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680851    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680855    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680858    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680861    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680863    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680866    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680868    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680871    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680873    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680876    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680878    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680881    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.680883    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680952    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680958    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680965    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680970    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680973    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680976    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680980    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 19:51:28.004503 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680984    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680988    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680991    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680994    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.680998    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681001    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681005    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681008    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681011    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681014    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681017    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681021    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681024    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681027    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681030    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681033    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681037    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681040    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681043    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681046    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681049    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681051    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681054    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681057    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 19:51:28.005391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681060    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681066    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681069    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681072    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681074    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681077    2576 flags.go:64] FLAG: --enable-server="true"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681080    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681085    2576 flags.go:64] FLAG: --event-burst="100"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681088    2576 flags.go:64] FLAG: --event-qps="50"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681091    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681094    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681097    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681102    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681105    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681108    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681111    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681114    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681117    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681120    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681123    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681126    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681129    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681132    2576 flags.go:64] FLAG: --feature-gates=""
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681157    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681160    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 19:51:28.006539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681163    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681166    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681169    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681173    2576 flags.go:64] FLAG: --help="false"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681175    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681179    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681182    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681185    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681190    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681193    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681196    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681199    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681202    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681205    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681208    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681211    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681213    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681216    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681219    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681225    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681228    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681230    2576 flags.go:64] FLAG: --lock-file=""
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681233    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681237    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 19:51:28.007682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681240    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681246    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681248    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681251    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681254    2576 flags.go:64] FLAG: --logging-format="text"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681257    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681260    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681263    2576 flags.go:64] FLAG: --manifest-url=""
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681266    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681270    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681273    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681277    2576 flags.go:64] FLAG: --max-pods="110"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681279    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681282    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681285    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681288    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681292    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681295    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681298    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681305    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681308    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681311    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681314    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 14 19:51:28.008814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681317    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681322    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681325    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681328    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681331    2576 flags.go:64] FLAG: --port="10250"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681336    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681339    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08030aa18360e60d2"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681342    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681345    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681348    2576 flags.go:64] FLAG: --register-node="true"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681351    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681354    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681357    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681360    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681363    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681366    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681369    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681372    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681375    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681378    2576 flags.go:64] FLAG: --runonce="false"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681380    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681383    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681386    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681389    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681392    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681396    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 19:51:28.009945 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681399    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681402    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681405    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681408    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681410    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681413    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681416    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681419    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681422    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681427    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681429    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681434    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681438    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681440    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681443    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681446    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681449    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681452    2576 flags.go:64] FLAG: --v="2"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681455    2576 flags.go:64] FLAG: --version="false"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681459    2576 flags.go:64] FLAG: --vmodule=""
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681463    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.681466    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681942    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681954    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681960    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:28.013446 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681965    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681969    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681974    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681978    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681989    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.681993    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682000    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682004    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682009    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682016    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682021    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682026    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682031    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682035    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682040    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682044    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682049    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682059    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682065    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:28.014579 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682069    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682073    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682077    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682081    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682086    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682091    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682096    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682102    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682106    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682110    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682120    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682124    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682129    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682133    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682153    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682158    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682162    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682166    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682171    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:28.021747 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682177    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682184    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682189    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682194    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682203    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682207    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682212    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682216    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682220    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682225    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682229    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682233    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682240    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682244    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682248    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682253    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682262    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682266    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682270    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:28.022690 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682275    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682279    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682283    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682287    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682292    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682296    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682300    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682304    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682308    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682313    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682322    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682346    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682351    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682356    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682399    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682412    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682505    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682509    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682511    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682514    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:28.023590 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682517    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682520    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682523    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682526    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682529    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682531    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682534    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682537    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682539    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682542    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682544    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682547    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682550    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682552    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682555    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682562    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682565    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682568    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:28.024493 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.682570    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.682577    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.690111    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.690126    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.691115    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.691126    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691197    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691204    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691208    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691211    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691214    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691217    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691221    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691223    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:28.025378 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691226    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691229    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691231    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691234    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691237    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691239    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691242    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691245    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691247    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691249    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691253    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691257    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691260    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691263    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691266    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691268    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691271    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691274    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691277    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691280    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:28.026075 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691283    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691286    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691288    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691291    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691293    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691296    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691299    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691301    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691303    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691306    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691308    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691311    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691313    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691316    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691319    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691322    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691324    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691327    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691329    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:28.026973 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691332    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691334    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691337    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691339    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691342    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691345    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691348    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691350    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691353    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691355    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691358    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691363    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691366    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691368    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691371    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691373    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691378    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691381    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691384    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:28.027863 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691387    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691390    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691393    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691396    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691399    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691401    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691404    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691406    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691409    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691412    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691414    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691416    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691419    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691421    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691424    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691428    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691431    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691434    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691437    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691439    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:28.028749 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691442    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691445    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691447    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691450    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691454    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691458    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691462    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691465    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691468    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691471    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691474    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691477    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691479    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.691485    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:28.029626 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691597    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691603    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691606    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691609    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691612    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691614    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691617    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691620    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691623    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691626    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691629    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691631    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691634    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691637    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691641    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691644    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691647    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691650    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691652    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691655    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:28.030303 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691657    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691660    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691664    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691667    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691670    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691673    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691675    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691678    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691681    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691683    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691686    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691689    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691691    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691694    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691696    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691699    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691702    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691704    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691707    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691709    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:28.031406 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691711    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691714    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691717    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691719    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691721    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691724    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691730    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691732    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691734    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691737    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691739    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691743    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691747    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691750    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691754    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691757    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691759    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691762    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691765    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:28.032483 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691768    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691770    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691773    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691775    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691778    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691780    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691783    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691785    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691788    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691790    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691793    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691795    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691798    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691800    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691803    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691805    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691808    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691811    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691813    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691817    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:28.033390 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691819    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691822    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691824    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691827    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691831    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691834    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691836    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691840    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691843    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691845    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691848    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691851    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691853    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691856    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691858    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691861    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691863    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691866    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691870    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:28.034561 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:27.691873    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.691878    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.691975    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.694241    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.695681    2576 server.go:1019] "Starting client certificate rotation"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.695780    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.695811    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.698444    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.701517    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.714784    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.718613    2576 log.go:25] "Validated CRI v1 image API"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.719451    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 19:51:28.170394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.723786    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8d26038f-ccda-4990-9ff6-1994c03f3300:/dev/nvme0n1p4 d6e11b43-0969-446b-99fc-d595e3f29711:/dev/nvme0n1p3]
Jul 14 19:51:28.171397 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.723801    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 19:51:28.171397 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.726217    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.731155    2576 manager.go:216] Machine: {Timestamp:2026-07-14 19:51:27.728447563 +0000 UTC m=+0.371020123 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098821 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ccb3eb9dd71538b91c5e9e89a4a6 SystemUUID:ec20ccb3-eb9d-d715-38b9-1c5e9e89a4a6 BootID:4a0ec29c-da4f-4e58-94a0-d1de43ef0c68 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:38:f2:dc:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:38:f2:dc:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:af:99:89:59:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.731254    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.731330    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.739052    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.739075    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.739879    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.739888    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.739896    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.739918    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.741336    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.744878    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.744989    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.745015    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.745024    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.745039    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.745048    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.745056    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 19:51:28.172024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.745464    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.745482    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.748062    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750455    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750492    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750668    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750684    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750692    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750701    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750712    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.750720    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.751431    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.751441    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.751449    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.751457    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.751475    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.751486    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.753331    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.753341    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.755441    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.755442    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.755500    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.756693    2576 server.go:1268] "Started kubelet"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.756764    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.756784    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.756804    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.757944    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.758469    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.761570    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-187.ec2.internal.18c23fec962c8318  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-187.ec2.internal,UID:ip-10-0-139-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-187.ec2.internal,},FirstTimestamp:2026-07-14 19:51:27.756469016 +0000 UTC m=+0.399041577,LastTimestamp:2026-07-14 19:51:27.756469016 +0000 UTC m=+0.399041577,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-187.ec2.internal,}"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.764132    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.765514    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.765515    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.765610    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.767195    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.767472    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.767493    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.767615    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.767623    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768222    2576 factory.go:55] Registering systemd factory
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768251    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768423    2576 factory.go:153] Registering CRI-O factory
Jul 14 19:51:28.172908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768436    2576 factory.go:223] Registration of the crio container factory successfully
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768493    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768515    2576 factory.go:103] Registering Raw factory
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768529    2576 manager.go:1196] Started watching for new ooms in manager
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.768867    2576 manager.go:349] Starting recovery of all containers
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.777452    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8l2m"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.777733    2576 manager.go:354] Recovery completed
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.781386    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.784318    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.784806    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.786832    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8l2m"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.787490    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.787509    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.787519    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.788111    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.788120    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.788149    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.788422    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.789432    2576 policy_none.go:49] "None policy: Start"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.789445    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.789457    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.789922    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.789948    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.789962    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.790909    2576 policy_none.go:47] "Start"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.838773    2576 manager.go:337] "Starting Device Plugin manager"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.838817    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.838827    2576 server.go:87] "Starting device plugin registration server"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.839042    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.839053    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.839169    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.839291    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.839299    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.839699    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.839748    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.939958    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.940885    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.940915    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.940932    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.940963    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:27.950652    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.950670    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-187.ec2.internal\": node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:27.982643    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.048336    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.049452    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 19:51:28.177836 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.049490    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.049516    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.049556    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.051822    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.083174    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.150334    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal"]
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.150418    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.155131    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.155209    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.155224    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.156416    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.156529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.156562    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.157085    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.157106    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.157106    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.157120    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.157155    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.157169    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.158316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.158342    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.158987    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.159007    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.159021    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.169672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00413e5f6730abed73a8bdf7f9d98721-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal\" (UID: \"00413e5f6730abed73a8bdf7f9d98721\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.169698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d48ced1008c46a99937ed2f0f9a90832-config\") pod \"kube-apiserver-proxy-ip-10-0-139-187.ec2.internal\" (UID: \"d48ced1008c46a99937ed2f0f9a90832\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.179603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.169720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00413e5f6730abed73a8bdf7f9d98721-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal\" (UID: \"00413e5f6730abed73a8bdf7f9d98721\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.191069    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.214659    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-187.ec2.internal\" not found" node="ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.218250    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-187.ec2.internal\" not found" node="ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.269925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d48ced1008c46a99937ed2f0f9a90832-config\") pod \"kube-apiserver-proxy-ip-10-0-139-187.ec2.internal\" (UID: \"d48ced1008c46a99937ed2f0f9a90832\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.269947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00413e5f6730abed73a8bdf7f9d98721-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal\" (UID: \"00413e5f6730abed73a8bdf7f9d98721\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.269965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00413e5f6730abed73a8bdf7f9d98721-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal\" (UID: \"00413e5f6730abed73a8bdf7f9d98721\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.270007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00413e5f6730abed73a8bdf7f9d98721-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal\" (UID: \"00413e5f6730abed73a8bdf7f9d98721\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.270026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d48ced1008c46a99937ed2f0f9a90832-config\") pod \"kube-apiserver-proxy-ip-10-0-139-187.ec2.internal\" (UID: \"d48ced1008c46a99937ed2f0f9a90832\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.270034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00413e5f6730abed73a8bdf7f9d98721-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal\" (UID: \"00413e5f6730abed73a8bdf7f9d98721\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.303754 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.291471    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.490662 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.391983    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.630871 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.492506    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.630871 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.517685    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.630871 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.521295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:28.630871 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:28.593263    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:28.630871 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:28.630689    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:30.494419    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.495502    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.495634    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.495671    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.590594    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 19:46:29 +0000 UTC" deadline="2027-12-30 14:08:51.984272429 +0000 UTC"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.590617    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12810h17m21.393657955s"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:30.594729    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-187.ec2.internal\" not found"
Jul 14 19:51:30.629206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.616202    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:30.794068 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.666185    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:30.794068 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.680068    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:51:30.794068 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.681901    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal"
Jul 14 19:51:30.794068 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.688759    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:51:30.794068 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.768581    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:31.081450 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:30.982928    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00413e5f6730abed73a8bdf7f9d98721.slice/crio-23e88a1b285a5123f5d077a334484ff5fa4f6faff4dc1f8244f9f49b8e2ff031 WatchSource:0}: Error finding container 23e88a1b285a5123f5d077a334484ff5fa4f6faff4dc1f8244f9f49b8e2ff031: Status 404 returned error can't find the container with id 23e88a1b285a5123f5d077a334484ff5fa4f6faff4dc1f8244f9f49b8e2ff031
Jul 14 19:51:31.081450 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:30.988409    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:51:31.444251 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:31.314563    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48ced1008c46a99937ed2f0f9a90832.slice/crio-fae417e1fee62e151136911338554eba2ba48f82823649578c5c7eac570160f9 WatchSource:0}: Error finding container fae417e1fee62e151136911338554eba2ba48f82823649578c5c7eac570160f9: Status 404 returned error can't find the container with id fae417e1fee62e151136911338554eba2ba48f82823649578c5c7eac570160f9
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.546096    2576 apiserver.go:52] "Watching apiserver"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.556388    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.556763    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-9zzjl","openshift-ovn-kubernetes/ovnkube-node-rxh4w","kube-system/konnectivity-agent-lpdd2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7","openshift-dns/node-resolver-fm5x5","openshift-multus/multus-rtbxv","openshift-network-diagnostics/network-check-target-sc6nd","openshift-network-operator/iptables-alerter-zlxtt","kube-system/global-pull-secret-syncer-c2g72","kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2fbdj","openshift-image-registry/node-ca-pwxkh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal","openshift-multus/multus-additional-cni-plugins-jpwfg"]
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.558514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.559632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.560647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.561276    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.561282    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.561370    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkdmp\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.562008    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.562155    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z8cng\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.562273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.562372    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.562431    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.562686    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.562845    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-flzlz\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.563014    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.563618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.563645    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.563724    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.564220    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.564576    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.564650    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.564657    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.564907    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f7m2c\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.565138    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.565849    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8bk8j\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.565890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.566222    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.566413    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.566627    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.568437    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.568454    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-84864\""
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.575030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.584597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.576869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.577359    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.577454    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.577598    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.577714    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7cqw\""
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.577740    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.576932    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.574812    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.578737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8173761e-40fd-4e25-9eaa-4006f6b1ecec-tmp-dir\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.578849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8173761e-40fd-4e25-9eaa-4006f6b1ecec-hosts-file\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.579383    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.579438    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.580934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.583249    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.583251    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-58ltv\""
Jul 14 19:51:31.588002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.583510    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.596585    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.604149    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.604154    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.604268    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.604414    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.604478    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.604478    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.605382    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bd22j\""
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.668612    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-socket-dir-parent\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-etc-selinux\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-log-socket\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-system-cni-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-cni-binary-copy\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-netns\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysctl-conf\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-tuned\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-var-lib-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-cnibin\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-run\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.730915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-tmp\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-kubelet-config\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-sys\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-ovnkube-script-lib\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-daemon-config\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-kubelet\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-ovnkube-config\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-cni-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-host\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12e08452-1fd9-4bb7-baaf-404dd0344ca1-host\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-run-netns\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-kubelet\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-etc-kubernetes\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.732388 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8tqw\" (UniqueName: \"kubernetes.io/projected/f91bbeb3-213c-4c73-b299-92b6bc40b606-kube-api-access-m8tqw\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmfpg\" (UniqueName: \"kubernetes.io/projected/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-kube-api-access-lmfpg\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxch8\" (UniqueName: \"kubernetes.io/projected/12e08452-1fd9-4bb7-baaf-404dd0344ca1-kube-api-access-kxch8\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33b4da87-cfc0-47c5-82d0-2413a5d3c1b1-agent-certs\") pod \"konnectivity-agent-lpdd2\" (UID: \"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1\") " pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33b4da87-cfc0-47c5-82d0-2413a5d3c1b1-konnectivity-ca\") pod \"konnectivity-agent-lpdd2\" (UID: \"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1\") " pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-cni-multus\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-hostroot\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-modprobe-d\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-lib-modules\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-ovn\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-dbus\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09694e64-0629-4763-b878-aa61824440d9-ovn-node-metrics-cert\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-k8s-cni-cncf-io\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-conf-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xdnv\" (UniqueName: \"kubernetes.io/projected/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-kube-api-access-4xdnv\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.733430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.680995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d867f\" (UniqueName: \"kubernetes.io/projected/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-kube-api-access-d867f\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-var-lib-kubelet\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cni-binary-copy\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9bd7\" (UniqueName: \"kubernetes.io/projected/b96f0b11-552a-4ff2-971f-f999f5d52b57-kube-api-access-r9bd7\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-os-release\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-host-slash\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-kubernetes\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftkb5\" (UniqueName: \"kubernetes.io/projected/8ad5683d-0ddf-4ad5-be33-bafe60e04498-kube-api-access-ftkb5\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/12e08452-1fd9-4bb7-baaf-404dd0344ca1-serviceca\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-slash\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-systemd\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8173761e-40fd-4e25-9eaa-4006f6b1ecec-tmp-dir\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysconfig\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-systemd-units\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-cni-bin\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-env-overrides\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlrgh\" (UniqueName: \"kubernetes.io/projected/09694e64-0629-4763-b878-aa61824440d9-kube-api-access-mlrgh\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8qj\" (UniqueName: \"kubernetes.io/projected/8173761e-40fd-4e25-9eaa-4006f6b1ecec-kube-api-access-fv8qj\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-cni-bin\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-iptables-alerter-script\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-registration-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-sys-fs\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-cni-netd\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-os-release\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-systemd\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cnibin\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-socket-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.734994 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-system-cni-dir\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-etc-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-node-log\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-multus-certs\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysctl-d\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-device-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8173761e-40fd-4e25-9eaa-4006f6b1ecec-hosts-file\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.681681    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8173761e-40fd-4e25-9eaa-4006f6b1ecec-hosts-file\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.682132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8173761e-40fd-4e25-9eaa-4006f6b1ecec-tmp-dir\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.693191    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2b7ct"
Jul 14 19:51:31.735766 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.702836    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2b7ct"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12e08452-1fd9-4bb7-baaf-404dd0344ca1-host\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-run-netns\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-kubelet\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-etc-kubernetes\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782166    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12e08452-1fd9-4bb7-baaf-404dd0344ca1-host\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-run-netns\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-kubelet\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-etc-kubernetes\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8tqw\" (UniqueName: \"kubernetes.io/projected/f91bbeb3-213c-4c73-b299-92b6bc40b606-kube-api-access-m8tqw\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmfpg\" (UniqueName: \"kubernetes.io/projected/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-kube-api-access-lmfpg\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxch8\" (UniqueName: \"kubernetes.io/projected/12e08452-1fd9-4bb7-baaf-404dd0344ca1-kube-api-access-kxch8\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33b4da87-cfc0-47c5-82d0-2413a5d3c1b1-agent-certs\") pod \"konnectivity-agent-lpdd2\" (UID: \"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1\") " pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33b4da87-cfc0-47c5-82d0-2413a5d3c1b1-konnectivity-ca\") pod \"konnectivity-agent-lpdd2\" (UID: \"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1\") " pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-cni-multus\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-hostroot\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-modprobe-d\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-lib-modules\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.795279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-ovn\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-hostroot\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-dbus\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09694e64-0629-4763-b878-aa61824440d9-ovn-node-metrics-cert\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-k8s-cni-cncf-io\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-conf-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xdnv\" (UniqueName: \"kubernetes.io/projected/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-kube-api-access-4xdnv\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-modprobe-d\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d867f\" (UniqueName: \"kubernetes.io/projected/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-kube-api-access-d867f\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-var-lib-kubelet\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-cni-multus\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-lib-modules\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cni-binary-copy\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9bd7\" (UniqueName: \"kubernetes.io/projected/b96f0b11-552a-4ff2-971f-f999f5d52b57-kube-api-access-r9bd7\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-os-release\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-host-slash\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.797226 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-kubernetes\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftkb5\" (UniqueName: \"kubernetes.io/projected/8ad5683d-0ddf-4ad5-be33-bafe60e04498-kube-api-access-ftkb5\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/12e08452-1fd9-4bb7-baaf-404dd0344ca1-serviceca\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782794    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-slash\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-systemd\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysconfig\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-systemd-units\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-cni-bin\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cni-binary-copy\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33b4da87-cfc0-47c5-82d0-2413a5d3c1b1-konnectivity-ca\") pod \"konnectivity-agent-lpdd2\" (UID: \"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1\") " pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-env-overrides\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlrgh\" (UniqueName: \"kubernetes.io/projected/09694e64-0629-4763-b878-aa61824440d9-kube-api-access-mlrgh\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8qj\" (UniqueName: \"kubernetes.io/projected/8173761e-40fd-4e25-9eaa-4006f6b1ecec-kube-api-access-fv8qj\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-cni-bin\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.798059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.782561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-ovn\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-iptables-alerter-script\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-registration-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-sys-fs\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-cni-netd\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-os-release\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-systemd\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cnibin\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-os-release\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-dbus\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783632    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-var-lib-kubelet\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-socket-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-host-slash\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.800587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-conf-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-system-cni-dir\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-system-cni-dir\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-etc-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-socket-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-node-log\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783760    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-sys-fs\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-multus-certs\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.783816    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-multus-certs\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysctl-d\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.783910    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:32.283891729 +0000 UTC m=+3.126263904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysctl-d\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-device-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-socket-dir-parent\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-cni-netd\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.801207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.783988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-etc-selinux\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-os-release\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-log-socket\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/12e08452-1fd9-4bb7-baaf-404dd0344ca1-serviceca\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-system-cni-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-slash\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-etc-selinux\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-run-systemd\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784805    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysconfig\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-device-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-systemd-units\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-cni-bin\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-socket-dir-parent\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-var-lib-cni-bin\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-env-overrides\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-iptables-alerter-script\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.803734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ad5683d-0ddf-4ad5-be33-bafe60e04498-cnibin\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-systemd\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-k8s-cni-cncf-io\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.784059    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-system-cni-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-cni-binary-copy\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785909    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b96f0b11-552a-4ff2-971f-f999f5d52b57-registration-dir\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.785998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-node-log\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-etc-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-netns\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysctl-conf\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-tuned\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-var-lib-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-cnibin\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-run\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-tmp\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-kubelet-config\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.804589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-sys\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-ovnkube-script-lib\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-daemon-config\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-kubelet\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-ovnkube-config\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-cni-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-host\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-kubernetes\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-host\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-run\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.786896    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.786914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09694e64-0629-4763-b878-aa61824440d9-ovn-node-metrics-cert\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787097    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33b4da87-cfc0-47c5-82d0-2413a5d3c1b1-agent-certs\") pod \"konnectivity-agent-lpdd2\" (UID: \"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1\") " pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.892796 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.787132    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret podName:8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f nodeName:}" failed. No retries permitted until 2026-07-14 19:51:32.287114094 +0000 UTC m=+3.129486287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret") pod "global-pull-secret-syncer-c2g72" (UID: "8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-kubelet\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-ovnkube-script-lib\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-log-socket\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787365    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-host-run-netns\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-sysctl-conf\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-cnibin\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787520    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-cni-dir\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-sys\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-kubelet-config\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-var-lib-openvswitch\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09694e64-0629-4763-b878-aa61824440d9-ovnkube-config\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09694e64-0629-4763-b878-aa61824440d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.787964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-cni-binary-copy\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.788176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ad5683d-0ddf-4ad5-be33-bafe60e04498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.788328    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-multus-daemon-config\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.790731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-etc-tuned\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.791756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-tmp\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.894788 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.794251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmfpg\" (UniqueName: \"kubernetes.io/projected/4b54a2b1-11c0-46ed-a80a-1200d04eb9a3-kube-api-access-lmfpg\") pod \"tuned-2fbdj\" (UID: \"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3\") " pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.794289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftkb5\" (UniqueName: \"kubernetes.io/projected/8ad5683d-0ddf-4ad5-be33-bafe60e04498-kube-api-access-ftkb5\") pod \"multus-additional-cni-plugins-jpwfg\" (UID: \"8ad5683d-0ddf-4ad5-be33-bafe60e04498\") " pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.794665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8tqw\" (UniqueName: \"kubernetes.io/projected/f91bbeb3-213c-4c73-b299-92b6bc40b606-kube-api-access-m8tqw\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.795289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d867f\" (UniqueName: \"kubernetes.io/projected/955b41b4-8ff0-4cd6-a2fc-e39aee112f9a-kube-api-access-d867f\") pod \"iptables-alerter-zlxtt\" (UID: \"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a\") " pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.795414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xdnv\" (UniqueName: \"kubernetes.io/projected/e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8-kube-api-access-4xdnv\") pod \"multus-rtbxv\" (UID: \"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8\") " pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.796575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxch8\" (UniqueName: \"kubernetes.io/projected/12e08452-1fd9-4bb7-baaf-404dd0344ca1-kube-api-access-kxch8\") pod \"node-ca-pwxkh\" (UID: \"12e08452-1fd9-4bb7-baaf-404dd0344ca1\") " pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.796641    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.796667    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.796681    2576 projected.go:196] Error preparing data for projected volume kube-api-access-st25k for pod openshift-network-diagnostics/network-check-target-sc6nd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:31.796754    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k podName:c87a4874-163d-4336-8c37-8a248a1a27d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:32.296737418 +0000 UTC m=+3.139109607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-st25k" (UniqueName: "kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k") pod "network-check-target-sc6nd" (UID: "c87a4874-163d-4336-8c37-8a248a1a27d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.796766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9bd7\" (UniqueName: \"kubernetes.io/projected/b96f0b11-552a-4ff2-971f-f999f5d52b57-kube-api-access-r9bd7\") pod \"aws-ebs-csi-driver-node-q48l7\" (UID: \"b96f0b11-552a-4ff2-971f-f999f5d52b57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.799412    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8qj\" (UniqueName: \"kubernetes.io/projected/8173761e-40fd-4e25-9eaa-4006f6b1ecec-kube-api-access-fv8qj\") pod \"node-resolver-fm5x5\" (UID: \"8173761e-40fd-4e25-9eaa-4006f6b1ecec\") " pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.799587    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlrgh\" (UniqueName: \"kubernetes.io/projected/09694e64-0629-4763-b878-aa61824440d9-kube-api-access-mlrgh\") pod \"ovnkube-node-rxh4w\" (UID: \"09694e64-0629-4763-b878-aa61824440d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.853261    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.856057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal" event={"ID":"d48ced1008c46a99937ed2f0f9a90832","Type":"ContainerStarted","Data":"fae417e1fee62e151136911338554eba2ba48f82823649578c5c7eac570160f9"}
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.857897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal" event={"ID":"00413e5f6730abed73a8bdf7f9d98721","Type":"ContainerStarted","Data":"23e88a1b285a5123f5d077a334484ff5fa4f6faff4dc1f8244f9f49b8e2ff031"}
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.881256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jpwfg"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.883058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fbdj"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.886004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwxkh"
Jul 14 19:51:31.896169 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.891842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7"
Jul 14 19:51:31.898608 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:31.893920    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b54a2b1_11c0_46ed_a80a_1200d04eb9a3.slice/crio-a28a04bcfbfa5a375c5c5557f821f9089e108aeab0c7170db21ee6475ac7b7d8 WatchSource:0}: Error finding container a28a04bcfbfa5a375c5c5557f821f9089e108aeab0c7170db21ee6475ac7b7d8: Status 404 returned error can't find the container with id a28a04bcfbfa5a375c5c5557f821f9089e108aeab0c7170db21ee6475ac7b7d8
Jul 14 19:51:31.898608 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.896245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fm5x5"
Jul 14 19:51:31.906742 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.906719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rtbxv"
Jul 14 19:51:31.907537 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:31.907514    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96f0b11_552a_4ff2_971f_f999f5d52b57.slice/crio-8ff03735e3e56b67288799131e8a008bc5490d364d00e36111c99173ccce8774 WatchSource:0}: Error finding container 8ff03735e3e56b67288799131e8a008bc5490d364d00e36111c99173ccce8774: Status 404 returned error can't find the container with id 8ff03735e3e56b67288799131e8a008bc5490d364d00e36111c99173ccce8774
Jul 14 19:51:31.908330 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:31.908306    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8173761e_40fd_4e25_9eaa_4006f6b1ecec.slice/crio-9caca694967bb3f4745d71ccf85531f8b2590fa81f93a35f9fdb5d8fa66af61e WatchSource:0}: Error finding container 9caca694967bb3f4745d71ccf85531f8b2590fa81f93a35f9fdb5d8fa66af61e: Status 404 returned error can't find the container with id 9caca694967bb3f4745d71ccf85531f8b2590fa81f93a35f9fdb5d8fa66af61e
Jul 14 19:51:31.912934 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.912918    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zlxtt"
Jul 14 19:51:31.917775 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:31.917710    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad5683d_0ddf_4ad5_be33_bafe60e04498.slice/crio-7f4f237d9783717f08aaedd0b8b49c9499b001fb332bee9026b44f2a67f7dea4 WatchSource:0}: Error finding container 7f4f237d9783717f08aaedd0b8b49c9499b001fb332bee9026b44f2a67f7dea4: Status 404 returned error can't find the container with id 7f4f237d9783717f08aaedd0b8b49c9499b001fb332bee9026b44f2a67f7dea4
Jul 14 19:51:31.929699 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.929673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:31.930304 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:31.930029    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:31.936180 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:31.936157    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fd6d6d_b70c_48ce_a9ec_83bf19801cb8.slice/crio-b7be63946b28f55e330cb0513f5fa61e11e0c6aa61064cd957b9c180b1cd66e3 WatchSource:0}: Error finding container b7be63946b28f55e330cb0513f5fa61e11e0c6aa61064cd957b9c180b1cd66e3: Status 404 returned error can't find the container with id b7be63946b28f55e330cb0513f5fa61e11e0c6aa61064cd957b9c180b1cd66e3
Jul 14 19:51:31.941289 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:51:31.941263    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955b41b4_8ff0_4cd6_a2fc_e39aee112f9a.slice/crio-f369cd9ce3d742b01c0e85bafa865506626f0434bef9c653efc352c4290b1d59 WatchSource:0}: Error finding container f369cd9ce3d742b01c0e85bafa865506626f0434bef9c653efc352c4290b1d59: Status 404 returned error can't find the container with id f369cd9ce3d742b01c0e85bafa865506626f0434bef9c653efc352c4290b1d59
Jul 14 19:51:32.290596 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.290552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:32.290762 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.290628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:32.290762 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.290748    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:32.290762 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.290757    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:32.290931 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.290824    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret podName:8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f nodeName:}" failed. No retries permitted until 2026-07-14 19:51:33.290802392 +0000 UTC m=+4.133174590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret") pod "global-pull-secret-syncer-c2g72" (UID: "8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:32.290931 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.290844    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:33.290836925 +0000 UTC m=+4.133209100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:32.391199 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.391161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:32.391366 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.391310    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:32.391366 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.391331    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:32.391366 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.391357    2576 projected.go:196] Error preparing data for projected volume kube-api-access-st25k for pod openshift-network-diagnostics/network-check-target-sc6nd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:32.391526 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.391418    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k podName:c87a4874-163d-4336-8c37-8a248a1a27d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:33.391399682 +0000 UTC m=+4.233771859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-st25k" (UniqueName: "kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k") pod "network-check-target-sc6nd" (UID: "c87a4874-163d-4336-8c37-8a248a1a27d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:32.563703 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.563622    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:32.704617 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.704567    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:46:31 +0000 UTC" deadline="2028-02-04 19:09:52.276527778 +0000 UTC"
Jul 14 19:51:32.704617 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.704612    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13679h18m19.571921299s"
Jul 14 19:51:32.850356 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.850268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:32.850970 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.850402    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:32.850970 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.850780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:32.850970 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.850867    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:32.850970 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.850926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:32.851181 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:32.851007    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:32.866269 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.866239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7" event={"ID":"b96f0b11-552a-4ff2-971f-f999f5d52b57","Type":"ContainerStarted","Data":"8ff03735e3e56b67288799131e8a008bc5490d364d00e36111c99173ccce8774"}
Jul 14 19:51:32.868570 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.868540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwxkh" event={"ID":"12e08452-1fd9-4bb7-baaf-404dd0344ca1","Type":"ContainerStarted","Data":"3c60e4ec913936139767db78f88d137a5e19e8dc90e47f84cb32da71302df5bd"}
Jul 14 19:51:32.872151 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.872091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerStarted","Data":"7f4f237d9783717f08aaedd0b8b49c9499b001fb332bee9026b44f2a67f7dea4"}
Jul 14 19:51:32.881201 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.881173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"328afc59565149971823bc171ebf3b2bce7f37f94c55deacc2372466b878c841"}
Jul 14 19:51:32.889832 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.889769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpdd2" event={"ID":"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1","Type":"ContainerStarted","Data":"f350986559808eec8cbee887176bed3b2bd63f86acb98ec2d017227b0b9a4305"}
Jul 14 19:51:32.900512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.900444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zlxtt" event={"ID":"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a","Type":"ContainerStarted","Data":"f369cd9ce3d742b01c0e85bafa865506626f0434bef9c653efc352c4290b1d59"}
Jul 14 19:51:32.911889 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.911857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rtbxv" event={"ID":"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8","Type":"ContainerStarted","Data":"b7be63946b28f55e330cb0513f5fa61e11e0c6aa61064cd957b9c180b1cd66e3"}
Jul 14 19:51:32.915770 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.915743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fm5x5" event={"ID":"8173761e-40fd-4e25-9eaa-4006f6b1ecec","Type":"ContainerStarted","Data":"9caca694967bb3f4745d71ccf85531f8b2590fa81f93a35f9fdb5d8fa66af61e"}
Jul 14 19:51:32.918989 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:32.918942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fbdj" event={"ID":"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3","Type":"ContainerStarted","Data":"a28a04bcfbfa5a375c5c5557f821f9089e108aeab0c7170db21ee6475ac7b7d8"}
Jul 14 19:51:33.297833 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:33.297517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:33.298030 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.297870    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:33.298030 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:33.297880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:33.298030 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.297936    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret podName:8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f nodeName:}" failed. No retries permitted until 2026-07-14 19:51:35.297917914 +0000 UTC m=+6.140290093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret") pod "global-pull-secret-syncer-c2g72" (UID: "8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:33.298030 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.298004    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:33.298240 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.298055    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:35.298039197 +0000 UTC m=+6.140411373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:33.398714 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:33.398630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:33.398869 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.398805    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:33.398869 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.398823    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:33.398869 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.398836    2576 projected.go:196] Error preparing data for projected volume kube-api-access-st25k for pod openshift-network-diagnostics/network-check-target-sc6nd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:33.399019 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:33.398895    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k podName:c87a4874-163d-4336-8c37-8a248a1a27d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:35.398876051 +0000 UTC m=+6.241248230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-st25k" (UniqueName: "kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k") pod "network-check-target-sc6nd" (UID: "c87a4874-163d-4336-8c37-8a248a1a27d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:33.705638 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:33.705557    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:46:31 +0000 UTC" deadline="2028-04-06 12:21:12.163176946 +0000 UTC"
Jul 14 19:51:33.705638 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:33.705591    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15160h29m38.457590889s"
Jul 14 19:51:33.940315 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:33.937089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal" event={"ID":"00413e5f6730abed73a8bdf7f9d98721","Type":"ContainerStarted","Data":"9fa8ab9e0a2adbae7a24a20e26b67b7854f5b82efe74caca5bb62346ddc158f0"}
Jul 14 19:51:34.850386 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:34.850289    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:34.850547 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:34.850494    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:34.850547 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:34.850504    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:34.850547 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:34.850540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:34.850701 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:34.850649    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:34.850755 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:34.850723    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:34.942931 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:34.942804    2576 generic.go:356] "Generic (PLEG): container finished" podID="00413e5f6730abed73a8bdf7f9d98721" containerID="9fa8ab9e0a2adbae7a24a20e26b67b7854f5b82efe74caca5bb62346ddc158f0" exitCode=0
Jul 14 19:51:34.942931 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:34.942867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal" event={"ID":"00413e5f6730abed73a8bdf7f9d98721","Type":"ContainerDied","Data":"9fa8ab9e0a2adbae7a24a20e26b67b7854f5b82efe74caca5bb62346ddc158f0"}
Jul 14 19:51:35.316527 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:35.316443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:35.316680 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:35.316528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:35.316680 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.316655    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:35.316793 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.316720    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret podName:8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f nodeName:}" failed. No retries permitted until 2026-07-14 19:51:39.316698591 +0000 UTC m=+10.159070773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret") pod "global-pull-secret-syncer-c2g72" (UID: "8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:35.317131 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.317098    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:35.317211 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.317154    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:39.317138083 +0000 UTC m=+10.159510263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:35.417746 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:35.417709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:35.417913 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.417863    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:35.417913 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.417886    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:35.417913 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.417898    2576 projected.go:196] Error preparing data for projected volume kube-api-access-st25k for pod openshift-network-diagnostics/network-check-target-sc6nd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:35.418086 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:35.417955    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k podName:c87a4874-163d-4336-8c37-8a248a1a27d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:39.417935437 +0000 UTC m=+10.260307616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-st25k" (UniqueName: "kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k") pod "network-check-target-sc6nd" (UID: "c87a4874-163d-4336-8c37-8a248a1a27d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:36.850910 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:36.850876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:36.851384 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:36.850917    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:36.851384 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:36.850876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:36.851384 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:36.851024    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:36.851384 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:36.851111    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:36.851384 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:36.851198    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:38.850616 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:38.850581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:38.850616 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:38.850601    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:38.850616 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:38.850614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:38.851149 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:38.850719    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:38.851149 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:38.850842    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:38.851149 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:38.850943    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:39.349352 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:39.349267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:39.349562 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:39.349401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:39.349562 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.349543    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:39.349686 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.349602    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:47.349583875 +0000 UTC m=+18.191956066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:39.349686 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.349670    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:39.349791 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.349702    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret podName:8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f nodeName:}" failed. No retries permitted until 2026-07-14 19:51:47.349691214 +0000 UTC m=+18.192063389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret") pod "global-pull-secret-syncer-c2g72" (UID: "8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:39.450461 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:39.450408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:39.450645 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.450621    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:39.450703 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.450651    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:39.450703 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.450667    2576 projected.go:196] Error preparing data for projected volume kube-api-access-st25k for pod openshift-network-diagnostics/network-check-target-sc6nd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:39.450767 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:39.450724    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k podName:c87a4874-163d-4336-8c37-8a248a1a27d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:47.450706528 +0000 UTC m=+18.293078704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-st25k" (UniqueName: "kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k") pod "network-check-target-sc6nd" (UID: "c87a4874-163d-4336-8c37-8a248a1a27d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:40.850560 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:40.850478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:40.850560 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:40.850520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:40.851062 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:40.850606    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:40.851062 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:40.850478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:40.851062 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:40.851044    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:40.851239 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:40.851122    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:42.850390 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:42.850354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:42.850390 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:42.850384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:42.850854 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:42.850354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:42.850854 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:42.850483    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:42.850854 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:42.850572    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:42.850854 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:42.850653    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:44.850325 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:44.850287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:44.850757 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:44.850295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:44.850757 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:44.850438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:44.850757 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:44.850410    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:44.850757 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:44.850530    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:44.850757 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:44.850632    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:46.850084 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:46.850006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:46.850084 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:46.850049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:46.850084 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:46.850049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:46.850568 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:46.850130    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:46.850568 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:46.850213    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:46.850568 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:46.850285    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:47.405748 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:47.405717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:47.405919 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:47.405780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:47.405919 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.405883    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:47.405919 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.405887    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:47.406058 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.405939    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:03.405924552 +0000 UTC m=+34.248296730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:47.406058 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.405952    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret podName:8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f nodeName:}" failed. No retries permitted until 2026-07-14 19:52:03.40594646 +0000 UTC m=+34.248318635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret") pod "global-pull-secret-syncer-c2g72" (UID: "8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:47.506390 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:47.506351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:47.506552 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.506473    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:47.506552 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.506503    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:47.506552 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.506518    2576 projected.go:196] Error preparing data for projected volume kube-api-access-st25k for pod openshift-network-diagnostics/network-check-target-sc6nd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:47.506704 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:47.506574    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k podName:c87a4874-163d-4336-8c37-8a248a1a27d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:03.506554987 +0000 UTC m=+34.348927162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-st25k" (UniqueName: "kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k") pod "network-check-target-sc6nd" (UID: "c87a4874-163d-4336-8c37-8a248a1a27d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:48.850141 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:48.850094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:48.850141 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:48.850119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:48.850141 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:48.850141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:48.850719 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:48.850238    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:48.850719 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:48.850313    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:48.850719 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:48.850414    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:50.850699 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:50.850664    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:50.850699 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:50.850692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:50.851178 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:50.850719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:50.851178 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:50.850778    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:50.851178 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:50.850873    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:50.851178 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:50.850937    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:51.978566 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.978519    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ad5683d-0ddf-4ad5-be33-bafe60e04498" containerID="33b297191f8b7fc60e081a61b9b3864d35dabe5deb9233022c57e60af932bafe" exitCode=0
Jul 14 19:51:51.979113 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.978609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerDied","Data":"33b297191f8b7fc60e081a61b9b3864d35dabe5deb9233022c57e60af932bafe"}
Jul 14 19:51:51.982460 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.982439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal" event={"ID":"00413e5f6730abed73a8bdf7f9d98721","Type":"ContainerStarted","Data":"1caa6b05ee63239bfa99d07335e5ce7b798bd0da46e826fd235627863fdc100b"}
Jul 14 19:51:51.983989 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.983970    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpdd2" event={"ID":"33b4da87-cfc0-47c5-82d0-2413a5d3c1b1","Type":"ContainerStarted","Data":"7fc6e232447ca27c537f101921e3dedc56ad8f7bf049714363c585e99f37f142"}
Jul 14 19:51:51.985284 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.985263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rtbxv" event={"ID":"e0fd6d6d-b70c-48ce-a9ec-83bf19801cb8","Type":"ContainerStarted","Data":"ebd6ef121635b3b7049f880cbcf9757bd3e26355744c5a1346eb897f4ee2d22b"}
Jul 14 19:51:51.987106 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.987082    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fm5x5" event={"ID":"8173761e-40fd-4e25-9eaa-4006f6b1ecec","Type":"ContainerStarted","Data":"1e7df59973f0014686483bd66f2d157d0b757df5eb5c952a407ef46d13a15608"}
Jul 14 19:51:51.988279 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.988261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fbdj" event={"ID":"4b54a2b1-11c0-46ed-a80a-1200d04eb9a3","Type":"ContainerStarted","Data":"91ae8b44f84333c99fd32e80ee72c13ff6ce79de9e4009e49138aa9e7aabefa1"}
Jul 14 19:51:51.989571 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.989552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal" event={"ID":"d48ced1008c46a99937ed2f0f9a90832","Type":"ContainerStarted","Data":"f8a21398d110abd9b33cd95312a8702bda44dfb4dd9bbd1b54269c18814dedb0"}
Jul 14 19:51:51.990993 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.990975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7" event={"ID":"b96f0b11-552a-4ff2-971f-f999f5d52b57","Type":"ContainerStarted","Data":"b683a50631a1fec4c486c343cb41f15154a1264ba64c2230a2d57f7f5d3fd006"}
Jul 14 19:51:51.992127 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:51.992106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwxkh" event={"ID":"12e08452-1fd9-4bb7-baaf-404dd0344ca1","Type":"ContainerStarted","Data":"db6b2426c3cc183ce73e90640fb7f4959cee29f7715f8012e1e339bcf56e8192"}
Jul 14 19:51:52.070579 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.070523    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-187.ec2.internal" podStartSLOduration=22.070507634 podStartE2EDuration="22.070507634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:52.040127547 +0000 UTC m=+22.882499745" watchObservedRunningTime="2026-07-14 19:51:52.070507634 +0000 UTC m=+22.912879831"
Jul 14 19:51:52.100804 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.100751    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2fbdj" podStartSLOduration=3.892067998 podStartE2EDuration="23.100736217s" totalImagesPullingTime="19.208668219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:52.073828489 +0000 UTC m=+22.916200686" watchObservedRunningTime="2026-07-14 19:51:52.100736217 +0000 UTC m=+22.943108459"
Jul 14 19:51:52.135886 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.135841    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fm5x5" podStartSLOduration=4.01597643 podStartE2EDuration="23.135825932s" totalImagesPullingTime="19.119849502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:52.10060331 +0000 UTC m=+22.942975507" watchObservedRunningTime="2026-07-14 19:51:52.135825932 +0000 UTC m=+22.978198129"
Jul 14 19:51:52.136413 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.136389    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lpdd2" podStartSLOduration=7.637195034 podStartE2EDuration="22.136379988s" totalImagesPullingTime="14.499184954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:52.136242502 +0000 UTC m=+22.978614699" watchObservedRunningTime="2026-07-14 19:51:52.136379988 +0000 UTC m=+22.978752184"
Jul 14 19:51:52.183307 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.183268    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-187.ec2.internal" podStartSLOduration=22.183252242000002 podStartE2EDuration="22.183252242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:52.164278563 +0000 UTC m=+23.006650759" watchObservedRunningTime="2026-07-14 19:51:52.183252242 +0000 UTC m=+23.025624433"
Jul 14 19:51:52.183899 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.183875    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pwxkh" podStartSLOduration=3.978959238 podStartE2EDuration="23.183867209s" totalImagesPullingTime="19.204907971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:52.183443817 +0000 UTC m=+23.025816014" watchObservedRunningTime="2026-07-14 19:51:52.183867209 +0000 UTC m=+23.026239405"
Jul 14 19:51:52.211455 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.211417    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rtbxv" podStartSLOduration=4.043474362 podStartE2EDuration="23.211401962s" totalImagesPullingTime="19.1679276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:52.211311935 +0000 UTC m=+23.053684132" watchObservedRunningTime="2026-07-14 19:51:52.211401962 +0000 UTC m=+23.053774159"
Jul 14 19:51:52.851023 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.850801    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:52.851221 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.850819    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:52.851221 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:52.851123    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:52.851221 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:52.851205    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:52.851423 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.850823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:52.851423 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:52.851307    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:52.997479 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.997410    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 19:51:52.998193 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.997786    2576 generic.go:356] "Generic (PLEG): container finished" podID="09694e64-0629-4763-b878-aa61824440d9" containerID="0f8e6974def3230a824d3b521558e49e64a768710385813d2e3d6a678e38931e" exitCode=1
Jul 14 19:51:52.998193 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.997864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"3f0d66ce17e7c00afcd9f07ce1eba94173952db78e8e2920019ff402bf545c2e"}
Jul 14 19:51:52.998193 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.997937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"18a4562d749b9826047b84a20a78578d7d9755d83cfe0d6eed9fe6a4621d1678"}
Jul 14 19:51:52.998193 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.997993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"011aa38104d5dccb1e9dbf7aca93fbec22664c65128c7f2621336a0b2a0245ac"}
Jul 14 19:51:52.998193 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.998044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"6523246d8d86ba4bf6b6b3038adfd9eac636dddba7a33de74e54e9844f0f4204"}
Jul 14 19:51:52.998193 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.998087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerDied","Data":"0f8e6974def3230a824d3b521558e49e64a768710385813d2e3d6a678e38931e"}
Jul 14 19:51:52.998193 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.998130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"78e6641fc24343d86b0fb145304681dcb0402e34d90a36ffd5430458004fb769"}
Jul 14 19:51:52.999550 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:52.999522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zlxtt" event={"ID":"955b41b4-8ff0-4cd6-a2fc-e39aee112f9a","Type":"ContainerStarted","Data":"68958079e1dffb25c7241b58f95915792f32da8a72b84fe27cc010fe056cbca4"}
Jul 14 19:51:53.020893 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:53.020843    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zlxtt" podStartSLOduration=4.8579257479999995 podStartE2EDuration="24.020826485s" totalImagesPullingTime="19.162900737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:53.020523426 +0000 UTC m=+23.862895636" watchObservedRunningTime="2026-07-14 19:51:53.020826485 +0000 UTC m=+23.863198682"
Jul 14 19:51:53.343646 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:53.343516    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 19:51:53.654687 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:53.654331    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T19:51:53.343534331Z","UUID":"2a31e625-ae0e-4038-813a-c632b8c23fe7","Handler":null,"Name":"","Endpoint":""}
Jul 14 19:51:53.655893 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:53.655875    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 19:51:53.656068 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:53.655911    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 19:51:54.004441 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:54.004366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7" event={"ID":"b96f0b11-552a-4ff2-971f-f999f5d52b57","Type":"ContainerStarted","Data":"4ef456f2996f32c28782f0cc2236a0faf62947078b7cd554208e8297fbdff798"}
Jul 14 19:51:54.850093 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:54.850054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:54.850267 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:54.850056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:54.850267 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:54.850203    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:54.850412 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:54.850054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:54.850412 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:54.850275    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:54.850535 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:54.850407    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:55.180640 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:55.180558    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:55.181215 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:55.181194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:56.008563 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:56.008533    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:56.009059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:56.009042    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lpdd2"
Jul 14 19:51:56.850351 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:56.850307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:56.850351 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:56.850331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:56.851049 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:56.850427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:56.851049 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:56.850431    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:56.851049 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:56.850503    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:56.851049 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:56.850562    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:57.012114 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:57.012072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7" event={"ID":"b96f0b11-552a-4ff2-971f-f999f5d52b57","Type":"ContainerStarted","Data":"36e9c7e4c67b2281bd345014e3f26ebdb6a1c5e2ad28172ae185f32c2ee0bf2d"}
Jul 14 19:51:57.013845 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:57.013820    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ad5683d-0ddf-4ad5-be33-bafe60e04498" containerID="1e97b6ce890bc8664a0096abccc5889f33aea6333e57fa91ca73c5b93b5ae2f0" exitCode=0
Jul 14 19:51:57.013981 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:57.013882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerDied","Data":"1e97b6ce890bc8664a0096abccc5889f33aea6333e57fa91ca73c5b93b5ae2f0"}
Jul 14 19:51:57.017303 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:57.017266    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 19:51:57.017631 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:57.017612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"a542aeea27a199511a45d25ec6cb09582bd0c131eaf64da22f276dfc7a9a6ba1"}
Jul 14 19:51:57.029584 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:57.029549    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q48l7" podStartSLOduration=4.317670255 podStartE2EDuration="28.029538515s" totalImagesPullingTime="23.71186826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:57.029000644 +0000 UTC m=+27.871372841" watchObservedRunningTime="2026-07-14 19:51:57.029538515 +0000 UTC m=+27.871910712"
Jul 14 19:51:58.850184 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:58.849961    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:51:58.850593 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:58.850012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:51:58.850593 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:58.850261    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:51:58.850593 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:58.850022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:51:58.850593 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:58.850327    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:51:58.850593 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:51:58.850453    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:51:59.024186 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:59.024163    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 19:51:59.024507 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:59.024486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"2e575a127083f7da75c83c940badecf82ce457d05e246b5c1c5b8aa434736173"}
Jul 14 19:51:59.024747 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:59.024724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:59.024849 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:59.024794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:51:59.024902 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:59.024895    2576 scope.go:117] "RemoveContainer" containerID="0f8e6974def3230a824d3b521558e49e64a768710385813d2e3d6a678e38931e"
Jul 14 19:51:59.040646 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:51:59.040625    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:52:00.029095 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.029021    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ad5683d-0ddf-4ad5-be33-bafe60e04498" containerID="140cb28265244faf03e775b5f4f480e597b0cd2bab244678b5db4f762299f0ed" exitCode=0
Jul 14 19:52:00.029501 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.029095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerDied","Data":"140cb28265244faf03e775b5f4f480e597b0cd2bab244678b5db4f762299f0ed"}
Jul 14 19:52:00.033215 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.033197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 19:52:00.033657 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.033629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" event={"ID":"09694e64-0629-4763-b878-aa61824440d9","Type":"ContainerStarted","Data":"49cc856673a9597eec1d6fecb61e28ad9dc0ffa07823c7e7019097b0234dbfc4"}
Jul 14 19:52:00.033941 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.033915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:52:00.049537 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.049518    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:52:00.082289 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.082250    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w" podStartSLOduration=9.851059201 podStartE2EDuration="30.082236194s" totalImagesPullingTime="20.231176993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:00.081013925 +0000 UTC m=+30.923386157" watchObservedRunningTime="2026-07-14 19:52:00.082236194 +0000 UTC m=+30.924608391"
Jul 14 19:52:00.386249 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.386178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sc6nd"]
Jul 14 19:52:00.386398 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.386367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:00.386498 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:00.386475    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:52:00.389073 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.389048    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2g72"]
Jul 14 19:52:00.389199 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.389159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:00.389288 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:00.389262    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:52:00.389867 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.389837    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9zzjl"]
Jul 14 19:52:00.389980 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:00.389960    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:52:00.390087 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:00.390067    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:52:01.849933 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:01.849898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:01.849933 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:01.849912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:01.849933 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:01.849898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:52:01.850631 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:01.850001    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:52:01.850631 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:01.850056    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:52:01.850631 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:01.850146    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:52:02.039670 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:02.039638    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ad5683d-0ddf-4ad5-be33-bafe60e04498" containerID="d81cfffeaba4f318ef37b86b8ae6e5ec40ece7e89bc134aad5bd8460660b09fc" exitCode=0
Jul 14 19:52:02.039832 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:02.039728    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerDied","Data":"d81cfffeaba4f318ef37b86b8ae6e5ec40ece7e89bc134aad5bd8460660b09fc"}
Jul 14 19:52:03.435595 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.435560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:52:03.435993 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.435626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:03.435993 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.435708    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:03.435993 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.435726    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:03.435993 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.435773    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.435756543 +0000 UTC m=+66.278128722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:03.435993 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.435787    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret podName:8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.43578094 +0000 UTC m=+66.278153119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret") pod "global-pull-secret-syncer-c2g72" (UID: "8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:03.536032 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.536002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:03.536172 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.536141    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:52:03.536172 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.536158    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:52:03.536172 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.536167    2576 projected.go:196] Error preparing data for projected volume kube-api-access-st25k for pod openshift-network-diagnostics/network-check-target-sc6nd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:03.536291 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.536215    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k podName:c87a4874-163d-4336-8c37-8a248a1a27d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.536197826 +0000 UTC m=+66.378570004 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-st25k" (UniqueName: "kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k") pod "network-check-target-sc6nd" (UID: "c87a4874-163d-4336-8c37-8a248a1a27d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:03.850988 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.850957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:03.851096 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.850964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:03.851167 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.851084    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sc6nd" podUID="c87a4874-163d-4336-8c37-8a248a1a27d4"
Jul 14 19:52:03.851167 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.851108    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:52:03.851278 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.851218    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2g72" podUID="8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f"
Jul 14 19:52:03.851351 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:03.851315    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zzjl" podUID="f91bbeb3-213c-4c73-b299-92b6bc40b606"
Jul 14 19:52:03.900281 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.900251    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-187.ec2.internal" event="NodeReady"
Jul 14 19:52:03.900434 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.900412    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 19:52:03.944143 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.944108    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"]
Jul 14 19:52:03.946915 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.946890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:03.949724 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.949498    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 19:52:03.949724 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.949520    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 19:52:03.949724 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.949567    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 19:52:03.949962 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.949813    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm29c\""
Jul 14 19:52:03.955796 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.955779    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 19:52:03.962781 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.962759    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v2zxw"]
Jul 14 19:52:03.966143 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.965738    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:03.967185 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.967166    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rzzt4"]
Jul 14 19:52:03.968647 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.968541    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 19:52:03.968647 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.968564    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc26t\""
Jul 14 19:52:03.969010 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.968989    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 19:52:03.970525 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.970509    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"]
Jul 14 19:52:03.971084 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.970589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:03.977123 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.977104    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 19:52:03.977266 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.977176    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 19:52:03.977266 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.977180    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 19:52:03.977633 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.977615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gm85k\""
Jul 14 19:52:03.982215 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:03.982194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2zxw"]
Jul 14 19:52:04.003067 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.003042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rzzt4"]
Jul 14 19:52:04.041460 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.041586 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcc9fc-0b70-4461-858b-be14584edd28-ca-trust-extracted\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.041586 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-installation-pull-secrets\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.041586 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-bound-sa-token\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.041740 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-image-registry-private-configuration\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.041899 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-trusted-ca\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.042014 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-registry-certificates\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.042014 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.041985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrqjt\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-kube-api-access-zrqjt\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143042 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.142961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-registry-certificates\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143042 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.142997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrqjt\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-kube-api-access-zrqjt\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143042 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143296 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-tmp-dir\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.143413 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.143385    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:04.143413 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.143411    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dd6bb5bc-6jhs4: secret "image-registry-tls" not found
Jul 14 19:52:04.143587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcc9fc-0b70-4461-858b-be14584edd28-ca-trust-extracted\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143587 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.143473    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls podName:25bcc9fc-0b70-4461-858b-be14584edd28 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:04.643450596 +0000 UTC m=+35.485822846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls") pod "image-registry-76dd6bb5bc-6jhs4" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28") : secret "image-registry-tls" not found
Jul 14 19:52:04.143587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-installation-pull-secrets\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143587 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-bound-sa-token\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-image-registry-private-configuration\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk2gd\" (UniqueName: \"kubernetes.io/projected/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-kube-api-access-hk2gd\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-trusted-ca\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-config-volume\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e-cert\") pod \"ingress-canary-rzzt4\" (UID: \"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e\") " pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcc9fc-0b70-4461-858b-be14584edd28-ca-trust-extracted\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.143783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75k4p\" (UniqueName: \"kubernetes.io/projected/5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e-kube-api-access-75k4p\") pod \"ingress-canary-rzzt4\" (UID: \"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e\") " pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:04.144115 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.143886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-registry-certificates\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.144553 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.144528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-trusted-ca\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.147957 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.147928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-image-registry-private-configuration\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.148061 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.148008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-installation-pull-secrets\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.155590 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.155566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-bound-sa-token\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.155747 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.155727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrqjt\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-kube-api-access-zrqjt\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.161744 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.161689    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:04.244603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.244574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-tmp-dir\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.244727 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.244638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.244727 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.244662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk2gd\" (UniqueName: \"kubernetes.io/projected/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-kube-api-access-hk2gd\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.244727 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.244685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-config-volume\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.244727 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.244709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e-cert\") pod \"ingress-canary-rzzt4\" (UID: \"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e\") " pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:04.244907 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.244749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75k4p\" (UniqueName: \"kubernetes.io/projected/5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e-kube-api-access-75k4p\") pod \"ingress-canary-rzzt4\" (UID: \"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e\") " pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:04.244961 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.244936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-tmp-dir\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.245139 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.245117    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:04.245236 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.245189    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls podName:7ef4cfe7-c7f4-4178-81f5-672a74c457ba nodeName:}" failed. No retries permitted until 2026-07-14 19:52:04.745172232 +0000 UTC m=+35.587544408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls") pod "dns-default-v2zxw" (UID: "7ef4cfe7-c7f4-4178-81f5-672a74c457ba") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:04.245422 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.245400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-config-volume\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.247674 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.247655    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e-cert\") pod \"ingress-canary-rzzt4\" (UID: \"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e\") " pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:04.253790 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.253769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk2gd\" (UniqueName: \"kubernetes.io/projected/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-kube-api-access-hk2gd\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.253984 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.253949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75k4p\" (UniqueName: \"kubernetes.io/projected/5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e-kube-api-access-75k4p\") pod \"ingress-canary-rzzt4\" (UID: \"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e\") " pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:04.258573 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.258532    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:04.283381 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.283355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rzzt4"
Jul 14 19:52:04.430943 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.430677    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rzzt4"]
Jul 14 19:52:04.433683 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:52:04.433650    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed8d5a2_2f49_4ec0_866b_7bc1e4e0688e.slice/crio-a842e379312ec0897ac722d5faab232794f7ce38fcc27335fca66838ae3cc9c2 WatchSource:0}: Error finding container a842e379312ec0897ac722d5faab232794f7ce38fcc27335fca66838ae3cc9c2: Status 404 returned error can't find the container with id a842e379312ec0897ac722d5faab232794f7ce38fcc27335fca66838ae3cc9c2
Jul 14 19:52:04.646634 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.646604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:04.647179 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.646713    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:04.647179 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.646730    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dd6bb5bc-6jhs4: secret "image-registry-tls" not found
Jul 14 19:52:04.647179 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.646788    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls podName:25bcc9fc-0b70-4461-858b-be14584edd28 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:05.646769995 +0000 UTC m=+36.489142173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls") pod "image-registry-76dd6bb5bc-6jhs4" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28") : secret "image-registry-tls" not found
Jul 14 19:52:04.747064 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:04.747024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:04.747254 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.747191    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:04.747332 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:04.747263    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls podName:7ef4cfe7-c7f4-4178-81f5-672a74c457ba nodeName:}" failed. No retries permitted until 2026-07-14 19:52:05.747241844 +0000 UTC m=+36.589614039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls") pod "dns-default-v2zxw" (UID: "7ef4cfe7-c7f4-4178-81f5-672a74c457ba") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:05.047975 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.047894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rzzt4" event={"ID":"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e","Type":"ContainerStarted","Data":"a842e379312ec0897ac722d5faab232794f7ce38fcc27335fca66838ae3cc9c2"}
Jul 14 19:52:05.190047 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.190005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:05.288219 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.288153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:05.654350 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.654313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:05.654747 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:05.654457    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:05.654747 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:05.654472    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dd6bb5bc-6jhs4: secret "image-registry-tls" not found
Jul 14 19:52:05.654747 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:05.654528    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls podName:25bcc9fc-0b70-4461-858b-be14584edd28 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:07.654510118 +0000 UTC m=+38.496882316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls") pod "image-registry-76dd6bb5bc-6jhs4" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28") : secret "image-registry-tls" not found
Jul 14 19:52:05.755201 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.755164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:05.755382 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:05.755310    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:05.755447 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:05.755386    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls podName:7ef4cfe7-c7f4-4178-81f5-672a74c457ba nodeName:}" failed. No retries permitted until 2026-07-14 19:52:07.755367946 +0000 UTC m=+38.597740148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls") pod "dns-default-v2zxw" (UID: "7ef4cfe7-c7f4-4178-81f5-672a74c457ba") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:05.850630 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.850594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:05.850789 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.850640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:52:05.850789 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.850594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:05.854485 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.854463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78ljl\""
Jul 14 19:52:05.854630 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.854489    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:52:05.854630 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.854507    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:52:05.854630 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.854495    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:52:05.854630 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.854536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkvzh\""
Jul 14 19:52:05.854630 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:05.854555    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:52:06.135270 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:06.135233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:06.194476 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:06.194438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:06.270961 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:06.270931    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:07.056446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:07.056410    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ad5683d-0ddf-4ad5-be33-bafe60e04498" containerID="cc093d42dad8b3e0c82d5a2691a734bfbd3400a776d4c4502148956a592e02f5" exitCode=0
Jul 14 19:52:07.056874 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:07.056479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerDied","Data":"cc093d42dad8b3e0c82d5a2691a734bfbd3400a776d4c4502148956a592e02f5"}
Jul 14 19:52:07.669969 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:07.669926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:07.670134 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:07.670101    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:07.670134 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:07.670126    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dd6bb5bc-6jhs4: secret "image-registry-tls" not found
Jul 14 19:52:07.670229 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:07.670198    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls podName:25bcc9fc-0b70-4461-858b-be14584edd28 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:11.670176633 +0000 UTC m=+42.512548823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls") pod "image-registry-76dd6bb5bc-6jhs4" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28") : secret "image-registry-tls" not found
Jul 14 19:52:07.770670 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:07.770632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:07.770834 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:07.770777    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:07.770874 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:07.770841    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls podName:7ef4cfe7-c7f4-4178-81f5-672a74c457ba nodeName:}" failed. No retries permitted until 2026-07-14 19:52:11.770825426 +0000 UTC m=+42.613197600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls") pod "dns-default-v2zxw" (UID: "7ef4cfe7-c7f4-4178-81f5-672a74c457ba") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:08.062146 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:08.062110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:08.063220 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:08.063190    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ad5683d-0ddf-4ad5-be33-bafe60e04498" containerID="081f46549ee1ef51b831414c7e9df1a19c59fa0e1da65c73341c184a804503c8" exitCode=0
Jul 14 19:52:08.063357 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:08.063259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerDied","Data":"081f46549ee1ef51b831414c7e9df1a19c59fa0e1da65c73341c184a804503c8"}
Jul 14 19:52:09.068437 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:09.068222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" event={"ID":"8ad5683d-0ddf-4ad5-be33-bafe60e04498","Type":"ContainerStarted","Data":"f67dca63d246763830838796efda80f45556402f563d64c667f527924e10ec72"}
Jul 14 19:52:09.098654 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:09.098607    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jpwfg" podStartSLOduration=8.710726061 podStartE2EDuration="40.098591957s" totalImagesPullingTime="31.387865896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:09.097994261 +0000 UTC m=+39.940366459" watchObservedRunningTime="2026-07-14 19:52:09.098591957 +0000 UTC m=+39.940964155"
Jul 14 19:52:10.072170 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:10.072126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rzzt4" event={"ID":"5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e","Type":"ContainerStarted","Data":"dbdc526e847d1f9618e01ada5217a45a8c7ab4fc8d55c843b7e1115327829496"}
Jul 14 19:52:11.698387 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:11.698323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:11.698751 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:11.698472    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:11.698751 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:11.698493    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dd6bb5bc-6jhs4: secret "image-registry-tls" not found
Jul 14 19:52:11.698751 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:11.698544    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls podName:25bcc9fc-0b70-4461-858b-be14584edd28 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:19.698529052 +0000 UTC m=+50.540901243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls") pod "image-registry-76dd6bb5bc-6jhs4" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28") : secret "image-registry-tls" not found
Jul 14 19:52:11.799492 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:11.799464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:11.799625 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:11.799591    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:11.799667 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:11.799638    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls podName:7ef4cfe7-c7f4-4178-81f5-672a74c457ba nodeName:}" failed. No retries permitted until 2026-07-14 19:52:19.799624951 +0000 UTC m=+50.641997127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls") pod "dns-default-v2zxw" (UID: "7ef4cfe7-c7f4-4178-81f5-672a74c457ba") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:19.751027 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:19.750993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:19.751405 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:19.751128    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:19.751405 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:19.751141    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dd6bb5bc-6jhs4: secret "image-registry-tls" not found
Jul 14 19:52:19.751405 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:19.751191    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls podName:25bcc9fc-0b70-4461-858b-be14584edd28 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.751174503 +0000 UTC m=+66.593546695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls") pod "image-registry-76dd6bb5bc-6jhs4" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28") : secret "image-registry-tls" not found
Jul 14 19:52:19.851971 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:19.851938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:19.852153 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:19.852059    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:19.852153 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:19.852121    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls podName:7ef4cfe7-c7f4-4178-81f5-672a74c457ba nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.852104517 +0000 UTC m=+66.694476708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls") pod "dns-default-v2zxw" (UID: "7ef4cfe7-c7f4-4178-81f5-672a74c457ba") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:30.595096 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.595035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rzzt4" podStartSLOduration=23.032232013 podStartE2EDuration="27.59501556s" totalImagesPullingTime="4.562783547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:10.093402388 +0000 UTC m=+40.935774584" watchObservedRunningTime="2026-07-14 19:52:30.59501556 +0000 UTC m=+61.437387757"
Jul 14 19:52:30.595538 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.595287    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-62jx7"]
Jul 14 19:52:30.620812 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.620784    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"]
Jul 14 19:52:30.620967 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.620908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.623419 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.623391    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.623419 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.623406    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 14 19:52:30.623621 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.623525    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ftpcb\""
Jul 14 19:52:30.623684 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.623648    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 14 19:52:30.623832 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.623817    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.629092 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.629073    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 14 19:52:30.634495 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.634473    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-62jx7"]
Jul 14 19:52:30.634597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.634507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"]
Jul 14 19:52:30.634597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.634590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:30.637408 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.637387    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.637723 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.637418    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 14 19:52:30.638050 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.637501    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m9jbj\""
Jul 14 19:52:30.638950 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.638483    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.675304 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.675283    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-f2pfv"]
Jul 14 19:52:30.697457 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.697438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-f2pfv"]
Jul 14 19:52:30.697544 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.697535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.700219 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.700202    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.700292 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.700252    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 14 19:52:30.700333 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.700319    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.700406 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.700392    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 14 19:52:30.700477 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.700463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d66p9\""
Jul 14 19:52:30.706005 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.705986    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 14 19:52:30.730612 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9tx9\" (UniqueName: \"kubernetes.io/projected/a69b6751-ce3a-4490-a068-934961a7b976-kube-api-access-b9tx9\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.730706 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d629n\" (UniqueName: \"kubernetes.io/projected/127861fc-5f15-435a-ab30-a3d014b90087-kube-api-access-d629n\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:30.730706 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca098121-4efe-46e0-a524-4be7b1de1f1d-snapshots\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.730706 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca098121-4efe-46e0-a524-4be7b1de1f1d-serving-cert\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.730706 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a69b6751-ce3a-4490-a068-934961a7b976-config\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.730869 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca098121-4efe-46e0-a524-4be7b1de1f1d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.730869 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a69b6751-ce3a-4490-a068-934961a7b976-serving-cert\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.730869 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69b6751-ce3a-4490-a068-934961a7b976-trusted-ca\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.730869 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:30.730869 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca098121-4efe-46e0-a524-4be7b1de1f1d-tmp\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.731052 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca098121-4efe-46e0-a524-4be7b1de1f1d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.731052 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.730912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtml4\" (UniqueName: \"kubernetes.io/projected/ca098121-4efe-46e0-a524-4be7b1de1f1d-kube-api-access-gtml4\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.831453 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:30.831607 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca098121-4efe-46e0-a524-4be7b1de1f1d-tmp\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.831607 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca098121-4efe-46e0-a524-4be7b1de1f1d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.831607 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:30.831586    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:52:30.831607 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtml4\" (UniqueName: \"kubernetes.io/projected/ca098121-4efe-46e0-a524-4be7b1de1f1d-kube-api-access-gtml4\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.831817 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:30.831656    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls podName:127861fc-5f15-435a-ab30-a3d014b90087 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:31.33163588 +0000 UTC m=+62.174008056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls") pod "cluster-samples-operator-65db858894-llb8c" (UID: "127861fc-5f15-435a-ab30-a3d014b90087") : secret "samples-operator-tls" not found
Jul 14 19:52:30.831817 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9tx9\" (UniqueName: \"kubernetes.io/projected/a69b6751-ce3a-4490-a068-934961a7b976-kube-api-access-b9tx9\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.831817 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d629n\" (UniqueName: \"kubernetes.io/projected/127861fc-5f15-435a-ab30-a3d014b90087-kube-api-access-d629n\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:30.831817 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca098121-4efe-46e0-a524-4be7b1de1f1d-snapshots\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.832024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca098121-4efe-46e0-a524-4be7b1de1f1d-serving-cert\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.832024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca098121-4efe-46e0-a524-4be7b1de1f1d-tmp\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.832024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a69b6751-ce3a-4490-a068-934961a7b976-config\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.832024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca098121-4efe-46e0-a524-4be7b1de1f1d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.832024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a69b6751-ce3a-4490-a068-934961a7b976-serving-cert\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.832024 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.831992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69b6751-ce3a-4490-a068-934961a7b976-trusted-ca\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.832290 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.832006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca098121-4efe-46e0-a524-4be7b1de1f1d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.832415 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.832398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca098121-4efe-46e0-a524-4be7b1de1f1d-snapshots\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.832574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.832557    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a69b6751-ce3a-4490-a068-934961a7b976-config\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.832877 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.832856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a69b6751-ce3a-4490-a068-934961a7b976-trusted-ca\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.832935 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.832925    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca098121-4efe-46e0-a524-4be7b1de1f1d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.835573 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.835546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a69b6751-ce3a-4490-a068-934961a7b976-serving-cert\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.835657 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.835605    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca098121-4efe-46e0-a524-4be7b1de1f1d-serving-cert\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.868248 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.868187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtml4\" (UniqueName: \"kubernetes.io/projected/ca098121-4efe-46e0-a524-4be7b1de1f1d-kube-api-access-gtml4\") pod \"insights-operator-68d9dd94cf-62jx7\" (UID: \"ca098121-4efe-46e0-a524-4be7b1de1f1d\") " pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:30.870695 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.870669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d629n\" (UniqueName: \"kubernetes.io/projected/127861fc-5f15-435a-ab30-a3d014b90087-kube-api-access-d629n\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:30.871317 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.871294    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9tx9\" (UniqueName: \"kubernetes.io/projected/a69b6751-ce3a-4490-a068-934961a7b976-kube-api-access-b9tx9\") pod \"console-operator-7866497494-f2pfv\" (UID: \"a69b6751-ce3a-4490-a068-934961a7b976\") " pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:30.930606 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:30.930577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-62jx7"
Jul 14 19:52:31.006791 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:31.006680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:31.084366 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:31.084277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-62jx7"]
Jul 14 19:52:31.089650 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:52:31.089614    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca098121_4efe_46e0_a524_4be7b1de1f1d.slice/crio-77e0b0f0c228c7e1effcc7e39753aed98832fbbbd8498dafc8d1c606954a7e4a WatchSource:0}: Error finding container 77e0b0f0c228c7e1effcc7e39753aed98832fbbbd8498dafc8d1c606954a7e4a: Status 404 returned error can't find the container with id 77e0b0f0c228c7e1effcc7e39753aed98832fbbbd8498dafc8d1c606954a7e4a
Jul 14 19:52:31.123099 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:31.123012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-62jx7" event={"ID":"ca098121-4efe-46e0-a524-4be7b1de1f1d","Type":"ContainerStarted","Data":"77e0b0f0c228c7e1effcc7e39753aed98832fbbbd8498dafc8d1c606954a7e4a"}
Jul 14 19:52:31.159568 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:31.159544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-f2pfv"]
Jul 14 19:52:31.161686 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:52:31.161661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69b6751_ce3a_4490_a068_934961a7b976.slice/crio-9563335bfae5b2d2670c24605dd98f04b9c03fff8035f467ccdcfba1bcfe6f89 WatchSource:0}: Error finding container 9563335bfae5b2d2670c24605dd98f04b9c03fff8035f467ccdcfba1bcfe6f89: Status 404 returned error can't find the container with id 9563335bfae5b2d2670c24605dd98f04b9c03fff8035f467ccdcfba1bcfe6f89
Jul 14 19:52:31.336553 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:31.336515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:31.336730 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:31.336665    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:52:31.336776 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:31.336730    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls podName:127861fc-5f15-435a-ab30-a3d014b90087 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:32.336714031 +0000 UTC m=+63.179086208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls") pod "cluster-samples-operator-65db858894-llb8c" (UID: "127861fc-5f15-435a-ab30-a3d014b90087") : secret "samples-operator-tls" not found
Jul 14 19:52:32.052058 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:32.052027    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxh4w"
Jul 14 19:52:32.129681 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:32.129640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-f2pfv" event={"ID":"a69b6751-ce3a-4490-a068-934961a7b976","Type":"ContainerStarted","Data":"9563335bfae5b2d2670c24605dd98f04b9c03fff8035f467ccdcfba1bcfe6f89"}
Jul 14 19:52:32.347483 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:32.347383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:32.347643 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:32.347623    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:52:32.347761 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:32.347702    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls podName:127861fc-5f15-435a-ab30-a3d014b90087 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:34.347682228 +0000 UTC m=+65.190054409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls") pod "cluster-samples-operator-65db858894-llb8c" (UID: "127861fc-5f15-435a-ab30-a3d014b90087") : secret "samples-operator-tls" not found
Jul 14 19:52:34.136060 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:34.136017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-62jx7" event={"ID":"ca098121-4efe-46e0-a524-4be7b1de1f1d","Type":"ContainerStarted","Data":"2bdc3851967b64cef3fe77e086468826ed177fd9da9af736715868d7c65e8229"}
Jul 14 19:52:34.137601 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:34.137583    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/0.log"
Jul 14 19:52:34.137703 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:34.137616    2576 generic.go:356] "Generic (PLEG): container finished" podID="a69b6751-ce3a-4490-a068-934961a7b976" containerID="9e7636f732c860dc9a1610485f6c775162cd948aacd35e5459863130fa9d4e60" exitCode=255
Jul 14 19:52:34.137703 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:34.137641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-f2pfv" event={"ID":"a69b6751-ce3a-4490-a068-934961a7b976","Type":"ContainerDied","Data":"9e7636f732c860dc9a1610485f6c775162cd948aacd35e5459863130fa9d4e60"}
Jul 14 19:52:34.137892 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:34.137874    2576 scope.go:117] "RemoveContainer" containerID="9e7636f732c860dc9a1610485f6c775162cd948aacd35e5459863130fa9d4e60"
Jul 14 19:52:34.154717 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:34.153942    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-62jx7" podStartSLOduration=1.5753789660000002 podStartE2EDuration="4.153925365s" totalImagesPullingTime="2.578546399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:34.153182019 +0000 UTC m=+64.995554211" watchObservedRunningTime="2026-07-14 19:52:34.153925365 +0000 UTC m=+64.996297564"
Jul 14 19:52:34.363787 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:34.363757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:34.363946 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:34.363897    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:52:34.363996 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:34.363959    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls podName:127861fc-5f15-435a-ab30-a3d014b90087 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.363944527 +0000 UTC m=+69.206316703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls") pod "cluster-samples-operator-65db858894-llb8c" (UID: "127861fc-5f15-435a-ab30-a3d014b90087") : secret "samples-operator-tls" not found
Jul 14 19:52:35.041480 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.041449    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7p8q8"]
Jul 14 19:52:35.043628 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.043609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.047313 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.047287    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 19:52:35.048268 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.048231    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 19:52:35.048354 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.048295    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mlhmv\""
Jul 14 19:52:35.070291 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.070256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c649611-ab91-4010-a4a6-e98109f53f8d-crio-socket\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.070431 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.070389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.070479 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.070431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.070479 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.070471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c649611-ab91-4010-a4a6-e98109f53f8d-data-volume\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.070650 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.070497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6g8s\" (UniqueName: \"kubernetes.io/projected/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-api-access-t6g8s\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.071236 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.071215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7p8q8"]
Jul 14 19:52:35.141983 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.141959    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 19:52:35.142404 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.142389    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/0.log"
Jul 14 19:52:35.142458 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.142424    2576 generic.go:356] "Generic (PLEG): container finished" podID="a69b6751-ce3a-4490-a068-934961a7b976" containerID="3c2e7494d11f9c3952c51303bc4261efb907cc8a1933cddcc1ebf9954666f351" exitCode=255
Jul 14 19:52:35.142541 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.142521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-f2pfv" event={"ID":"a69b6751-ce3a-4490-a068-934961a7b976","Type":"ContainerDied","Data":"3c2e7494d11f9c3952c51303bc4261efb907cc8a1933cddcc1ebf9954666f351"}
Jul 14 19:52:35.142592 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.142568    2576 scope.go:117] "RemoveContainer" containerID="9e7636f732c860dc9a1610485f6c775162cd948aacd35e5459863130fa9d4e60"
Jul 14 19:52:35.142787 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.142766    2576 scope.go:117] "RemoveContainer" containerID="3c2e7494d11f9c3952c51303bc4261efb907cc8a1933cddcc1ebf9954666f351"
Jul 14 19:52:35.142976 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.142951    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-f2pfv_openshift-console-operator(a69b6751-ce3a-4490-a068-934961a7b976)\"" pod="openshift-console-operator/console-operator-7866497494-f2pfv" podUID="a69b6751-ce3a-4490-a068-934961a7b976"
Jul 14 19:52:35.171067 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.171040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c649611-ab91-4010-a4a6-e98109f53f8d-crio-socket\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.171168 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.171150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c649611-ab91-4010-a4a6-e98109f53f8d-crio-socket\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.171257 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.171238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.171304 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.171289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.171403 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.171386    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.171454 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.171409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c649611-ab91-4010-a4a6-e98109f53f8d-data-volume\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.171454 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.171420    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.171454 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.171448    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.671428671 +0000 UTC m=+66.513800847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.171603 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.171468    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.671459694 +0000 UTC m=+66.513831873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.171603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.171501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6g8s\" (UniqueName: \"kubernetes.io/projected/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-api-access-t6g8s\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.171733 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.171714    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c649611-ab91-4010-a4a6-e98109f53f8d-data-volume\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.184705 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.184685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6g8s\" (UniqueName: \"kubernetes.io/projected/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-api-access-t6g8s\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.473882 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.473834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:52:35.474064 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.473955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:35.476327 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.476305    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:52:35.476459 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.476308    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:52:35.484224 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.484198    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 19:52:35.484374 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.484269    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs podName:f91bbeb3-213c-4c73-b299-92b6bc40b606 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:39.484249046 +0000 UTC m=+130.326621235 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs") pod "network-metrics-daemon-9zzjl" (UID: "f91bbeb3-213c-4c73-b299-92b6bc40b606") : secret "metrics-daemon-secret" not found
Jul 14 19:52:35.486372 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.486333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f-original-pull-secret\") pod \"global-pull-secret-syncer-c2g72\" (UID: \"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f\") " pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:35.563874 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.563836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2g72"
Jul 14 19:52:35.574817 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.574788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:35.577813 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.577792    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:52:35.587258 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.587236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:52:35.597602 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.597577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st25k\" (UniqueName: \"kubernetes.io/projected/c87a4874-163d-4336-8c37-8a248a1a27d4-kube-api-access-st25k\") pod \"network-check-target-sc6nd\" (UID: \"c87a4874-163d-4336-8c37-8a248a1a27d4\") " pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:35.675295 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.675257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.675537 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.675301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:35.675537 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.675413    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.675537 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.675474    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:36.675459215 +0000 UTC m=+67.517831390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.675537 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.675420    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.675704 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.675558    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:36.675540956 +0000 UTC m=+67.517913133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.685103 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.685079    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2g72"]
Jul 14 19:52:35.687589 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:52:35.687570    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3952e8_d7e4_4aa5_bad1_5a5fd530ed4f.slice/crio-f9a4f6835c771450e65c1500618eb62eaa4d580a57464add2cf87522a3913208 WatchSource:0}: Error finding container f9a4f6835c771450e65c1500618eb62eaa4d580a57464add2cf87522a3913208: Status 404 returned error can't find the container with id f9a4f6835c771450e65c1500618eb62eaa4d580a57464add2cf87522a3913208
Jul 14 19:52:35.776297 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.776207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:52:35.776464 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.776364    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:35.776464 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.776385    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dd6bb5bc-6jhs4: secret "image-registry-tls" not found
Jul 14 19:52:35.776464 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.776435    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls podName:25bcc9fc-0b70-4461-858b-be14584edd28 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:07.776421166 +0000 UTC m=+98.618793345 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls") pod "image-registry-76dd6bb5bc-6jhs4" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28") : secret "image-registry-tls" not found
Jul 14 19:52:35.873410 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.873385    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkvzh\""
Jul 14 19:52:35.877074 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.877053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:52:35.877180 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.877168    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:35.877224 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:35.877215    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls podName:7ef4cfe7-c7f4-4178-81f5-672a74c457ba nodeName:}" failed. No retries permitted until 2026-07-14 19:53:07.87720359 +0000 UTC m=+98.719575766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls") pod "dns-default-v2zxw" (UID: "7ef4cfe7-c7f4-4178-81f5-672a74c457ba") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:35.881987 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:35.881973    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:36.000403 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:36.000210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sc6nd"]
Jul 14 19:52:36.002783 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:52:36.002758    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87a4874_163d_4336_8c37_8a248a1a27d4.slice/crio-954ffe68751b9e08e814828dba3e68f0baffdbb90304fd3c0fa990f94208c6fb WatchSource:0}: Error finding container 954ffe68751b9e08e814828dba3e68f0baffdbb90304fd3c0fa990f94208c6fb: Status 404 returned error can't find the container with id 954ffe68751b9e08e814828dba3e68f0baffdbb90304fd3c0fa990f94208c6fb
Jul 14 19:52:36.146749 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:36.146672    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 19:52:36.147174 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:36.147028    2576 scope.go:117] "RemoveContainer" containerID="3c2e7494d11f9c3952c51303bc4261efb907cc8a1933cddcc1ebf9954666f351"
Jul 14 19:52:36.147226 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:36.147198    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-f2pfv_openshift-console-operator(a69b6751-ce3a-4490-a068-934961a7b976)\"" pod="openshift-console-operator/console-operator-7866497494-f2pfv" podUID="a69b6751-ce3a-4490-a068-934961a7b976"
Jul 14 19:52:36.147916 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:36.147886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sc6nd" event={"ID":"c87a4874-163d-4336-8c37-8a248a1a27d4","Type":"ContainerStarted","Data":"954ffe68751b9e08e814828dba3e68f0baffdbb90304fd3c0fa990f94208c6fb"}
Jul 14 19:52:36.148863 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:36.148839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2g72" event={"ID":"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f","Type":"ContainerStarted","Data":"f9a4f6835c771450e65c1500618eb62eaa4d580a57464add2cf87522a3913208"}
Jul 14 19:52:36.685115 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:36.685011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:36.685319 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:36.685158    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:36.685319 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:36.685166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:36.685319 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:36.685274    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.685224324 +0000 UTC m=+69.527596504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:36.685637 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:36.685551    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:36.685637 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:36.685586    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.685576262 +0000 UTC m=+69.527948437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:37.009460 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:37.009427    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fm5x5_8173761e-40fd-4e25-9eaa-4006f6b1ecec/dns-node-resolver/0.log"
Jul 14 19:52:38.214692 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:38.214658    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwxkh_12e08452-1fd9-4bb7-baaf-404dd0344ca1/node-ca/0.log"
Jul 14 19:52:38.401022 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:38.400985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:38.401216 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:38.401109    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:52:38.401216 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:38.401185    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls podName:127861fc-5f15-435a-ab30-a3d014b90087 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.401164198 +0000 UTC m=+77.243536381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls") pod "cluster-samples-operator-65db858894-llb8c" (UID: "127861fc-5f15-435a-ab30-a3d014b90087") : secret "samples-operator-tls" not found
Jul 14 19:52:38.703932 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:38.703895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:38.703932 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:38.703938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:38.704171 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:38.704057    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:38.704171 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:38.704123    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:42.704106781 +0000 UTC m=+73.546478958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:38.704171 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:38.704060    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:38.704355 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:38.704195    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:42.704181425 +0000 UTC m=+73.546553600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:39.009139 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:39.009048    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rzzt4_5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e/serve-healthcheck-canary/0.log"
Jul 14 19:52:41.007872 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:41.007836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:41.008232 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:41.007897    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:41.008232 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:41.008186    2576 scope.go:117] "RemoveContainer" containerID="3c2e7494d11f9c3952c51303bc4261efb907cc8a1933cddcc1ebf9954666f351"
Jul 14 19:52:41.008380 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:41.008359    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-f2pfv_openshift-console-operator(a69b6751-ce3a-4490-a068-934961a7b976)\"" pod="openshift-console-operator/console-operator-7866497494-f2pfv" podUID="a69b6751-ce3a-4490-a068-934961a7b976"
Jul 14 19:52:41.162858 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:41.162821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2g72" event={"ID":"8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f","Type":"ContainerStarted","Data":"e5f062c75add73626798b294c0d5289149602cea4b6bc71b16674f123c7fa0df"}
Jul 14 19:52:41.164151 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:41.164126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sc6nd" event={"ID":"c87a4874-163d-4336-8c37-8a248a1a27d4","Type":"ContainerStarted","Data":"00719d22e710c9e0d682f58443a5addecb33d58af4473117a5da7cbd9a30ab4e"}
Jul 14 19:52:41.164260 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:41.164182    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:52:41.178245 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:41.178211    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c2g72" podStartSLOduration=66.442199351 podStartE2EDuration="1m11.178200039s" totalImagesPullingTime="4.736000688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:41.177756045 +0000 UTC m=+72.020128253" watchObservedRunningTime="2026-07-14 19:52:41.178200039 +0000 UTC m=+72.020572236"
Jul 14 19:52:42.739458 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:42.739421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:42.739458 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:42.739461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:42.739869 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:42.739573    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:42.739869 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:42.739591    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:42.739869 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:42.739639    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:50.739623672 +0000 UTC m=+81.581995847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:42.739869 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:42.739656    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:50.739649082 +0000 UTC m=+81.582021257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:46.467474 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:46.467438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:46.469817 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:46.469795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/127861fc-5f15-435a-ab30-a3d014b90087-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-llb8c\" (UID: \"127861fc-5f15-435a-ab30-a3d014b90087\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:46.544450 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:46.544422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"
Jul 14 19:52:46.659840 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:46.659792    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sc6nd" podStartSLOduration=72.241508298 podStartE2EDuration="1m16.659774859s" totalImagesPullingTime="4.418266561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:41.195991714 +0000 UTC m=+72.038363911" watchObservedRunningTime="2026-07-14 19:52:46.659774859 +0000 UTC m=+77.502147081"
Jul 14 19:52:46.660450 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:46.660431    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c"]
Jul 14 19:52:47.183026 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:47.182993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c" event={"ID":"127861fc-5f15-435a-ab30-a3d014b90087","Type":"ContainerStarted","Data":"334868ac1ac021e2a0b15c8ea3b26590f22f8f85a4ee50167140f7a0edc24218"}
Jul 14 19:52:49.191479 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:49.191398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c" event={"ID":"127861fc-5f15-435a-ab30-a3d014b90087","Type":"ContainerStarted","Data":"e0464b799f44bdc7ebea82cbc643d9efe3e25b5ba3b4d6d7969da78d3e485081"}
Jul 14 19:52:49.191830 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:49.191501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c" event={"ID":"127861fc-5f15-435a-ab30-a3d014b90087","Type":"ContainerStarted","Data":"d8d092f9767698d1bde12c952bc800228f16b137af022f7dbed2a21fc06d076b"}
Jul 14 19:52:49.211298 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:49.211244    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-llb8c" podStartSLOduration=16.983732743 podStartE2EDuration="19.211227416s" totalImagesPullingTime="2.227494673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:49.209988497 +0000 UTC m=+80.052360717" watchObservedRunningTime="2026-07-14 19:52:49.211227416 +0000 UTC m=+80.053599645"
Jul 14 19:52:50.801690 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:50.801654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:50.801690 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:50.801692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:50.802106 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:50.801802    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:50.802106 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:52:50.801865    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls podName:0c649611-ab91-4010-a4a6-e98109f53f8d nodeName:}" failed. No retries permitted until 2026-07-14 19:53:06.801850303 +0000 UTC m=+97.644222477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7p8q8" (UID: "0c649611-ab91-4010-a4a6-e98109f53f8d") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:50.802201 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:50.802147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c649611-ab91-4010-a4a6-e98109f53f8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:52:55.850523 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:55.850411    2576 scope.go:117] "RemoveContainer" containerID="3c2e7494d11f9c3952c51303bc4261efb907cc8a1933cddcc1ebf9954666f351"
Jul 14 19:52:56.212415 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:56.212391    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 19:52:56.212634 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:56.212459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-f2pfv" event={"ID":"a69b6751-ce3a-4490-a068-934961a7b976","Type":"ContainerStarted","Data":"a51c58f84ddaaaec012a84981ca92063e6cf06d38dd4f9336a54c37bf0dd48c6"}
Jul 14 19:52:56.212757 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:56.212740    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:56.232970 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:56.232927    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-f2pfv" podStartSLOduration=23.725305012 podStartE2EDuration="26.232915277s" totalImagesPullingTime="2.507610265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:56.232793541 +0000 UTC m=+87.075165739" watchObservedRunningTime="2026-07-14 19:52:56.232915277 +0000 UTC m=+87.075287485"
Jul 14 19:52:56.397862 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:56.397828    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-f2pfv"
Jul 14 19:52:59.280780 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.280750    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"]
Jul 14 19:52:59.286729 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.286707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.289589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.289571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 19:52:59.290658 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.290634    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 19:52:59.290658 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.290642    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 14 19:52:59.291410 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.291390    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 19:52:59.301139 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.301117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"]
Jul 14 19:52:59.368198 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.368163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-klusterlet-config\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.368198 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.368199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmfq\" (UniqueName: \"kubernetes.io/projected/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-kube-api-access-dtmfq\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.368462 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.368277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-tmp\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.385682 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.385657    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-xzdx7"]
Jul 14 19:52:59.387894 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.387876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xzdx7"
Jul 14 19:52:59.391371 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.391354    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h4bnq\""
Jul 14 19:52:59.391478 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.391400    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 19:52:59.391894 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.391876    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 19:52:59.406956 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.406935    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xzdx7"]
Jul 14 19:52:59.468906 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.468885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdprg\" (UniqueName: \"kubernetes.io/projected/058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69-kube-api-access-cdprg\") pod \"downloads-68c9cbb497-xzdx7\" (UID: \"058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69\") " pod="openshift-console/downloads-68c9cbb497-xzdx7"
Jul 14 19:52:59.469010 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.468931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-klusterlet-config\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.469010 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.468950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmfq\" (UniqueName: \"kubernetes.io/projected/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-kube-api-access-dtmfq\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.469132 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.469015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-tmp\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.469419 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.469399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-tmp\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.471271 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.471253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-klusterlet-config\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.479009 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.478987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmfq\" (UniqueName: \"kubernetes.io/projected/e0ea9fa0-0fbb-43ff-b162-698b70dad6f4-kube-api-access-dtmfq\") pod \"klusterlet-addon-workmgr-65d7846d5c-9jml2\" (UID: \"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.569825 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.569748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdprg\" (UniqueName: \"kubernetes.io/projected/058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69-kube-api-access-cdprg\") pod \"downloads-68c9cbb497-xzdx7\" (UID: \"058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69\") " pod="openshift-console/downloads-68c9cbb497-xzdx7"
Jul 14 19:52:59.584590 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.584559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdprg\" (UniqueName: \"kubernetes.io/projected/058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69-kube-api-access-cdprg\") pod \"downloads-68c9cbb497-xzdx7\" (UID: \"058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69\") " pod="openshift-console/downloads-68c9cbb497-xzdx7"
Jul 14 19:52:59.595363 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.595324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:52:59.696775 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.696748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xzdx7"
Jul 14 19:52:59.722114 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.722088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"]
Jul 14 19:52:59.725669 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:52:59.725640    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ea9fa0_0fbb_43ff_b162_698b70dad6f4.slice/crio-84c932773c45512cf22c84d8924e77d68821543504c5ead7194bda77346820d6 WatchSource:0}: Error finding container 84c932773c45512cf22c84d8924e77d68821543504c5ead7194bda77346820d6: Status 404 returned error can't find the container with id 84c932773c45512cf22c84d8924e77d68821543504c5ead7194bda77346820d6
Jul 14 19:52:59.821553 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:52:59.821472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xzdx7"]
Jul 14 19:52:59.825300 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:52:59.825273    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058e5e8d_b0b1_4f0b_9e8b_9cec29fa5e69.slice/crio-a03e5e588730889ef98107c8485e2c40ca3352dbe7a32310e76d6e16c81d1b73 WatchSource:0}: Error finding container a03e5e588730889ef98107c8485e2c40ca3352dbe7a32310e76d6e16c81d1b73: Status 404 returned error can't find the container with id a03e5e588730889ef98107c8485e2c40ca3352dbe7a32310e76d6e16c81d1b73
Jul 14 19:53:00.226735 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:00.226695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xzdx7" event={"ID":"058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69","Type":"ContainerStarted","Data":"a03e5e588730889ef98107c8485e2c40ca3352dbe7a32310e76d6e16c81d1b73"}
Jul 14 19:53:00.227664 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:00.227642    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2" event={"ID":"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4","Type":"ContainerStarted","Data":"84c932773c45512cf22c84d8924e77d68821543504c5ead7194bda77346820d6"}
Jul 14 19:53:04.246378 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.246318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2" event={"ID":"e0ea9fa0-0fbb-43ff-b162-698b70dad6f4","Type":"ContainerStarted","Data":"7e5edfb2faeafa03160badb5e1e7fdba0be0a6e24f2e7722e4e32945504e3218"}
Jul 14 19:53:04.246824 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.246402    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:53:04.248162 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.248142    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2"
Jul 14 19:53:04.263491 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.263437    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d7846d5c-9jml2" podStartSLOduration=0.965791855 podStartE2EDuration="5.263419117s" totalImagesPullingTime="4.297627262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:04.262730819 +0000 UTC m=+95.105103018" watchObservedRunningTime="2026-07-14 19:53:04.263419117 +0000 UTC m=+95.105791315"
Jul 14 19:53:04.693893 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.693853    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f7968699c-x4t9x"]
Jul 14 19:53:04.696121 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.696098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.698810 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.698778    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 19:53:04.698929 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.698831    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 19:53:04.698929 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.698882    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 19:53:04.699167 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.699136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 19:53:04.699655 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.699592    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 19:53:04.699655 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.699620    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hzzg9\""
Jul 14 19:53:04.708042 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.708020    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7968699c-x4t9x"]
Jul 14 19:53:04.815173 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.815139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-serving-cert\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.815173 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.815174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-service-ca\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.815432 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.815213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-config\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.815432 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.815239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-oauth-serving-cert\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.815432 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.815278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-oauth-config\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.815432 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.815299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2778\" (UniqueName: \"kubernetes.io/projected/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-kube-api-access-l2778\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.916746 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.916706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-serving-cert\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.916746 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.916750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-service-ca\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.916972 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.916796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-config\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.916972 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.916826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-oauth-serving-cert\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.916972 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.916867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-oauth-config\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.916972 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.916901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2778\" (UniqueName: \"kubernetes.io/projected/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-kube-api-access-l2778\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.917901 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.917874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-config\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.918011 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.917979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-oauth-serving-cert\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.918076 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.918007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-service-ca\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.919655 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.919628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-serving-cert\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.919757 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.919695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-oauth-config\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:04.927962 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:04.927937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2778\" (UniqueName: \"kubernetes.io/projected/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-kube-api-access-l2778\") pod \"console-6f7968699c-x4t9x\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") " pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:05.007806 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:05.007774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:05.150122 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:05.150085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7968699c-x4t9x"]
Jul 14 19:53:05.153216 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:53:05.153189    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f2a2eb_4217_42d9_9c57_b5886f1edf15.slice/crio-ab5f61e9f77dd52f51303f73618047ef379d1f40eb9fdf9bba5a39bc8a6ebbca WatchSource:0}: Error finding container ab5f61e9f77dd52f51303f73618047ef379d1f40eb9fdf9bba5a39bc8a6ebbca: Status 404 returned error can't find the container with id ab5f61e9f77dd52f51303f73618047ef379d1f40eb9fdf9bba5a39bc8a6ebbca
Jul 14 19:53:05.253845 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:05.253809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7968699c-x4t9x" event={"ID":"b2f2a2eb-4217-42d9-9c57-b5886f1edf15","Type":"ContainerStarted","Data":"ab5f61e9f77dd52f51303f73618047ef379d1f40eb9fdf9bba5a39bc8a6ebbca"}
Jul 14 19:53:06.832577 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:06.832533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:53:06.835325 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:06.835295    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c649611-ab91-4010-a4a6-e98109f53f8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7p8q8\" (UID: \"0c649611-ab91-4010-a4a6-e98109f53f8d\") " pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:53:06.852554 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:06.852526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7p8q8"
Jul 14 19:53:07.007333 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.007297    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7p8q8"]
Jul 14 19:53:07.009953 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:53:07.009924    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c649611_ab91_4010_a4a6_e98109f53f8d.slice/crio-ac632b3cee3399105e7aa7ff83a7ec4c898fab75af32806a42b8a3569d97fcad WatchSource:0}: Error finding container ac632b3cee3399105e7aa7ff83a7ec4c898fab75af32806a42b8a3569d97fcad: Status 404 returned error can't find the container with id ac632b3cee3399105e7aa7ff83a7ec4c898fab75af32806a42b8a3569d97fcad
Jul 14 19:53:07.262025 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.261975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7p8q8" event={"ID":"0c649611-ab91-4010-a4a6-e98109f53f8d","Type":"ContainerStarted","Data":"ac632b3cee3399105e7aa7ff83a7ec4c898fab75af32806a42b8a3569d97fcad"}
Jul 14 19:53:07.841488 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.841449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:53:07.844408 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.844384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"image-registry-76dd6bb5bc-6jhs4\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") " pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:53:07.860924 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.860897    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm29c\""
Jul 14 19:53:07.868883 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.868847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:53:07.942800 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.942763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:53:07.945783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:07.945755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ef4cfe7-c7f4-4178-81f5-672a74c457ba-metrics-tls\") pod \"dns-default-v2zxw\" (UID: \"7ef4cfe7-c7f4-4178-81f5-672a74c457ba\") " pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:53:08.180642 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:08.180552    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc26t\""
Jul 14 19:53:08.188826 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:08.188796    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:53:08.519715 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:08.519383    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"]
Jul 14 19:53:08.524624 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:53:08.524592    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bcc9fc_0b70_4461_858b_be14584edd28.slice/crio-000fdfd700e8b4a8c15910c50c2e030025b71659d0b91ff976973cd9705c408d WatchSource:0}: Error finding container 000fdfd700e8b4a8c15910c50c2e030025b71659d0b91ff976973cd9705c408d: Status 404 returned error can't find the container with id 000fdfd700e8b4a8c15910c50c2e030025b71659d0b91ff976973cd9705c408d
Jul 14 19:53:08.534315 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:08.534218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2zxw"]
Jul 14 19:53:08.539683 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:53:08.539657    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef4cfe7_c7f4_4178_81f5_672a74c457ba.slice/crio-29cb749b0f85c8952cdf60115b41fbadc9ec2f99b24f3d31cc54dd9c1b2e88a1 WatchSource:0}: Error finding container 29cb749b0f85c8952cdf60115b41fbadc9ec2f99b24f3d31cc54dd9c1b2e88a1: Status 404 returned error can't find the container with id 29cb749b0f85c8952cdf60115b41fbadc9ec2f99b24f3d31cc54dd9c1b2e88a1
Jul 14 19:53:09.274352 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:09.274231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2zxw" event={"ID":"7ef4cfe7-c7f4-4178-81f5-672a74c457ba","Type":"ContainerStarted","Data":"29cb749b0f85c8952cdf60115b41fbadc9ec2f99b24f3d31cc54dd9c1b2e88a1"}
Jul 14 19:53:09.280462 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:09.279535    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4" event={"ID":"25bcc9fc-0b70-4461-858b-be14584edd28","Type":"ContainerStarted","Data":"53d06fa558f8fb62009dbff8cf2dbec4ac1e88b012cd9782edafb6e4ec3303de"}
Jul 14 19:53:09.280462 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:09.279589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4" event={"ID":"25bcc9fc-0b70-4461-858b-be14584edd28","Type":"ContainerStarted","Data":"000fdfd700e8b4a8c15910c50c2e030025b71659d0b91ff976973cd9705c408d"}
Jul 14 19:53:09.280462 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:09.280404    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:53:09.284097 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:09.283436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7968699c-x4t9x" event={"ID":"b2f2a2eb-4217-42d9-9c57-b5886f1edf15","Type":"ContainerStarted","Data":"7652a3bc52d19db89cbb115556178c4d4ad4ed6f67a667635e130174a6fc7268"}
Jul 14 19:53:09.304254 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:09.303035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4" podStartSLOduration=99.303013812 podStartE2EDuration="1m39.303013812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:09.301017924 +0000 UTC m=+100.143390145" watchObservedRunningTime="2026-07-14 19:53:09.303013812 +0000 UTC m=+100.145386010"
Jul 14 19:53:09.323394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:09.323186    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f7968699c-x4t9x" podStartSLOduration=2.05389489 podStartE2EDuration="5.323165086s" totalImagesPullingTime="3.269270196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:09.321949778 +0000 UTC m=+100.164321976" watchObservedRunningTime="2026-07-14 19:53:09.323165086 +0000 UTC m=+100.165537285"
Jul 14 19:53:12.170623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:12.170582    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sc6nd"
Jul 14 19:53:13.278057 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.278020    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7855fbb878-7gxjw"]
Jul 14 19:53:13.305515 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.305478    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7855fbb878-7gxjw"]
Jul 14 19:53:13.305688 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.305589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.313443 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.313415    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 19:53:13.494998 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.494967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-serving-cert\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.494998 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.495005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvhfd\" (UniqueName: \"kubernetes.io/projected/c68c5d22-5544-47d9-a19c-c750775357b4-kube-api-access-mvhfd\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.495222 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.495033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-service-ca\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.495222 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.495087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-oauth-serving-cert\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.495222 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.495131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-console-config\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.495222 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.495209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-oauth-config\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.495395 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.495258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-trusted-ca-bundle\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.595871 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.595790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-console-config\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.595871 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.595859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-oauth-config\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596083 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.595898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-trusted-ca-bundle\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596083 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.595942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-serving-cert\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596083 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.595966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvhfd\" (UniqueName: \"kubernetes.io/projected/c68c5d22-5544-47d9-a19c-c750775357b4-kube-api-access-mvhfd\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596083 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.595987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-service-ca\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596083 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.596009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-oauth-serving-cert\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596675 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.596645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-console-config\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596922 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.596899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-oauth-serving-cert\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.596984 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.596899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-service-ca\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.597083 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.597032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-trusted-ca-bundle\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.598740 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.598716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-serving-cert\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.598827 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.598764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-oauth-config\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.605584 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.605558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvhfd\" (UniqueName: \"kubernetes.io/projected/c68c5d22-5544-47d9-a19c-c750775357b4-kube-api-access-mvhfd\") pod \"console-7855fbb878-7gxjw\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") " pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:13.617319 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:13.617299    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:14.949970 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.949935    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"]
Jul 14 19:53:14.972703 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.972665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"]
Jul 14 19:53:14.972856 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.972783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:14.975847 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.975826    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 19:53:14.976938 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.976914    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 19:53:14.977643 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.977592    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 19:53:14.977780 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.977753    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7lm52\""
Jul 14 19:53:14.978298 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.978272    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 19:53:14.979562 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:14.979544    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 19:53:15.007998 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.007967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:15.008144 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.008025    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:15.009803 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.009644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe4257d-6933-4faf-abb2-f3c424405b49-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.009803 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.009697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abe4257d-6933-4faf-abb2-f3c424405b49-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.009803 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.009733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf2zv\" (UniqueName: \"kubernetes.io/projected/abe4257d-6933-4faf-abb2-f3c424405b49-kube-api-access-nf2zv\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.010038 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.009933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe4257d-6933-4faf-abb2-f3c424405b49-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.013786 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.013767    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:15.028013 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.027984    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8f4nd"]
Jul 14 19:53:15.048494 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.048465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.052815 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.052789    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pq5qb\""
Jul 14 19:53:15.052993 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.052979    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 19:53:15.053761 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.053587    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 19:53:15.053761 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.053707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 19:53:15.110401 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-tls\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.110401 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-wtmp\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.110624 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe4257d-6933-4faf-abb2-f3c424405b49-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.110624 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.110624 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-accelerators-collector-config\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.110814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59789efe-d225-48c7-818b-a7f43484c6af-metrics-client-ca\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.110814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe4257d-6933-4faf-abb2-f3c424405b49-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.110814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-root\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.110814 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcdwg\" (UniqueName: \"kubernetes.io/projected/59789efe-d225-48c7-818b-a7f43484c6af-kube-api-access-rcdwg\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.111003 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abe4257d-6933-4faf-abb2-f3c424405b49-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.111003 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2zv\" (UniqueName: \"kubernetes.io/projected/abe4257d-6933-4faf-abb2-f3c424405b49-kube-api-access-nf2zv\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.111003 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-textfile\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.111003 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.110924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-sys\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.111210 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.111138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe4257d-6933-4faf-abb2-f3c424405b49-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.113286 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.113256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abe4257d-6933-4faf-abb2-f3c424405b49-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.113609 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.113589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe4257d-6933-4faf-abb2-f3c424405b49-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.119907 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.119888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf2zv\" (UniqueName: \"kubernetes.io/projected/abe4257d-6933-4faf-abb2-f3c424405b49-kube-api-access-nf2zv\") pod \"openshift-state-metrics-84bd68b896-d5mxq\" (UID: \"abe4257d-6933-4faf-abb2-f3c424405b49\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.211821 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.211738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-tls\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.211821 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.211777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-wtmp\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212003 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.211916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212003 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.211929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-wtmp\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212003 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.211975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-accelerators-collector-config\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212146 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59789efe-d225-48c7-818b-a7f43484c6af-metrics-client-ca\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212146 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212049    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-root\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212146 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcdwg\" (UniqueName: \"kubernetes.io/projected/59789efe-d225-48c7-818b-a7f43484c6af-kube-api-access-rcdwg\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212146 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-textfile\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212146 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-sys\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212420 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-sys\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212420 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59789efe-d225-48c7-818b-a7f43484c6af-root\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212671 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212619    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-accelerators-collector-config\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212833 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-textfile\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.212833 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.212821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59789efe-d225-48c7-818b-a7f43484c6af-metrics-client-ca\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.214547 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.214524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.215245 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.215223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59789efe-d225-48c7-818b-a7f43484c6af-node-exporter-tls\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.224849 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.224827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcdwg\" (UniqueName: \"kubernetes.io/projected/59789efe-d225-48c7-818b-a7f43484c6af-kube-api-access-rcdwg\") pod \"node-exporter-8f4nd\" (UID: \"59789efe-d225-48c7-818b-a7f43484c6af\") " pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:15.284760 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.284719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"
Jul 14 19:53:15.313908 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.313876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:15.360270 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:15.360232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8f4nd"
Jul 14 19:53:18.007500 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.007460    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cf586b875-98jkc"]
Jul 14 19:53:18.018334 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.018311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.021252 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.021231    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 19:53:18.021428 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.021407    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 19:53:18.021577 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.021558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 19:53:18.021666 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.021657    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 19:53:18.021922 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.021766    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-elvvt8v2f8p9b\""
Jul 14 19:53:18.022252 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.022212    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lrgml\""
Jul 14 19:53:18.022252 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.022228    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 19:53:18.026897 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.026702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cf586b875-98jkc"]
Jul 14 19:53:18.036361 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.036471 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-tls\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.036471 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.036613 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9897332-8cde-4642-bd84-500024ba84e2-metrics-client-ca\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.036613 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.036613 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.036613 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-grpc-tls\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.036828 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.036625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d278\" (UniqueName: \"kubernetes.io/projected/a9897332-8cde-4642-bd84-500024ba84e2-kube-api-access-2d278\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.137958 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.137916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.137958 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.137964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-tls\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.138208 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.137982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.138208 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.138000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9897332-8cde-4642-bd84-500024ba84e2-metrics-client-ca\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.138208 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.138038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.138384 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.138218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.138384 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.138264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-grpc-tls\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.138384 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.138292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d278\" (UniqueName: \"kubernetes.io/projected/a9897332-8cde-4642-bd84-500024ba84e2-kube-api-access-2d278\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.139410 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.139382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9897332-8cde-4642-bd84-500024ba84e2-metrics-client-ca\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.141133 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.141102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.141558 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.141386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.141558 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.141466    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.141864 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.141836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.142036 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.142012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-grpc-tls\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.142628 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.142609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a9897332-8cde-4642-bd84-500024ba84e2-secret-thanos-querier-tls\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.148040 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.148019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d278\" (UniqueName: \"kubernetes.io/projected/a9897332-8cde-4642-bd84-500024ba84e2-kube-api-access-2d278\") pod \"thanos-querier-7cf586b875-98jkc\" (UID: \"a9897332-8cde-4642-bd84-500024ba84e2\") " pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:18.330551 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:18.330471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:19.408985 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.408950    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d9d4bc989-8kkbw"]
Jul 14 19:53:19.412850 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.412831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.417457 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.417434    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 19:53:19.418271 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.418253    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 19:53:19.418426 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.418408    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 19:53:19.418496 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.418437    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 19:53:19.418551 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.418499    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4qn2lbo0opugd\""
Jul 14 19:53:19.418551 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.418532    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tl4fh\""
Jul 14 19:53:19.426111 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.426091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9d4bc989-8kkbw"]
Jul 14 19:53:19.449457 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.449427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2188428a-0b7d-4e98-b043-69f18ea36416-metrics-server-audit-profiles\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.449623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.449467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2188428a-0b7d-4e98-b043-69f18ea36416-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.449623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.449495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-secret-metrics-server-client-certs\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.449623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.449520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2188428a-0b7d-4e98-b043-69f18ea36416-audit-log\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.449623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.449570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jllw\" (UniqueName: \"kubernetes.io/projected/2188428a-0b7d-4e98-b043-69f18ea36416-kube-api-access-7jllw\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.449623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.449603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-client-ca-bundle\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.449914 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.449684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-secret-metrics-server-tls\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.550601 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.550564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2188428a-0b7d-4e98-b043-69f18ea36416-metrics-server-audit-profiles\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.550785 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.550625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2188428a-0b7d-4e98-b043-69f18ea36416-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.550785 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.550652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-secret-metrics-server-client-certs\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.550785 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.550670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2188428a-0b7d-4e98-b043-69f18ea36416-audit-log\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.550785 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.550687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jllw\" (UniqueName: \"kubernetes.io/projected/2188428a-0b7d-4e98-b043-69f18ea36416-kube-api-access-7jllw\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.550785 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.550720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-client-ca-bundle\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.550785 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.550752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-secret-metrics-server-tls\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.551163 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.551139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2188428a-0b7d-4e98-b043-69f18ea36416-audit-log\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.551799 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.551766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2188428a-0b7d-4e98-b043-69f18ea36416-metrics-server-audit-profiles\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.551799 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.551786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2188428a-0b7d-4e98-b043-69f18ea36416-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.553591 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.553568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-client-ca-bundle\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.553734 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.553714    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-secret-metrics-server-tls\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.553799 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.553717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2188428a-0b7d-4e98-b043-69f18ea36416-secret-metrics-server-client-certs\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.561877 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.561857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jllw\" (UniqueName: \"kubernetes.io/projected/2188428a-0b7d-4e98-b043-69f18ea36416-kube-api-access-7jllw\") pod \"metrics-server-d9d4bc989-8kkbw\" (UID: \"2188428a-0b7d-4e98-b043-69f18ea36416\") " pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.724200 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.724167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:19.726975 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.726951    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"]
Jul 14 19:53:19.730733 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.730712    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:19.733200 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.733179    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 19:53:19.733304 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.733268    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sr95d\""
Jul 14 19:53:19.740179 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.740144    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"]
Jul 14 19:53:19.752224 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.752200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec99a656-cdb1-424a-941c-1db016871616-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xwjss\" (UID: \"ec99a656-cdb1-424a-941c-1db016871616\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:19.752321 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.752246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-628t7\" (UniqueName: \"kubernetes.io/projected/ec99a656-cdb1-424a-941c-1db016871616-kube-api-access-628t7\") pod \"monitoring-plugin-5f68df7f58-xwjss\" (UID: \"ec99a656-cdb1-424a-941c-1db016871616\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:19.853013 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.852606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-628t7\" (UniqueName: \"kubernetes.io/projected/ec99a656-cdb1-424a-941c-1db016871616-kube-api-access-628t7\") pod \"monitoring-plugin-5f68df7f58-xwjss\" (UID: \"ec99a656-cdb1-424a-941c-1db016871616\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:19.853013 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.852746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec99a656-cdb1-424a-941c-1db016871616-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xwjss\" (UID: \"ec99a656-cdb1-424a-941c-1db016871616\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:19.853013 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:53:19.852837    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 14 19:53:19.853013 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:53:19.852884    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec99a656-cdb1-424a-941c-1db016871616-monitoring-plugin-cert podName:ec99a656-cdb1-424a-941c-1db016871616 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:20.352870876 +0000 UTC m=+111.195243052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ec99a656-cdb1-424a-941c-1db016871616-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-xwjss" (UID: "ec99a656-cdb1-424a-941c-1db016871616") : secret "monitoring-plugin-cert" not found
Jul 14 19:53:19.861756 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:19.861727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-628t7\" (UniqueName: \"kubernetes.io/projected/ec99a656-cdb1-424a-941c-1db016871616-kube-api-access-628t7\") pod \"monitoring-plugin-5f68df7f58-xwjss\" (UID: \"ec99a656-cdb1-424a-941c-1db016871616\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:20.110971 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.110872    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7855fbb878-7gxjw"]
Jul 14 19:53:20.343516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.343439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8f4nd" event={"ID":"59789efe-d225-48c7-818b-a7f43484c6af","Type":"ContainerStarted","Data":"61c15f4e7b7da0fcdf4c8c1af9d0a76e05a8e276196466c562f7995910a30386"}
Jul 14 19:53:20.358480 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.358321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec99a656-cdb1-424a-941c-1db016871616-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xwjss\" (UID: \"ec99a656-cdb1-424a-941c-1db016871616\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:20.367143 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.367085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ec99a656-cdb1-424a-941c-1db016871616-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xwjss\" (UID: \"ec99a656-cdb1-424a-941c-1db016871616\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:20.508694 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.508621    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9d4bc989-8kkbw"]
Jul 14 19:53:20.642075 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.641991    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:20.666051 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.658761    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7855fbb878-7gxjw"]
Jul 14 19:53:20.666051 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.663349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq"]
Jul 14 19:53:20.666252 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.665996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cf586b875-98jkc"]
Jul 14 19:53:20.844110 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:20.844036    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"]
Jul 14 19:53:20.852743 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:53:20.852663    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec99a656_cdb1_424a_941c_1db016871616.slice/crio-25267ea99180d46876da5665b7f3e6aaaf1f32b9634372af61310ceb721f4d29 WatchSource:0}: Error finding container 25267ea99180d46876da5665b7f3e6aaaf1f32b9634372af61310ceb721f4d29: Status 404 returned error can't find the container with id 25267ea99180d46876da5665b7f3e6aaaf1f32b9634372af61310ceb721f4d29
Jul 14 19:53:21.248046 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.248008    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 19:53:21.258166 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.258138    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"]
Jul 14 19:53:21.258397 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.258377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.261569 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.261471    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 19:53:21.263400 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.262103    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 19:53:21.263400 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.262328    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 19:53:21.263400 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.262603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 19:53:21.263400 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.262819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-982vf\""
Jul 14 19:53:21.263400 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.263013    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 19:53:21.263400 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.263209    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 19:53:21.263813 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.263426    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 19:53:21.263813 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.263523    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 19:53:21.264110 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.264002    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 19:53:21.264492 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.264232    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 19:53:21.264492 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.264269    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 19:53:21.264492 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.264422    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 19:53:21.265000 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.264747    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8bn5gukc3sdbs\""
Jul 14 19:53:21.276835 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.275784    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.282999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-config\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93cabaa0-103c-4830-96e9-80ce0526371b-config-out\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.283364 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284175 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.283971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284175 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284175 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284175 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284175 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284872 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93cabaa0-103c-4830-96e9-80ce0526371b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284872 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284872 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-web-config\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284872 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.284872 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.284390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc7rl\" (UniqueName: \"kubernetes.io/projected/93cabaa0-103c-4830-96e9-80ce0526371b-kube-api-access-rc7rl\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.285143 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.285009    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 19:53:21.285956 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.285663    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 19:53:21.353912 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.353384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw" event={"ID":"2188428a-0b7d-4e98-b043-69f18ea36416","Type":"ContainerStarted","Data":"0379a9d176ddc12e1b5429f0d86b0201a5c152863a0feecfc0715060421464ba"}
Jul 14 19:53:21.356372 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.356205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq" event={"ID":"abe4257d-6933-4faf-abb2-f3c424405b49","Type":"ContainerStarted","Data":"01e1b887f3ff4fd1d89ed1e87036de7b2067457f9812e48969eadf27661a8176"}
Jul 14 19:53:21.356372 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.356265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq" event={"ID":"abe4257d-6933-4faf-abb2-f3c424405b49","Type":"ContainerStarted","Data":"56ee98794491a5a0ad7b2fb8c610ed35a18130ebeaf01f05b445a1a687a6f44e"}
Jul 14 19:53:21.356372 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.356297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq" event={"ID":"abe4257d-6933-4faf-abb2-f3c424405b49","Type":"ContainerStarted","Data":"0dc7541d62d1bb106a57dd1a4fe5c563f7756222923976bc4e9a544e6960c9e4"}
Jul 14 19:53:21.359060 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.358435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7855fbb878-7gxjw" event={"ID":"c68c5d22-5544-47d9-a19c-c750775357b4","Type":"ContainerStarted","Data":"4a3cec867f3b62ea400da219f56723c8b979117b7b37452bb086cd85af580059"}
Jul 14 19:53:21.359060 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.358477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7855fbb878-7gxjw" event={"ID":"c68c5d22-5544-47d9-a19c-c750775357b4","Type":"ContainerStarted","Data":"f0d557a35dd27f44910b9b2c690305ad183a5a3ee95554ac4ee6e40ac9d98dde"}
Jul 14 19:53:21.361787 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.361561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss" event={"ID":"ec99a656-cdb1-424a-941c-1db016871616","Type":"ContainerStarted","Data":"25267ea99180d46876da5665b7f3e6aaaf1f32b9634372af61310ceb721f4d29"}
Jul 14 19:53:21.363297 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.363263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" event={"ID":"a9897332-8cde-4642-bd84-500024ba84e2","Type":"ContainerStarted","Data":"842d4dd3f3585ea4e915ac3dcc03dcab44ba1bf6625705657b0da58e3512395b"}
Jul 14 19:53:21.367548 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.367427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7p8q8" event={"ID":"0c649611-ab91-4010-a4a6-e98109f53f8d","Type":"ContainerStarted","Data":"e1744415139846b0d2cb69d1d3e1b1ab25f125181ca7ac973a1d8b1309636bcf"}
Jul 14 19:53:21.378027 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.373974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xzdx7" event={"ID":"058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69","Type":"ContainerStarted","Data":"35b0aea1fcbc5e16b4dc753f1f9629e496fc4fcd403ca01e466862ca88f62217"}
Jul 14 19:53:21.378027 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.377144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-xzdx7"
Jul 14 19:53:21.379138 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.379005    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-xzdx7"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.379261    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7855fbb878-7gxjw" podStartSLOduration=8.37922796 podStartE2EDuration="8.37922796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:21.37785428 +0000 UTC m=+112.220226477" watchObservedRunningTime="2026-07-14 19:53:21.37922796 +0000 UTC m=+112.221600158"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.382003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2zxw" event={"ID":"7ef4cfe7-c7f4-4178-81f5-672a74c457ba","Type":"ContainerStarted","Data":"f1e7a72ef17968d95e99c7149d70a24975e61eef801d61e80a9dcb0028e844d1"}
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.382043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2zxw" event={"ID":"7ef4cfe7-c7f4-4178-81f5-672a74c457ba","Type":"ContainerStarted","Data":"3934565d9301b75661aabe74b274a1b5c443ac70518ff2643c8db0b575b5180b"}
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.382705    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385059    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-config\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93cabaa0-103c-4830-96e9-80ce0526371b-config-out\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.385574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.386512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.386512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.386512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93cabaa0-103c-4830-96e9-80ce0526371b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.386512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.386512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-web-config\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.386512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.386512 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.385702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc7rl\" (UniqueName: \"kubernetes.io/projected/93cabaa0-103c-4830-96e9-80ce0526371b-kube-api-access-rc7rl\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.387088 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.386974    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.388278 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.387248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.388278 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.388071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.389430 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.389115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.391017 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.389730    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.391875 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.391231    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.395818 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.395114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.395818 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.395681    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93cabaa0-103c-4830-96e9-80ce0526371b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.401500 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.401480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93cabaa0-103c-4830-96e9-80ce0526371b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.402039 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.402017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-config\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.402220 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.402174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.402952 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.402897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.404484 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.404428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-web-config\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.404484 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.404466    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.404792 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.404769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.405419 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.405371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.406583 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.405775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93cabaa0-103c-4830-96e9-80ce0526371b-config-out\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.406583 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.406540    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.407920 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.407319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc7rl\" (UniqueName: \"kubernetes.io/projected/93cabaa0-103c-4830-96e9-80ce0526371b-kube-api-access-rc7rl\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.408067 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.407893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93cabaa0-103c-4830-96e9-80ce0526371b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93cabaa0-103c-4830-96e9-80ce0526371b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.423304 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.422838    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-xzdx7" podStartSLOduration=2.004905656 podStartE2EDuration="22.422816993s" totalImagesPullingTime="20.417911337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:21.401509816 +0000 UTC m=+112.243882015" watchObservedRunningTime="2026-07-14 19:53:21.422816993 +0000 UTC m=+112.265189190"
Jul 14 19:53:21.458366 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.457911    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v2zxw" podStartSLOduration=66.749350443 podStartE2EDuration="1m18.457791572s" totalImagesPullingTime="11.708441129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:21.456912293 +0000 UTC m=+112.299284506" watchObservedRunningTime="2026-07-14 19:53:21.457791572 +0000 UTC m=+112.300163772"
Jul 14 19:53:21.586506 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.586203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:21.820572 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:21.820429    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 19:53:22.392939 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:22.392823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerStarted","Data":"00b1c4970107c76f4f2fc539e22c3d001d20cfe32669dd74612c83b6010aa605"}
Jul 14 19:53:22.396321 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:22.396289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7p8q8" event={"ID":"0c649611-ab91-4010-a4a6-e98109f53f8d","Type":"ContainerStarted","Data":"18c1ae6ad2006a975aa1724441e9829d68889c485af1e42cc5ef6885be8a8d9d"}
Jul 14 19:53:23.617499 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:23.617399    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:29.428139 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.428094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw" event={"ID":"2188428a-0b7d-4e98-b043-69f18ea36416","Type":"ContainerStarted","Data":"de3ac2f58e72d633ee9288853a0e34e902e7ab00a69a53dfe1cb28073276e501"}
Jul 14 19:53:29.430172 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.430145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq" event={"ID":"abe4257d-6933-4faf-abb2-f3c424405b49","Type":"ContainerStarted","Data":"fff3f0c8862d1213376a49dcf8c107451821c69c745ea40c0b5c6a9e4669d2db"}
Jul 14 19:53:29.431688 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.431662    2576 generic.go:356] "Generic (PLEG): container finished" podID="93cabaa0-103c-4830-96e9-80ce0526371b" containerID="5e286d34c43d0a28b317b45af72a5f55482b948835d5b077e2f1978f35e50aad" exitCode=0
Jul 14 19:53:29.431809 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.431695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerDied","Data":"5e286d34c43d0a28b317b45af72a5f55482b948835d5b077e2f1978f35e50aad"}
Jul 14 19:53:29.433537 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.433516    2576 generic.go:356] "Generic (PLEG): container finished" podID="59789efe-d225-48c7-818b-a7f43484c6af" containerID="259849fbc672afaa25ce0a62a88a5bd0b2f17ace0ea98f335bf6f5783b1c6936" exitCode=0
Jul 14 19:53:29.433614 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.433594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8f4nd" event={"ID":"59789efe-d225-48c7-818b-a7f43484c6af","Type":"ContainerDied","Data":"259849fbc672afaa25ce0a62a88a5bd0b2f17ace0ea98f335bf6f5783b1c6936"}
Jul 14 19:53:29.435273 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.435249    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss" event={"ID":"ec99a656-cdb1-424a-941c-1db016871616","Type":"ContainerStarted","Data":"71c0e17624556cd55ab0dd9929238a5dd96b82984fad77d9c9d2da15018071ec"}
Jul 14 19:53:29.435403 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.435385    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:29.437781 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.437754    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" event={"ID":"a9897332-8cde-4642-bd84-500024ba84e2","Type":"ContainerStarted","Data":"0f4e4268a684551369e0756dee7cc7127d0e97cdbf159f3ea35ab987748a8716"}
Jul 14 19:53:29.437902 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.437825    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" event={"ID":"a9897332-8cde-4642-bd84-500024ba84e2","Type":"ContainerStarted","Data":"4ced4c808e95f50f73fe9f0a9fa4aa78d26a2f7525b58b15faebaa138602bbcf"}
Jul 14 19:53:29.437902 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.437865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" event={"ID":"a9897332-8cde-4642-bd84-500024ba84e2","Type":"ContainerStarted","Data":"0b7e9f92264f917d1244f5ab9e1a7fdceed2261757675891cd8972b683dcfc4e"}
Jul 14 19:53:29.439947 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.439926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7p8q8" event={"ID":"0c649611-ab91-4010-a4a6-e98109f53f8d","Type":"ContainerStarted","Data":"fcbfb8f7747453ce1f73dede671f587bb4be92fc3497355ac804698325b92391"}
Jul 14 19:53:29.440803 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.440782    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss"
Jul 14 19:53:29.448824 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.448758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw" podStartSLOduration=2.6922191 podStartE2EDuration="10.448745813s" totalImagesPullingTime="7.756526713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:29.448129355 +0000 UTC m=+120.290501553" watchObservedRunningTime="2026-07-14 19:53:29.448745813 +0000 UTC m=+120.291118009"
Jul 14 19:53:29.493025 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.492960    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xwjss" podStartSLOduration=3.069115694 podStartE2EDuration="10.492939245s" totalImagesPullingTime="7.423823551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:29.491953227 +0000 UTC m=+120.334325437" watchObservedRunningTime="2026-07-14 19:53:29.492939245 +0000 UTC m=+120.335311444"
Jul 14 19:53:29.514160 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.514110    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7p8q8" podStartSLOduration=33.499337251 podStartE2EDuration="54.514086568s" totalImagesPullingTime="21.014749317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:52:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:29.512551146 +0000 UTC m=+120.354923347" watchObservedRunningTime="2026-07-14 19:53:29.514086568 +0000 UTC m=+120.356458764"
Jul 14 19:53:29.552803 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:29.552752    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-d5mxq" podStartSLOduration=8.102042591 podStartE2EDuration="15.552735437s" totalImagesPullingTime="7.450692846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:29.550968184 +0000 UTC m=+120.393340393" watchObservedRunningTime="2026-07-14 19:53:29.552735437 +0000 UTC m=+120.395107638"
Jul 14 19:53:30.446026 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:30.445988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8f4nd" event={"ID":"59789efe-d225-48c7-818b-a7f43484c6af","Type":"ContainerStarted","Data":"8f3ae91f076d027da116ae27b7679ea44417d7c116fe61b4f45583ed05b28c6a"}
Jul 14 19:53:30.446501 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:30.446049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8f4nd" event={"ID":"59789efe-d225-48c7-818b-a7f43484c6af","Type":"ContainerStarted","Data":"ed3a5268c32bdf81a834632d5da94703d6ef6f16c45bddfc188888079e25d8fa"}
Jul 14 19:53:30.448813 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:30.448777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" event={"ID":"a9897332-8cde-4642-bd84-500024ba84e2","Type":"ContainerStarted","Data":"bbbf6e75943a8693a4d42a5f221b836d0812179a9e348c036329e5c78d3410c6"}
Jul 14 19:53:30.448948 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:30.448855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" event={"ID":"a9897332-8cde-4642-bd84-500024ba84e2","Type":"ContainerStarted","Data":"43b2e93988b2e71a26ed5e7467d9b7b6f892dcaedff6e69003dc6dd2294a6250"}
Jul 14 19:53:30.448948 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:30.448899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" event={"ID":"a9897332-8cde-4642-bd84-500024ba84e2","Type":"ContainerStarted","Data":"8bc95053d92805e114def17d6b4f93a69b93010cbade27cad733d206c32eb760"}
Jul 14 19:53:30.467297 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:30.467211    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8f4nd" podStartSLOduration=8.342744045 podStartE2EDuration="16.467195767s" totalImagesPullingTime="8.00666936s" totalInitContainerRuntime="117.782362ms" isStatefulPod=true podCreationTimestamp="2026-07-14 19:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:30.466145709 +0000 UTC m=+121.308517906" watchObservedRunningTime="2026-07-14 19:53:30.467195767 +0000 UTC m=+121.309567964"
Jul 14 19:53:30.488949 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:30.488909    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc" podStartSLOduration=4.774441522 podStartE2EDuration="13.488895256s" totalImagesPullingTime="8.714453734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:30.487451322 +0000 UTC m=+121.329823530" watchObservedRunningTime="2026-07-14 19:53:30.488895256 +0000 UTC m=+121.331267508"
Jul 14 19:53:31.265807 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:31.265775    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:53:31.409223 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:31.409183    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7968699c-x4t9x"]
Jul 14 19:53:31.457164 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:31.457127    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:32.403411 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:32.403384    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v2zxw"
Jul 14 19:53:34.471638 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:34.471606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerStarted","Data":"220cfaa0fd3aa50b163ead1ffaf7e9cb14333f2dbe182e63677a452cbc0aac5b"}
Jul 14 19:53:34.472023 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:34.471691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerStarted","Data":"5b155bbcdc97b1401918c7ef56b364d0a3b9da72d93af7c2004c11b05aa7a104"}
Jul 14 19:53:34.472023 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:34.471725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerStarted","Data":"f6fdd0ddb8a74d9c3a1b8e20f04e81ea5c572d67edd340191abe4f21dae34b99"}
Jul 14 19:53:34.472023 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:34.471750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerStarted","Data":"9cb6cf9ef03fc3e609817b100282c32e9e3ac2c929b9f36c2a2f9e55be22ddaa"}
Jul 14 19:53:35.480544 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:35.480503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerStarted","Data":"022e195f8fcd739c56d553a95f573f96875012234d3ab640c5a8c08e27873c1e"}
Jul 14 19:53:35.480914 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:35.480625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93cabaa0-103c-4830-96e9-80ce0526371b","Type":"ContainerStarted","Data":"4aeb3bfb7ad929fb28a5d8e380f9297780f316f364b2e9b119ab108c7cf07b06"}
Jul 14 19:53:35.512445 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:35.512360    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.460473456 podStartE2EDuration="14.512324955s" totalImagesPullingTime="11.017640781s" totalInitContainerRuntime="34.210718ms" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:35.510675675 +0000 UTC m=+126.353047894" watchObservedRunningTime="2026-07-14 19:53:35.512324955 +0000 UTC m=+126.354697153"
Jul 14 19:53:36.587539 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:36.587504    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:53:37.465495 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:37.465467    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cf586b875-98jkc"
Jul 14 19:53:39.576211 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:39.576173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:53:39.578556 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:39.578530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f91bbeb3-213c-4c73-b299-92b6bc40b606-metrics-certs\") pod \"network-metrics-daemon-9zzjl\" (UID: \"f91bbeb3-213c-4c73-b299-92b6bc40b606\") " pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:53:39.724541 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:39.724509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:39.724773 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:39.724593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:39.778597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:39.778560    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78ljl\""
Jul 14 19:53:39.786542 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:39.786523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zzjl"
Jul 14 19:53:39.950289 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:39.950262    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9zzjl"]
Jul 14 19:53:39.952639 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:53:39.952612    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91bbeb3_213c_4c73_b299_92b6bc40b606.slice/crio-4ec5a0883c7684080205caba946cb20b057c7ed0124e5d6ce6e466069a5323f6 WatchSource:0}: Error finding container 4ec5a0883c7684080205caba946cb20b057c7ed0124e5d6ce6e466069a5323f6: Status 404 returned error can't find the container with id 4ec5a0883c7684080205caba946cb20b057c7ed0124e5d6ce6e466069a5323f6
Jul 14 19:53:40.500603 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:40.500567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zzjl" event={"ID":"f91bbeb3-213c-4c73-b299-92b6bc40b606","Type":"ContainerStarted","Data":"4ec5a0883c7684080205caba946cb20b057c7ed0124e5d6ce6e466069a5323f6"}
Jul 14 19:53:42.515511 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:42.515472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zzjl" event={"ID":"f91bbeb3-213c-4c73-b299-92b6bc40b606","Type":"ContainerStarted","Data":"dc75f9b68a8d17ed88d9491f87dda8a8e9c5a30dc00cd8349e308574932886ee"}
Jul 14 19:53:42.515943 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:42.515550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zzjl" event={"ID":"f91bbeb3-213c-4c73-b299-92b6bc40b606","Type":"ContainerStarted","Data":"0e2ed071f87ea6eddadf9f63725c462f6a0fd7e8d21130fd4ce5ca05b5af7ffe"}
Jul 14 19:53:42.534122 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:42.534067    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9zzjl" podStartSLOduration=131.982142995 podStartE2EDuration="2m13.534051566s" totalImagesPullingTime="1.551908571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:42.532238169 +0000 UTC m=+133.374610380" watchObservedRunningTime="2026-07-14 19:53:42.534051566 +0000 UTC m=+133.376423763"
Jul 14 19:53:46.312752 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.312694    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4" podUID="25bcc9fc-0b70-4461-858b-be14584edd28" containerName="registry" containerID="cri-o://53d06fa558f8fb62009dbff8cf2dbec4ac1e88b012cd9782edafb6e4ec3303de" gracePeriod=30
Jul 14 19:53:46.402056 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.402015    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7855fbb878-7gxjw" podUID="c68c5d22-5544-47d9-a19c-c750775357b4" containerName="console" containerID="cri-o://4a3cec867f3b62ea400da219f56723c8b979117b7b37452bb086cd85af580059" gracePeriod=15
Jul 14 19:53:46.534316 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.534283    2576 generic.go:356] "Generic (PLEG): container finished" podID="c68c5d22-5544-47d9-a19c-c750775357b4" containerID="4a3cec867f3b62ea400da219f56723c8b979117b7b37452bb086cd85af580059" exitCode=0
Jul 14 19:53:46.534459 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.534369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7855fbb878-7gxjw" event={"ID":"c68c5d22-5544-47d9-a19c-c750775357b4","Type":"ContainerDied","Data":"4a3cec867f3b62ea400da219f56723c8b979117b7b37452bb086cd85af580059"}
Jul 14 19:53:46.536028 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.536006    2576 generic.go:356] "Generic (PLEG): container finished" podID="25bcc9fc-0b70-4461-858b-be14584edd28" containerID="53d06fa558f8fb62009dbff8cf2dbec4ac1e88b012cd9782edafb6e4ec3303de" exitCode=0
Jul 14 19:53:46.536127 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.536035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4" event={"ID":"25bcc9fc-0b70-4461-858b-be14584edd28","Type":"ContainerDied","Data":"53d06fa558f8fb62009dbff8cf2dbec4ac1e88b012cd9782edafb6e4ec3303de"}
Jul 14 19:53:46.594394 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.594368    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:53:46.681082 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.681053    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:46.741452 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741426    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrqjt\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-kube-api-access-zrqjt\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.741609 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcc9fc-0b70-4461-858b-be14584edd28-ca-trust-extracted\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.741609 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741510    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-installation-pull-secrets\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.741723 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741615    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-image-registry-private-configuration\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.741723 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-trusted-ca\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.741723 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741717    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-bound-sa-token\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.741877 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741752    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-registry-certificates\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.741877 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.741793    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") pod \"25bcc9fc-0b70-4461-858b-be14584edd28\" (UID: \"25bcc9fc-0b70-4461-858b-be14584edd28\") "
Jul 14 19:53:46.742391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.742284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:46.742567 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.742535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:46.743906 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.743875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:46.744005 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.743924    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-kube-api-access-zrqjt" (OuterVolumeSpecName: "kube-api-access-zrqjt") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "kube-api-access-zrqjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:46.744076 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.744021    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:46.744437 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.744415    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:46.744652 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.744631    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:46.749806 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.749786    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25bcc9fc-0b70-4461-858b-be14584edd28-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "25bcc9fc-0b70-4461-858b-be14584edd28" (UID: "25bcc9fc-0b70-4461-858b-be14584edd28"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:53:46.843158 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843099    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvhfd\" (UniqueName: \"kubernetes.io/projected/c68c5d22-5544-47d9-a19c-c750775357b4-kube-api-access-mvhfd\") pod \"c68c5d22-5544-47d9-a19c-c750775357b4\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") "
Jul 14 19:53:46.843158 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843140    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-serving-cert\") pod \"c68c5d22-5544-47d9-a19c-c750775357b4\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") "
Jul 14 19:53:46.843158 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843156    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-oauth-serving-cert\") pod \"c68c5d22-5544-47d9-a19c-c750775357b4\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") "
Jul 14 19:53:46.843404 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843193    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-trusted-ca-bundle\") pod \"c68c5d22-5544-47d9-a19c-c750775357b4\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") "
Jul 14 19:53:46.843404 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843306    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-console-config\") pod \"c68c5d22-5544-47d9-a19c-c750775357b4\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") "
Jul 14 19:53:46.843404 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843373    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-service-ca\") pod \"c68c5d22-5544-47d9-a19c-c750775357b4\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") "
Jul 14 19:53:46.843564 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843410    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-oauth-config\") pod \"c68c5d22-5544-47d9-a19c-c750775357b4\" (UID: \"c68c5d22-5544-47d9-a19c-c750775357b4\") "
Jul 14 19:53:46.843694 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843638    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c68c5d22-5544-47d9-a19c-c750775357b4" (UID: "c68c5d22-5544-47d9-a19c-c750775357b4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:46.843694 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843574    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c68c5d22-5544-47d9-a19c-c750775357b4" (UID: "c68c5d22-5544-47d9-a19c-c750775357b4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:46.843694 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843651    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-registry-tls\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.843694 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843678    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-console-config" (OuterVolumeSpecName: "console-config") pod "c68c5d22-5544-47d9-a19c-c750775357b4" (UID: "c68c5d22-5544-47d9-a19c-c750775357b4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:46.843694 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843690    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrqjt\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-kube-api-access-zrqjt\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.843954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843708    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcc9fc-0b70-4461-858b-be14584edd28-ca-trust-extracted\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.843954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843716    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-service-ca" (OuterVolumeSpecName: "service-ca") pod "c68c5d22-5544-47d9-a19c-c750775357b4" (UID: "c68c5d22-5544-47d9-a19c-c750775357b4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:46.843954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843725    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-installation-pull-secrets\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.843954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843739    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcc9fc-0b70-4461-858b-be14584edd28-image-registry-private-configuration\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.843954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843756    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-trusted-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.843954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843765    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcc9fc-0b70-4461-858b-be14584edd28-bound-sa-token\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.843954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.843775    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcc9fc-0b70-4461-858b-be14584edd28-registry-certificates\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.845162 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.845139    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c68c5d22-5544-47d9-a19c-c750775357b4" (UID: "c68c5d22-5544-47d9-a19c-c750775357b4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:46.845243 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.845229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c68c5d22-5544-47d9-a19c-c750775357b4-kube-api-access-mvhfd" (OuterVolumeSpecName: "kube-api-access-mvhfd") pod "c68c5d22-5544-47d9-a19c-c750775357b4" (UID: "c68c5d22-5544-47d9-a19c-c750775357b4"). InnerVolumeSpecName "kube-api-access-mvhfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:46.845311 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.845288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c68c5d22-5544-47d9-a19c-c750775357b4" (UID: "c68c5d22-5544-47d9-a19c-c750775357b4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:46.944307 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.944275    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-serving-cert\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.944307 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.944301    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-oauth-serving-cert\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.944307 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.944310    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-trusted-ca-bundle\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.944563 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.944318    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-console-config\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.944563 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.944331    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c68c5d22-5544-47d9-a19c-c750775357b4-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.944563 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.944362    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c68c5d22-5544-47d9-a19c-c750775357b4-console-oauth-config\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:46.944563 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:46.944372    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvhfd\" (UniqueName: \"kubernetes.io/projected/c68c5d22-5544-47d9-a19c-c750775357b4-kube-api-access-mvhfd\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:47.543369 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.543314    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"
Jul 14 19:53:47.543819 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.543318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dd6bb5bc-6jhs4" event={"ID":"25bcc9fc-0b70-4461-858b-be14584edd28","Type":"ContainerDied","Data":"000fdfd700e8b4a8c15910c50c2e030025b71659d0b91ff976973cd9705c408d"}
Jul 14 19:53:47.543819 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.543465    2576 scope.go:117] "RemoveContainer" containerID="53d06fa558f8fb62009dbff8cf2dbec4ac1e88b012cd9782edafb6e4ec3303de"
Jul 14 19:53:47.545427 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.545028    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7855fbb878-7gxjw"
Jul 14 19:53:47.545427 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.545026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7855fbb878-7gxjw" event={"ID":"c68c5d22-5544-47d9-a19c-c750775357b4","Type":"ContainerDied","Data":"f0d557a35dd27f44910b9b2c690305ad183a5a3ee95554ac4ee6e40ac9d98dde"}
Jul 14 19:53:47.558302 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.557927    2576 scope.go:117] "RemoveContainer" containerID="4a3cec867f3b62ea400da219f56723c8b979117b7b37452bb086cd85af580059"
Jul 14 19:53:47.581828 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.581804    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7855fbb878-7gxjw"]
Jul 14 19:53:47.588407 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.588383    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7855fbb878-7gxjw"]
Jul 14 19:53:47.600306 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.600281    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"]
Jul 14 19:53:47.604880 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.604860    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76dd6bb5bc-6jhs4"]
Jul 14 19:53:47.855826 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.855792    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25bcc9fc-0b70-4461-858b-be14584edd28" path="/var/lib/kubelet/pods/25bcc9fc-0b70-4461-858b-be14584edd28/volumes"
Jul 14 19:53:47.856162 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:47.856149    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c68c5d22-5544-47d9-a19c-c750775357b4" path="/var/lib/kubelet/pods/c68c5d22-5544-47d9-a19c-c750775357b4/volumes"
Jul 14 19:53:49.556551 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:49.556471    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca098121-4efe-46e0-a524-4be7b1de1f1d" containerID="2bdc3851967b64cef3fe77e086468826ed177fd9da9af736715868d7c65e8229" exitCode=0
Jul 14 19:53:49.556551 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:49.556526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-62jx7" event={"ID":"ca098121-4efe-46e0-a524-4be7b1de1f1d","Type":"ContainerDied","Data":"2bdc3851967b64cef3fe77e086468826ed177fd9da9af736715868d7c65e8229"}
Jul 14 19:53:49.556919 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:49.556828    2576 scope.go:117] "RemoveContainer" containerID="2bdc3851967b64cef3fe77e086468826ed177fd9da9af736715868d7c65e8229"
Jul 14 19:53:50.523700 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:50.523668    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rzzt4_5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e/serve-healthcheck-canary/0.log"
Jul 14 19:53:50.562238 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:50.562203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-62jx7" event={"ID":"ca098121-4efe-46e0-a524-4be7b1de1f1d","Type":"ContainerStarted","Data":"b7333bf9a5126057415f54c3ac48be860aeca17fd560b3907048c6c712b83a6a"}
Jul 14 19:53:56.435326 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.435265    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f7968699c-x4t9x" podUID="b2f2a2eb-4217-42d9-9c57-b5886f1edf15" containerName="console" containerID="cri-o://7652a3bc52d19db89cbb115556178c4d4ad4ed6f67a667635e130174a6fc7268" gracePeriod=15
Jul 14 19:53:56.587304 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.587275    2576 generic.go:356] "Generic (PLEG): container finished" podID="b2f2a2eb-4217-42d9-9c57-b5886f1edf15" containerID="7652a3bc52d19db89cbb115556178c4d4ad4ed6f67a667635e130174a6fc7268" exitCode=0
Jul 14 19:53:56.587443 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.587358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7968699c-x4t9x" event={"ID":"b2f2a2eb-4217-42d9-9c57-b5886f1edf15","Type":"ContainerDied","Data":"7652a3bc52d19db89cbb115556178c4d4ad4ed6f67a667635e130174a6fc7268"}
Jul 14 19:53:56.713324 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.713289    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:56.726841 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.726818    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-serving-cert\") pod \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") "
Jul 14 19:53:56.726981 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.726856    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-service-ca\") pod \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") "
Jul 14 19:53:56.726981 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.726881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-config\") pod \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") "
Jul 14 19:53:56.726981 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.726898    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-oauth-serving-cert\") pod \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") "
Jul 14 19:53:56.726981 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.726948    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-oauth-config\") pod \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") "
Jul 14 19:53:56.726981 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.726972    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2778\" (UniqueName: \"kubernetes.io/projected/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-kube-api-access-l2778\") pod \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\" (UID: \"b2f2a2eb-4217-42d9-9c57-b5886f1edf15\") "
Jul 14 19:53:56.727308 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.727253    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2f2a2eb-4217-42d9-9c57-b5886f1edf15" (UID: "b2f2a2eb-4217-42d9-9c57-b5886f1edf15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:56.727308 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.727270    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-config" (OuterVolumeSpecName: "console-config") pod "b2f2a2eb-4217-42d9-9c57-b5886f1edf15" (UID: "b2f2a2eb-4217-42d9-9c57-b5886f1edf15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:56.727425 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.727377    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2f2a2eb-4217-42d9-9c57-b5886f1edf15" (UID: "b2f2a2eb-4217-42d9-9c57-b5886f1edf15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:56.728976 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.728953    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2f2a2eb-4217-42d9-9c57-b5886f1edf15" (UID: "b2f2a2eb-4217-42d9-9c57-b5886f1edf15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:56.729080 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.728995    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2f2a2eb-4217-42d9-9c57-b5886f1edf15" (UID: "b2f2a2eb-4217-42d9-9c57-b5886f1edf15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:56.729080 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.729035    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-kube-api-access-l2778" (OuterVolumeSpecName: "kube-api-access-l2778") pod "b2f2a2eb-4217-42d9-9c57-b5886f1edf15" (UID: "b2f2a2eb-4217-42d9-9c57-b5886f1edf15"). InnerVolumeSpecName "kube-api-access-l2778". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:56.827519 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.827488    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2778\" (UniqueName: \"kubernetes.io/projected/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-kube-api-access-l2778\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:56.827519 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.827513    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-serving-cert\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:56.827519 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.827524    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:56.827710 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.827533    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-config\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:56.827710 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.827541    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-oauth-serving-cert\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:56.827710 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:56.827549    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a2eb-4217-42d9-9c57-b5886f1edf15-console-oauth-config\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:53:57.592829 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:57.592792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7968699c-x4t9x" event={"ID":"b2f2a2eb-4217-42d9-9c57-b5886f1edf15","Type":"ContainerDied","Data":"ab5f61e9f77dd52f51303f73618047ef379d1f40eb9fdf9bba5a39bc8a6ebbca"}
Jul 14 19:53:57.592829 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:57.592828    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7968699c-x4t9x"
Jul 14 19:53:57.593333 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:57.592887    2576 scope.go:117] "RemoveContainer" containerID="7652a3bc52d19db89cbb115556178c4d4ad4ed6f67a667635e130174a6fc7268"
Jul 14 19:53:57.613969 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:57.613936    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7968699c-x4t9x"]
Jul 14 19:53:57.619612 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:57.619583    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f7968699c-x4t9x"]
Jul 14 19:53:57.854986 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:57.854913    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f2a2eb-4217-42d9-9c57-b5886f1edf15" path="/var/lib/kubelet/pods/b2f2a2eb-4217-42d9-9c57-b5886f1edf15/volumes"
Jul 14 19:53:59.729880 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:59.729851    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:53:59.734214 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:53:59.734189    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d9d4bc989-8kkbw"
Jul 14 19:54:21.587261 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:54:21.587218    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:54:21.606829 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:54:21.606799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:54:21.705944 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:54:21.705917    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:56:18.070005 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.069920    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nj2ln"]
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070310    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25bcc9fc-0b70-4461-858b-be14584edd28" containerName="registry"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070330    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="25bcc9fc-0b70-4461-858b-be14584edd28" containerName="registry"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070366    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f2a2eb-4217-42d9-9c57-b5886f1edf15" containerName="console"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070375    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f2a2eb-4217-42d9-9c57-b5886f1edf15" containerName="console"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070390    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c68c5d22-5544-47d9-a19c-c750775357b4" containerName="console"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070398    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c68c5d22-5544-47d9-a19c-c750775357b4" containerName="console"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070495    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c68c5d22-5544-47d9-a19c-c750775357b4" containerName="console"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070508    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f2a2eb-4217-42d9-9c57-b5886f1edf15" containerName="console"
Jul 14 19:56:18.070516 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.070517    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="25bcc9fc-0b70-4461-858b-be14584edd28" containerName="registry"
Jul 14 19:56:18.072403 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.072387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.075741 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.075721    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 19:56:18.075859 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.075776    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 19:56:18.085302 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.085272    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nj2ln"]
Jul 14 19:56:18.120830 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.120806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nj2ln\" (UID: \"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.120954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.120853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqmx4\" (UniqueName: \"kubernetes.io/projected/fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8-kube-api-access-qqmx4\") pod \"cert-manager-webhook-6486ffd997-nj2ln\" (UID: \"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.221861 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.221830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqmx4\" (UniqueName: \"kubernetes.io/projected/fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8-kube-api-access-qqmx4\") pod \"cert-manager-webhook-6486ffd997-nj2ln\" (UID: \"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.221995 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.221903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nj2ln\" (UID: \"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.234509 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.234480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nj2ln\" (UID: \"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.234896 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.234878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqmx4\" (UniqueName: \"kubernetes.io/projected/fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8-kube-api-access-qqmx4\") pod \"cert-manager-webhook-6486ffd997-nj2ln\" (UID: \"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.400093 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.400007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:18.531661 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:18.531598    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nj2ln"]
Jul 14 19:56:18.534404 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:56:18.534376    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe5e861b_2ea0_421d_ae0f_3bd4a226d1e8.slice/crio-5b7a6c1ef5ec2ec682f1295cbec3bed796b686a1584bc7bb593ab58f67977f9c WatchSource:0}: Error finding container 5b7a6c1ef5ec2ec682f1295cbec3bed796b686a1584bc7bb593ab58f67977f9c: Status 404 returned error can't find the container with id 5b7a6c1ef5ec2ec682f1295cbec3bed796b686a1584bc7bb593ab58f67977f9c
Jul 14 19:56:19.121850 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:19.121813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln" event={"ID":"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8","Type":"ContainerStarted","Data":"5b7a6c1ef5ec2ec682f1295cbec3bed796b686a1584bc7bb593ab58f67977f9c"}
Jul 14 19:56:22.136906 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:22.136865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln" event={"ID":"fe5e861b-2ea0-421d-ae0f-3bd4a226d1e8","Type":"ContainerStarted","Data":"f4efb378223077b83739d5b57b4f7d61b86f3470266ae4f77ce0381bfb6cb2c2"}
Jul 14 19:56:22.137289 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:22.137004    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:22.155030 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:22.154984    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln" podStartSLOduration=1.150300363 podStartE2EDuration="4.154970923s" totalImagesPullingTime="3.00467056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:56:22.153865169 +0000 UTC m=+292.996237392" watchObservedRunningTime="2026-07-14 19:56:22.154970923 +0000 UTC m=+292.997343120"
Jul 14 19:56:28.143000 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:28.142964    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nj2ln"
Jul 14 19:56:29.581379 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:29.581353    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 19:56:29.584909 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:29.584884    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 19:56:29.584909 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:29.584898    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 19:56:29.588389 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:29.588366    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 19:56:29.593390 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:29.593369    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 19:56:36.417210 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.417173    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"]
Jul 14 19:56:36.423221 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.423204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.425886 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.425862    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 19:56:36.426000 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.425860    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:56:36.426000 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.425918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9vc8g\""
Jul 14 19:56:36.429446 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.429424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"]
Jul 14 19:56:36.470064 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.470028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mc86\" (UniqueName: \"kubernetes.io/projected/274eeaac-84ec-4826-abf7-c21743c780dc-kube-api-access-9mc86\") pod \"openshift-lws-operator-fd8ccff4c-df9fq\" (UID: \"274eeaac-84ec-4826-abf7-c21743c780dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.470198 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.470178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/274eeaac-84ec-4826-abf7-c21743c780dc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-df9fq\" (UID: \"274eeaac-84ec-4826-abf7-c21743c780dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.570997 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.570956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/274eeaac-84ec-4826-abf7-c21743c780dc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-df9fq\" (UID: \"274eeaac-84ec-4826-abf7-c21743c780dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.571180 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.571014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mc86\" (UniqueName: \"kubernetes.io/projected/274eeaac-84ec-4826-abf7-c21743c780dc-kube-api-access-9mc86\") pod \"openshift-lws-operator-fd8ccff4c-df9fq\" (UID: \"274eeaac-84ec-4826-abf7-c21743c780dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.571451 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.571428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/274eeaac-84ec-4826-abf7-c21743c780dc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-df9fq\" (UID: \"274eeaac-84ec-4826-abf7-c21743c780dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.581702 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.581677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mc86\" (UniqueName: \"kubernetes.io/projected/274eeaac-84ec-4826-abf7-c21743c780dc-kube-api-access-9mc86\") pod \"openshift-lws-operator-fd8ccff4c-df9fq\" (UID: \"274eeaac-84ec-4826-abf7-c21743c780dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.733181 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.733146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"
Jul 14 19:56:36.878597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.878565    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq"]
Jul 14 19:56:36.882139 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:56:36.882100    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod274eeaac_84ec_4826_abf7_c21743c780dc.slice/crio-af471d4f51ffa3d431b9f0ec9a13c7a8eb5f70d99822c252528559b53fb6b77f WatchSource:0}: Error finding container af471d4f51ffa3d431b9f0ec9a13c7a8eb5f70d99822c252528559b53fb6b77f: Status 404 returned error can't find the container with id af471d4f51ffa3d431b9f0ec9a13c7a8eb5f70d99822c252528559b53fb6b77f
Jul 14 19:56:36.883811 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:36.883791    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:56:37.198065 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:37.198030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq" event={"ID":"274eeaac-84ec-4826-abf7-c21743c780dc","Type":"ContainerStarted","Data":"af471d4f51ffa3d431b9f0ec9a13c7a8eb5f70d99822c252528559b53fb6b77f"}
Jul 14 19:56:40.212240 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:40.212206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq" event={"ID":"274eeaac-84ec-4826-abf7-c21743c780dc","Type":"ContainerStarted","Data":"b1035cd9fee46e82984986391d31325ac5557483df567540a09ca50afca0d32b"}
Jul 14 19:56:40.228955 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:40.228886    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-df9fq" podStartSLOduration=1.292121634 podStartE2EDuration="4.228868011s" totalImagesPullingTime="2.936746377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:56:40.227164834 +0000 UTC m=+311.069537030" watchObservedRunningTime="2026-07-14 19:56:40.228868011 +0000 UTC m=+311.071240209"
Jul 14 19:56:56.821333 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.821289    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"]
Jul 14 19:56:56.823760 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.823740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:56.826383 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.826360    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 19:56:56.826487 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.826387    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 19:56:56.832397 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.832379    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 19:56:56.832508 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.832490    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6vqlw\""
Jul 14 19:56:56.832938 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.832924    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 19:56:56.854740 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.854716    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"]
Jul 14 19:56:56.944108 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.944072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cpcq\" (UniqueName: \"kubernetes.io/projected/227d786e-94c4-481b-980e-b518e1c55d2c-kube-api-access-6cpcq\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:56.944108 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.944112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/227d786e-94c4-481b-980e-b518e1c55d2c-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:56.944305 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.944131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/227d786e-94c4-481b-980e-b518e1c55d2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:56.944305 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.944262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/227d786e-94c4-481b-980e-b518e1c55d2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:56.944398 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:56.944310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/227d786e-94c4-481b-980e-b518e1c55d2c-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.045535 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.045494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/227d786e-94c4-481b-980e-b518e1c55d2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.045674 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.045557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/227d786e-94c4-481b-980e-b518e1c55d2c-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.045674 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.045608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cpcq\" (UniqueName: \"kubernetes.io/projected/227d786e-94c4-481b-980e-b518e1c55d2c-kube-api-access-6cpcq\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.045674 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.045643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/227d786e-94c4-481b-980e-b518e1c55d2c-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.045674 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.045668    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/227d786e-94c4-481b-980e-b518e1c55d2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.046144 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.046095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/227d786e-94c4-481b-980e-b518e1c55d2c-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.047944 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.047920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/227d786e-94c4-481b-980e-b518e1c55d2c-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.048065 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.048046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/227d786e-94c4-481b-980e-b518e1c55d2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.048150 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.048133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/227d786e-94c4-481b-980e-b518e1c55d2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.054629 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.054599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cpcq\" (UniqueName: \"kubernetes.io/projected/227d786e-94c4-481b-980e-b518e1c55d2c-kube-api-access-6cpcq\") pod \"opendatahub-operator-controller-manager-786799b55c-r4922\" (UID: \"227d786e-94c4-481b-980e-b518e1c55d2c\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.134968 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.134895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:56:57.285091 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:57.285056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"]
Jul 14 19:56:57.288707 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:56:57.288680    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227d786e_94c4_481b_980e_b518e1c55d2c.slice/crio-c9587f048a931d94820e9246047dd135fbb9a616a7810de86a1b38e5d446e2f7 WatchSource:0}: Error finding container c9587f048a931d94820e9246047dd135fbb9a616a7810de86a1b38e5d446e2f7: Status 404 returned error can't find the container with id c9587f048a931d94820e9246047dd135fbb9a616a7810de86a1b38e5d446e2f7
Jul 14 19:56:58.284227 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:56:58.284190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922" event={"ID":"227d786e-94c4-481b-980e-b518e1c55d2c","Type":"ContainerStarted","Data":"c9587f048a931d94820e9246047dd135fbb9a616a7810de86a1b38e5d446e2f7"}
Jul 14 19:57:00.294019 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:00.293986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922" event={"ID":"227d786e-94c4-481b-980e-b518e1c55d2c","Type":"ContainerStarted","Data":"2cb3de8213823e5c6109934d26fb0eff38a286e89ceacb1fbe048c46baab7b98"}
Jul 14 19:57:02.302947 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:02.302910    2576 generic.go:356] "Generic (PLEG): container finished" podID="227d786e-94c4-481b-980e-b518e1c55d2c" containerID="2cb3de8213823e5c6109934d26fb0eff38a286e89ceacb1fbe048c46baab7b98" exitCode=0
Jul 14 19:57:02.303377 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:02.302981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922" event={"ID":"227d786e-94c4-481b-980e-b518e1c55d2c","Type":"ContainerDied","Data":"2cb3de8213823e5c6109934d26fb0eff38a286e89ceacb1fbe048c46baab7b98"}
Jul 14 19:57:03.309543 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:03.309510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922" event={"ID":"227d786e-94c4-481b-980e-b518e1c55d2c","Type":"ContainerStarted","Data":"468998f4541938ca77f4e2bf858a31afb5ee65ada1547096692a5bfa93ee3a0b"}
Jul 14 19:57:03.309914 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:03.309747    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:57:03.336684 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:03.336639    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922" podStartSLOduration=3.028087742 podStartE2EDuration="7.336624295s" totalImagesPullingTime="3.233708495s" totalInitContainerRuntime="1.074828058s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:03.334449228 +0000 UTC m=+334.176821452" watchObservedRunningTime="2026-07-14 19:57:03.336624295 +0000 UTC m=+334.178996491"
Jul 14 19:57:14.316652 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:14.316623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-r4922"
Jul 14 19:57:16.971897 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:16.971864    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"]
Jul 14 19:57:16.979498 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:16.979472    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:16.983951 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:16.983929    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 19:57:16.984092 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:16.983995    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 19:57:16.985311 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:16.985295    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 19:57:16.985414 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:16.985369    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 19:57:17.004117 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.004094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"]
Jul 14 19:57:17.004381 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.004362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da15a176-2566-49df-b22e-316cb1ddf585-tmp\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.004434 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.004412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxj6\" (UniqueName: \"kubernetes.io/projected/da15a176-2566-49df-b22e-316cb1ddf585-kube-api-access-4hxj6\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.004521 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.004505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da15a176-2566-49df-b22e-316cb1ddf585-tls-certs\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.105627 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.105590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxj6\" (UniqueName: \"kubernetes.io/projected/da15a176-2566-49df-b22e-316cb1ddf585-kube-api-access-4hxj6\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.105784 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.105696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da15a176-2566-49df-b22e-316cb1ddf585-tls-certs\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.105784 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.105746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da15a176-2566-49df-b22e-316cb1ddf585-tmp\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.108046 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.108016    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da15a176-2566-49df-b22e-316cb1ddf585-tmp\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.108273 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.108255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da15a176-2566-49df-b22e-316cb1ddf585-tls-certs\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.121051 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.121023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxj6\" (UniqueName: \"kubernetes.io/projected/da15a176-2566-49df-b22e-316cb1ddf585-kube-api-access-4hxj6\") pod \"kube-auth-proxy-59df779c5f-dlp8r\" (UID: \"da15a176-2566-49df-b22e-316cb1ddf585\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.288399 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.288290    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"
Jul 14 19:57:17.290719 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.290689    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nkpkv"]
Jul 14 19:57:17.293133 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.293107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.305459 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.305430    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 14 19:57:17.305569 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.305520    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-g9fvq\""
Jul 14 19:57:17.307161 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.307138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e83348f-ec90-4853-818f-d5aac5f5e3f4-cert\") pod \"odh-model-controller-7998c67dc4-nkpkv\" (UID: \"6e83348f-ec90-4853-818f-d5aac5f5e3f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.307244 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.307180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x6hv\" (UniqueName: \"kubernetes.io/projected/6e83348f-ec90-4853-818f-d5aac5f5e3f4-kube-api-access-5x6hv\") pod \"odh-model-controller-7998c67dc4-nkpkv\" (UID: \"6e83348f-ec90-4853-818f-d5aac5f5e3f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.407696 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.407661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e83348f-ec90-4853-818f-d5aac5f5e3f4-cert\") pod \"odh-model-controller-7998c67dc4-nkpkv\" (UID: \"6e83348f-ec90-4853-818f-d5aac5f5e3f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.407696 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.407700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x6hv\" (UniqueName: \"kubernetes.io/projected/6e83348f-ec90-4853-818f-d5aac5f5e3f4-kube-api-access-5x6hv\") pod \"odh-model-controller-7998c67dc4-nkpkv\" (UID: \"6e83348f-ec90-4853-818f-d5aac5f5e3f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.407931 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:57:17.407799    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 14 19:57:17.407931 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:57:17.407872    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e83348f-ec90-4853-818f-d5aac5f5e3f4-cert podName:6e83348f-ec90-4853-818f-d5aac5f5e3f4 nodeName:}" failed. No retries permitted until 2026-07-14 19:57:17.907854929 +0000 UTC m=+348.750227105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6e83348f-ec90-4853-818f-d5aac5f5e3f4-cert") pod "odh-model-controller-7998c67dc4-nkpkv" (UID: "6e83348f-ec90-4853-818f-d5aac5f5e3f4") : secret "odh-model-controller-webhook-cert" not found
Jul 14 19:57:17.416320 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.416290    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nkpkv"]
Jul 14 19:57:17.445278 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.445235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x6hv\" (UniqueName: \"kubernetes.io/projected/6e83348f-ec90-4853-818f-d5aac5f5e3f4-kube-api-access-5x6hv\") pod \"odh-model-controller-7998c67dc4-nkpkv\" (UID: \"6e83348f-ec90-4853-818f-d5aac5f5e3f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.485219 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.485195    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r"]
Jul 14 19:57:17.487832 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:57:17.487802    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda15a176_2566_49df_b22e_316cb1ddf585.slice/crio-203f4faf8a658b5ee51c96ffaae6b08b27d1d49412b5799f054068f965343450 WatchSource:0}: Error finding container 203f4faf8a658b5ee51c96ffaae6b08b27d1d49412b5799f054068f965343450: Status 404 returned error can't find the container with id 203f4faf8a658b5ee51c96ffaae6b08b27d1d49412b5799f054068f965343450
Jul 14 19:57:17.911628 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.911592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e83348f-ec90-4853-818f-d5aac5f5e3f4-cert\") pod \"odh-model-controller-7998c67dc4-nkpkv\" (UID: \"6e83348f-ec90-4853-818f-d5aac5f5e3f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.914054 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.914036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e83348f-ec90-4853-818f-d5aac5f5e3f4-cert\") pod \"odh-model-controller-7998c67dc4-nkpkv\" (UID: \"6e83348f-ec90-4853-818f-d5aac5f5e3f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:17.918909 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:17.918894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:18.069229 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.069201    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nkpkv"]
Jul 14 19:57:18.070555 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:57:18.070529    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e83348f_ec90_4853_818f_d5aac5f5e3f4.slice/crio-0eed32ef1b0076f1d3d5bc423d0b776532e3864f5723114c300e62c166eb6c86 WatchSource:0}: Error finding container 0eed32ef1b0076f1d3d5bc423d0b776532e3864f5723114c300e62c166eb6c86: Status 404 returned error can't find the container with id 0eed32ef1b0076f1d3d5bc423d0b776532e3864f5723114c300e62c166eb6c86
Jul 14 19:57:18.375071 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.375033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv" event={"ID":"6e83348f-ec90-4853-818f-d5aac5f5e3f4","Type":"ContainerStarted","Data":"0eed32ef1b0076f1d3d5bc423d0b776532e3864f5723114c300e62c166eb6c86"}
Jul 14 19:57:18.376293 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.376261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r" event={"ID":"da15a176-2566-49df-b22e-316cb1ddf585","Type":"ContainerStarted","Data":"203f4faf8a658b5ee51c96ffaae6b08b27d1d49412b5799f054068f965343450"}
Jul 14 19:57:18.406687 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.406656    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tz6mx"]
Jul 14 19:57:18.408879 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.408863    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:18.411263 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.411244    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 14 19:57:18.424035 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.424009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tz6mx"]
Jul 14 19:57:18.518441 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.518404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bea68f-6400-456f-adfe-be7848d0dc4a-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz6mx\" (UID: \"68bea68f-6400-456f-adfe-be7848d0dc4a\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:18.518609 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.518474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w76h2\" (UniqueName: \"kubernetes.io/projected/68bea68f-6400-456f-adfe-be7848d0dc4a-kube-api-access-w76h2\") pod \"model-serving-api-54d89bd5fc-tz6mx\" (UID: \"68bea68f-6400-456f-adfe-be7848d0dc4a\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:18.610572 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.610541    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"]
Jul 14 19:57:18.612954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.612936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.615914 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.615891    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 19:57:18.616070 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.616056    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 19:57:18.616315 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.616293    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 19:57:18.616414 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.616331    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 19:57:18.616414 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.616368    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vchq6\""
Jul 14 19:57:18.618974 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.618954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bea68f-6400-456f-adfe-be7848d0dc4a-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz6mx\" (UID: \"68bea68f-6400-456f-adfe-be7848d0dc4a\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:18.619076 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.618996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76h2\" (UniqueName: \"kubernetes.io/projected/68bea68f-6400-456f-adfe-be7848d0dc4a-kube-api-access-w76h2\") pod \"model-serving-api-54d89bd5fc-tz6mx\" (UID: \"68bea68f-6400-456f-adfe-be7848d0dc4a\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:18.619138 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:57:18.619108    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 14 19:57:18.619286 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:57:18.619168    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bea68f-6400-456f-adfe-be7848d0dc4a-tls-certs podName:68bea68f-6400-456f-adfe-be7848d0dc4a nodeName:}" failed. No retries permitted until 2026-07-14 19:57:19.119148927 +0000 UTC m=+349.961521108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/68bea68f-6400-456f-adfe-be7848d0dc4a-tls-certs") pod "model-serving-api-54d89bd5fc-tz6mx" (UID: "68bea68f-6400-456f-adfe-be7848d0dc4a") : secret "model-serving-api-tls" not found
Jul 14 19:57:18.649302 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.649223    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"]
Jul 14 19:57:18.651508 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.651477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76h2\" (UniqueName: \"kubernetes.io/projected/68bea68f-6400-456f-adfe-be7848d0dc4a-kube-api-access-w76h2\") pod \"model-serving-api-54d89bd5fc-tz6mx\" (UID: \"68bea68f-6400-456f-adfe-be7848d0dc4a\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:18.719813 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.719765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf6bk\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-kube-api-access-cf6bk\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.720004 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.719866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.720004 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.719899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.720004 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.719934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-token\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.720168 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.720000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.720168 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.720054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f812c6-83cf-4e87-98f8-40845bf06b2b-local-certs\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.720168 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.720091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-cacerts\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.822502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.821656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf6bk\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-kube-api-access-cf6bk\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.822502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.821767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.822502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.821806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.822502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.821841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-token\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.822502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.821879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.822502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.821908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f812c6-83cf-4e87-98f8-40845bf06b2b-local-certs\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.822502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.821945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-cacerts\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.823036 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.822699    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.826597 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.826566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f812c6-83cf-4e87-98f8-40845bf06b2b-local-certs\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.827078 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.827038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.829823 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.829741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.830307 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.830246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-cacerts\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.832208 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.832165    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf6bk\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-kube-api-access-cf6bk\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.832467 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.832443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-token\") pod \"istiod-openshift-gateway-7574459656-vpz2k\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:18.922680 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:18.922540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:19.109027 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:19.105707    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"]
Jul 14 19:57:19.125511 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:19.125484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bea68f-6400-456f-adfe-be7848d0dc4a-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz6mx\" (UID: \"68bea68f-6400-456f-adfe-be7848d0dc4a\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:19.128676 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:19.128626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68bea68f-6400-456f-adfe-be7848d0dc4a-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz6mx\" (UID: \"68bea68f-6400-456f-adfe-be7848d0dc4a\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:19.319022 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:19.318987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:19.386032 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:19.385543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k" event={"ID":"90f812c6-83cf-4e87-98f8-40845bf06b2b","Type":"ContainerStarted","Data":"03367b4895ccafb8404544e78e5e5b5b005dd98722509ffbf7ba44b926f5449b"}
Jul 14 19:57:19.516180 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:19.516104    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tz6mx"]
Jul 14 19:57:19.519226 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:57:19.519193    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bea68f_6400_456f_adfe_be7848d0dc4a.slice/crio-4bc04cddc7d06ed1bf92d22c20e63ae71aca891aaa12e67e1a638534f4a753da WatchSource:0}: Error finding container 4bc04cddc7d06ed1bf92d22c20e63ae71aca891aaa12e67e1a638534f4a753da: Status 404 returned error can't find the container with id 4bc04cddc7d06ed1bf92d22c20e63ae71aca891aaa12e67e1a638534f4a753da
Jul 14 19:57:20.393379 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:20.393321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx" event={"ID":"68bea68f-6400-456f-adfe-be7848d0dc4a","Type":"ContainerStarted","Data":"4bc04cddc7d06ed1bf92d22c20e63ae71aca891aaa12e67e1a638534f4a753da"}
Jul 14 19:57:23.715854 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:23.715798    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 14 19:57:23.716215 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:23.715897    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 14 19:57:24.417672 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.416849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r" event={"ID":"da15a176-2566-49df-b22e-316cb1ddf585","Type":"ContainerStarted","Data":"b7e10a06fec988f922330c73ff156396b6b0177c4ccb2ae1f6dc883217e2fa12"}
Jul 14 19:57:24.419889 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.419857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx" event={"ID":"68bea68f-6400-456f-adfe-be7848d0dc4a","Type":"ContainerStarted","Data":"5aa23e02fe8ca81c7e1a25f07bb79bd365b417d8f38b2aa974adf2b16e2bcaea"}
Jul 14 19:57:24.420300 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.420157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:24.422472 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.422133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv" event={"ID":"6e83348f-ec90-4853-818f-d5aac5f5e3f4","Type":"ContainerStarted","Data":"e2cf544a8fa778e864488c3331e329d0b3b7a6d827f733c832a5a53332c8e127"}
Jul 14 19:57:24.422472 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.422189    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:24.424274 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.424247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k" event={"ID":"90f812c6-83cf-4e87-98f8-40845bf06b2b","Type":"ContainerStarted","Data":"c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b"}
Jul 14 19:57:24.424751 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.424727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:24.426438 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.426409    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vpz2k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 19:57:24.426545 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.426471    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k" podUID="90f812c6-83cf-4e87-98f8-40845bf06b2b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 19:57:24.457852 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.457797    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59df779c5f-dlp8r" podStartSLOduration=2.234302717 podStartE2EDuration="8.457776891s" totalImagesPullingTime="6.223474174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:24.455444294 +0000 UTC m=+355.297816504" watchObservedRunningTime="2026-07-14 19:57:24.457776891 +0000 UTC m=+355.300149090"
Jul 14 19:57:24.481065 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.481006    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv" podStartSLOduration=1.84676894 podStartE2EDuration="7.480927771s" totalImagesPullingTime="5.634158831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:24.479436583 +0000 UTC m=+355.321808797" watchObservedRunningTime="2026-07-14 19:57:24.480927771 +0000 UTC m=+355.323299972"
Jul 14 19:57:24.514141 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.514081    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k" podStartSLOduration=1.909803083 podStartE2EDuration="6.514065699s" totalImagesPullingTime="4.604262616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:24.510811313 +0000 UTC m=+355.353183510" watchObservedRunningTime="2026-07-14 19:57:24.514065699 +0000 UTC m=+355.356437895"
Jul 14 19:57:24.552288 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:24.552230    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx" podStartSLOduration=2.357366291 podStartE2EDuration="6.552212954s" totalImagesPullingTime="4.194846663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:24.551627177 +0000 UTC m=+355.393999387" watchObservedRunningTime="2026-07-14 19:57:24.552212954 +0000 UTC m=+355.394585152"
Jul 14 19:57:25.430627 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:25.430596    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:29.298509 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.298476    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"]
Jul 14 19:57:29.301932 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.301910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.307124 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.307100    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 19:57:29.307258 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.307208    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rl4fk\""
Jul 14 19:57:29.308859 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.308834    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"]
Jul 14 19:57:29.311236 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.311217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:29.313596 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.313576    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 19:57:29.313717 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.313701    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zxnnw\""
Jul 14 19:57:29.325271 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.325210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"]
Jul 14 19:57:29.326989 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.326968    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"]
Jul 14 19:57:29.425209 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.425173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvzjq\" (UID: \"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:29.425402 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.425223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43a764fb-7684-4078-a6fd-b6007174a14a-cert\") pod \"kserve-controller-manager-d6f4b65b8-gtw96\" (UID: \"43a764fb-7684-4078-a6fd-b6007174a14a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.425402 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.425279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbngg\" (UniqueName: \"kubernetes.io/projected/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-kube-api-access-dbngg\") pod \"llmisvc-controller-manager-777c6bd7d5-vvzjq\" (UID: \"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:29.425402 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.425355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tg9n\" (UniqueName: \"kubernetes.io/projected/43a764fb-7684-4078-a6fd-b6007174a14a-kube-api-access-6tg9n\") pod \"kserve-controller-manager-d6f4b65b8-gtw96\" (UID: \"43a764fb-7684-4078-a6fd-b6007174a14a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.526445 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.526403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvzjq\" (UID: \"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:29.526643 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.526456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43a764fb-7684-4078-a6fd-b6007174a14a-cert\") pod \"kserve-controller-manager-d6f4b65b8-gtw96\" (UID: \"43a764fb-7684-4078-a6fd-b6007174a14a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.526643 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.526484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbngg\" (UniqueName: \"kubernetes.io/projected/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-kube-api-access-dbngg\") pod \"llmisvc-controller-manager-777c6bd7d5-vvzjq\" (UID: \"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:29.526643 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.526519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tg9n\" (UniqueName: \"kubernetes.io/projected/43a764fb-7684-4078-a6fd-b6007174a14a-kube-api-access-6tg9n\") pod \"kserve-controller-manager-d6f4b65b8-gtw96\" (UID: \"43a764fb-7684-4078-a6fd-b6007174a14a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.526643 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:57:29.526577    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 14 19:57:29.526842 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:57:29.526661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-cert podName:ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4 nodeName:}" failed. No retries permitted until 2026-07-14 19:57:30.026638352 +0000 UTC m=+360.869010527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-cert") pod "llmisvc-controller-manager-777c6bd7d5-vvzjq" (UID: "ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4") : secret "llmisvc-webhook-server-cert" not found
Jul 14 19:57:29.529038 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.529018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43a764fb-7684-4078-a6fd-b6007174a14a-cert\") pod \"kserve-controller-manager-d6f4b65b8-gtw96\" (UID: \"43a764fb-7684-4078-a6fd-b6007174a14a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.552390 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.552318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tg9n\" (UniqueName: \"kubernetes.io/projected/43a764fb-7684-4078-a6fd-b6007174a14a-kube-api-access-6tg9n\") pod \"kserve-controller-manager-d6f4b65b8-gtw96\" (UID: \"43a764fb-7684-4078-a6fd-b6007174a14a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.554104 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.554071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbngg\" (UniqueName: \"kubernetes.io/projected/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-kube-api-access-dbngg\") pod \"llmisvc-controller-manager-777c6bd7d5-vvzjq\" (UID: \"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:29.617463 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.617429    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rl4fk\""
Jul 14 19:57:29.624689 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.624665    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:29.789378 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:29.789327    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"]
Jul 14 19:57:29.790529 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:57:29.790504    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a764fb_7684_4078_a6fd_b6007174a14a.slice/crio-c362d6783432c9181c4421922fda3c85c5e79b34eaa1218ea0cb4b67c24c7ad7 WatchSource:0}: Error finding container c362d6783432c9181c4421922fda3c85c5e79b34eaa1218ea0cb4b67c24c7ad7: Status 404 returned error can't find the container with id c362d6783432c9181c4421922fda3c85c5e79b34eaa1218ea0cb4b67c24c7ad7
Jul 14 19:57:30.030439 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:30.030403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvzjq\" (UID: \"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:30.032799 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:30.032772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vvzjq\" (UID: \"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:30.228134 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:30.228098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zxnnw\""
Jul 14 19:57:30.234465 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:30.234443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:30.367088 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:30.367054    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"]
Jul 14 19:57:30.369230 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:57:30.369201    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podea593e5d_f3eb_40b9_8972_bf62fbf1e1b4.slice/crio-2712f4c28dc298a320031ee10ae3aeadd0137bfa9eb842d2b762920832baa0d4 WatchSource:0}: Error finding container 2712f4c28dc298a320031ee10ae3aeadd0137bfa9eb842d2b762920832baa0d4: Status 404 returned error can't find the container with id 2712f4c28dc298a320031ee10ae3aeadd0137bfa9eb842d2b762920832baa0d4
Jul 14 19:57:30.452326 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:30.452289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq" event={"ID":"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4","Type":"ContainerStarted","Data":"2712f4c28dc298a320031ee10ae3aeadd0137bfa9eb842d2b762920832baa0d4"}
Jul 14 19:57:30.453315 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:30.453292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96" event={"ID":"43a764fb-7684-4078-a6fd-b6007174a14a","Type":"ContainerStarted","Data":"c362d6783432c9181c4421922fda3c85c5e79b34eaa1218ea0cb4b67c24c7ad7"}
Jul 14 19:57:33.489749 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.489698    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"]
Jul 14 19:57:33.490241 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.489937    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k" podUID="90f812c6-83cf-4e87-98f8-40845bf06b2b" containerName="discovery" containerID="cri-o://c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b" gracePeriod=30
Jul 14 19:57:33.765189 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.765166    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:33.869295 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869267    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-kubeconfig\") pod \"90f812c6-83cf-4e87-98f8-40845bf06b2b\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") "
Jul 14 19:57:33.869295 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-ca-configmap\") pod \"90f812c6-83cf-4e87-98f8-40845bf06b2b\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") "
Jul 14 19:57:33.869496 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869383    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf6bk\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-kube-api-access-cf6bk\") pod \"90f812c6-83cf-4e87-98f8-40845bf06b2b\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") "
Jul 14 19:57:33.869496 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-cacerts\") pod \"90f812c6-83cf-4e87-98f8-40845bf06b2b\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") "
Jul 14 19:57:33.869496 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869473    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-dns-cert\") pod \"90f812c6-83cf-4e87-98f8-40845bf06b2b\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") "
Jul 14 19:57:33.869612 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869500    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f812c6-83cf-4e87-98f8-40845bf06b2b-local-certs\") pod \"90f812c6-83cf-4e87-98f8-40845bf06b2b\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") "
Jul 14 19:57:33.869612 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869542    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-token\") pod \"90f812c6-83cf-4e87-98f8-40845bf06b2b\" (UID: \"90f812c6-83cf-4e87-98f8-40845bf06b2b\") "
Jul 14 19:57:33.869776 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869741    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "90f812c6-83cf-4e87-98f8-40845bf06b2b" (UID: "90f812c6-83cf-4e87-98f8-40845bf06b2b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:57:33.869917 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.869849    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-ca-configmap\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:57:33.871855 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.871822    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "90f812c6-83cf-4e87-98f8-40845bf06b2b" (UID: "90f812c6-83cf-4e87-98f8-40845bf06b2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:57:33.871855 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.871831    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-cacerts" (OuterVolumeSpecName: "cacerts") pod "90f812c6-83cf-4e87-98f8-40845bf06b2b" (UID: "90f812c6-83cf-4e87-98f8-40845bf06b2b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:57:33.872017 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.871979    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "90f812c6-83cf-4e87-98f8-40845bf06b2b" (UID: "90f812c6-83cf-4e87-98f8-40845bf06b2b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:57:33.872058 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.872045    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90f812c6-83cf-4e87-98f8-40845bf06b2b-local-certs" (OuterVolumeSpecName: "local-certs") pod "90f812c6-83cf-4e87-98f8-40845bf06b2b" (UID: "90f812c6-83cf-4e87-98f8-40845bf06b2b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:57:33.872058 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.872045    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-kube-api-access-cf6bk" (OuterVolumeSpecName: "kube-api-access-cf6bk") pod "90f812c6-83cf-4e87-98f8-40845bf06b2b" (UID: "90f812c6-83cf-4e87-98f8-40845bf06b2b"). InnerVolumeSpecName "kube-api-access-cf6bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:57:33.872133 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.872043    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "90f812c6-83cf-4e87-98f8-40845bf06b2b" (UID: "90f812c6-83cf-4e87-98f8-40845bf06b2b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:57:33.970768 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.970731    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf6bk\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-kube-api-access-cf6bk\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:57:33.970768 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.970762    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-cacerts\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:57:33.970768 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.970774    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-csr-dns-cert\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:57:33.971000 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.970783    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f812c6-83cf-4e87-98f8-40845bf06b2b-local-certs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:57:33.971000 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.970791    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-token\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:57:33.971000 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:33.970799    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90f812c6-83cf-4e87-98f8-40845bf06b2b-istio-kubeconfig\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:57:34.477439 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.477400    2576 generic.go:356] "Generic (PLEG): container finished" podID="90f812c6-83cf-4e87-98f8-40845bf06b2b" containerID="c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b" exitCode=0
Jul 14 19:57:34.477623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.477453    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"
Jul 14 19:57:34.477623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.477487    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k" event={"ID":"90f812c6-83cf-4e87-98f8-40845bf06b2b","Type":"ContainerDied","Data":"c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b"}
Jul 14 19:57:34.477623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.477540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k" event={"ID":"90f812c6-83cf-4e87-98f8-40845bf06b2b","Type":"ContainerDied","Data":"03367b4895ccafb8404544e78e5e5b5b005dd98722509ffbf7ba44b926f5449b"}
Jul 14 19:57:34.477623 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.477560    2576 scope.go:117] "RemoveContainer" containerID="c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b"
Jul 14 19:57:34.479206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.479170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq" event={"ID":"ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4","Type":"ContainerStarted","Data":"915b044000a3a4249b059cc798e6fbbb4452d6fc9e9b0b21763d3659fbb258da"}
Jul 14 19:57:34.479329 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.479267    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:57:34.480760 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.480734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96" event={"ID":"43a764fb-7684-4078-a6fd-b6007174a14a","Type":"ContainerStarted","Data":"bf8e39b8c89ba38a5f4e215aa8d3a05a7f48c038e64a3de2ca69808193ea9d29"}
Jul 14 19:57:34.480859 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.480797    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:57:34.486610 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.486590    2576 scope.go:117] "RemoveContainer" containerID="c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b"
Jul 14 19:57:34.486863 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:57:34.486843    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b\": container with ID starting with c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b not found: ID does not exist" containerID="c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b"
Jul 14 19:57:34.486928 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.486870    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b"} err="failed to get container status \"c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b\": rpc error: code = NotFound desc = could not find container \"c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b\": container with ID starting with c86d7775e8dab13d500dd6a65c6cd6d460357d176e3bfccbba0f4bc9c3b8482b not found: ID does not exist"
Jul 14 19:57:34.522085 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.522035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq" podStartSLOduration=2.252283843 podStartE2EDuration="5.522020863s" totalImagesPullingTime="3.26973702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:34.520397762 +0000 UTC m=+365.362769958" watchObservedRunningTime="2026-07-14 19:57:34.522020863 +0000 UTC m=+365.364393077"
Jul 14 19:57:34.547999 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.547859    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96" podStartSLOduration=1.7017858590000001 podStartE2EDuration="5.547841978s" totalImagesPullingTime="3.846056119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:34.547188308 +0000 UTC m=+365.389560518" watchObservedRunningTime="2026-07-14 19:57:34.547841978 +0000 UTC m=+365.390214153"
Jul 14 19:57:34.568414 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.568386    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"]
Jul 14 19:57:34.572472 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:34.572441    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vpz2k"]
Jul 14 19:57:35.432464 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:35.432430    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nkpkv"
Jul 14 19:57:35.434678 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:35.434652    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tz6mx"
Jul 14 19:57:35.857973 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:57:35.857932    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90f812c6-83cf-4e87-98f8-40845bf06b2b" path="/var/lib/kubelet/pods/90f812c6-83cf-4e87-98f8-40845bf06b2b/volumes"
Jul 14 19:58:05.489846 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:05.489814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vvzjq"
Jul 14 19:58:05.492910 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:05.492885    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gtw96"
Jul 14 19:58:18.180206 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.180166    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wj45r"]
Jul 14 19:58:18.180789 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.180702    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f812c6-83cf-4e87-98f8-40845bf06b2b" containerName="discovery"
Jul 14 19:58:18.180789 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.180724    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f812c6-83cf-4e87-98f8-40845bf06b2b" containerName="discovery"
Jul 14 19:58:18.180909 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.180838    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="90f812c6-83cf-4e87-98f8-40845bf06b2b" containerName="discovery"
Jul 14 19:58:18.189648 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.189625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:18.192666 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.192644    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 19:58:18.193735 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.193712    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-p97n4\""
Jul 14 19:58:18.197329 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.197306    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 19:58:18.200492 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.200471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wj45r"]
Jul 14 19:58:18.246687 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.246652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb4vq\" (UniqueName: \"kubernetes.io/projected/097b6613-281a-4f0f-a869-65ac9fce6823-kube-api-access-gb4vq\") pod \"kuadrant-operator-catalog-wj45r\" (UID: \"097b6613-281a-4f0f-a869-65ac9fce6823\") " pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:18.347651 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.347620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb4vq\" (UniqueName: \"kubernetes.io/projected/097b6613-281a-4f0f-a869-65ac9fce6823-kube-api-access-gb4vq\") pod \"kuadrant-operator-catalog-wj45r\" (UID: \"097b6613-281a-4f0f-a869-65ac9fce6823\") " pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:18.356753 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.356728    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb4vq\" (UniqueName: \"kubernetes.io/projected/097b6613-281a-4f0f-a869-65ac9fce6823-kube-api-access-gb4vq\") pod \"kuadrant-operator-catalog-wj45r\" (UID: \"097b6613-281a-4f0f-a869-65ac9fce6823\") " pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:18.500499 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.500470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:18.630389 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.630364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wj45r"]
Jul 14 19:58:18.632511 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:58:18.632486    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097b6613_281a_4f0f_a869_65ac9fce6823.slice/crio-f2312a748eac1644edfd3c23fab8d1232276659d9127e7458f4ffde997d641ab WatchSource:0}: Error finding container f2312a748eac1644edfd3c23fab8d1232276659d9127e7458f4ffde997d641ab: Status 404 returned error can't find the container with id f2312a748eac1644edfd3c23fab8d1232276659d9127e7458f4ffde997d641ab
Jul 14 19:58:18.676609 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:18.676574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wj45r" event={"ID":"097b6613-281a-4f0f-a869-65ac9fce6823","Type":"ContainerStarted","Data":"f2312a748eac1644edfd3c23fab8d1232276659d9127e7458f4ffde997d641ab"}
Jul 14 19:58:21.695289 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:21.695256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wj45r" event={"ID":"097b6613-281a-4f0f-a869-65ac9fce6823","Type":"ContainerStarted","Data":"d3b0210fc9dc7b40c746553a9530bee388f9dc9563f98bbbdfb12a079821e183"}
Jul 14 19:58:21.711632 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:21.711581    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wj45r" podStartSLOduration=1.061791269 podStartE2EDuration="3.711564323s" totalImagesPullingTime="2.649773054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:58:21.710850816 +0000 UTC m=+412.553223014" watchObservedRunningTime="2026-07-14 19:58:21.711564323 +0000 UTC m=+412.553936522"
Jul 14 19:58:28.501213 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:28.501184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:28.501626 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:28.501356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:28.524052 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:28.524026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:28.749002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:28.748967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wj45r"
Jul 14 19:58:51.741565 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:51.741523    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"]
Jul 14 19:58:51.745777 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:51.745756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"
Jul 14 19:58:51.749038 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:51.749021    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-srzks\""
Jul 14 19:58:51.761782 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:51.761758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"]
Jul 14 19:58:51.835801 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:51.835770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wbph\" (UniqueName: \"kubernetes.io/projected/2fc97411-93d8-46d5-bbe2-b1d568b09704-kube-api-access-5wbph\") pod \"authorino-operator-75cc8d5cb7-99qjk\" (UID: \"2fc97411-93d8-46d5-bbe2-b1d568b09704\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"
Jul 14 19:58:51.936281 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:51.936244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wbph\" (UniqueName: \"kubernetes.io/projected/2fc97411-93d8-46d5-bbe2-b1d568b09704-kube-api-access-5wbph\") pod \"authorino-operator-75cc8d5cb7-99qjk\" (UID: \"2fc97411-93d8-46d5-bbe2-b1d568b09704\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"
Jul 14 19:58:51.947661 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:51.947604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wbph\" (UniqueName: \"kubernetes.io/projected/2fc97411-93d8-46d5-bbe2-b1d568b09704-kube-api-access-5wbph\") pod \"authorino-operator-75cc8d5cb7-99qjk\" (UID: \"2fc97411-93d8-46d5-bbe2-b1d568b09704\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"
Jul 14 19:58:52.056001 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:52.055916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"
Jul 14 19:58:52.188240 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:52.188216    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"]
Jul 14 19:58:52.190947 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:58:52.190917    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc97411_93d8_46d5_bbe2_b1d568b09704.slice/crio-7885254a8af02391921fc477c6c1252706344e023302c405728ad5f6262d6473 WatchSource:0}: Error finding container 7885254a8af02391921fc477c6c1252706344e023302c405728ad5f6262d6473: Status 404 returned error can't find the container with id 7885254a8af02391921fc477c6c1252706344e023302c405728ad5f6262d6473
Jul 14 19:58:52.836912 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:52.836874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk" event={"ID":"2fc97411-93d8-46d5-bbe2-b1d568b09704","Type":"ContainerStarted","Data":"7885254a8af02391921fc477c6c1252706344e023302c405728ad5f6262d6473"}
Jul 14 19:58:54.975040 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:54.975002    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"]
Jul 14 19:58:55.014693 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.014665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"]
Jul 14 19:58:55.014854 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.014774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"
Jul 14 19:58:55.018845 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.018816    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 14 19:58:55.018993 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.018870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j7mmz\""
Jul 14 19:58:55.060798 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.060768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwmn\" (UniqueName: \"kubernetes.io/projected/8526164c-fa62-4696-b309-7fb703cdc99d-kube-api-access-2nwmn\") pod \"dns-operator-controller-manager-864dd78c4c-mf464\" (UID: \"8526164c-fa62-4696-b309-7fb703cdc99d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"
Jul 14 19:58:55.161726 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.161687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwmn\" (UniqueName: \"kubernetes.io/projected/8526164c-fa62-4696-b309-7fb703cdc99d-kube-api-access-2nwmn\") pod \"dns-operator-controller-manager-864dd78c4c-mf464\" (UID: \"8526164c-fa62-4696-b309-7fb703cdc99d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"
Jul 14 19:58:55.180151 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.180122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwmn\" (UniqueName: \"kubernetes.io/projected/8526164c-fa62-4696-b309-7fb703cdc99d-kube-api-access-2nwmn\") pod \"dns-operator-controller-manager-864dd78c4c-mf464\" (UID: \"8526164c-fa62-4696-b309-7fb703cdc99d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"
Jul 14 19:58:55.327429 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.327325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"
Jul 14 19:58:55.953431 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:55.953408    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"]
Jul 14 19:58:55.955191 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:58:55.955161    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8526164c_fa62_4696_b309_7fb703cdc99d.slice/crio-07314993716d469efc7f24549db67f972b59f90562a65413cc978e9540bc0b1f WatchSource:0}: Error finding container 07314993716d469efc7f24549db67f972b59f90562a65413cc978e9540bc0b1f: Status 404 returned error can't find the container with id 07314993716d469efc7f24549db67f972b59f90562a65413cc978e9540bc0b1f
Jul 14 19:58:56.863555 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:56.863477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk" event={"ID":"2fc97411-93d8-46d5-bbe2-b1d568b09704","Type":"ContainerStarted","Data":"8feb62511e09bcc8bded4d344300350b71c00a6d614c5eb3c4e290c7d670aa36"}
Jul 14 19:58:56.863995 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:56.863739    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"
Jul 14 19:58:56.865107 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:56.865070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464" event={"ID":"8526164c-fa62-4696-b309-7fb703cdc99d","Type":"ContainerStarted","Data":"07314993716d469efc7f24549db67f972b59f90562a65413cc978e9540bc0b1f"}
Jul 14 19:58:56.901862 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:56.901808    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk" podStartSLOduration=2.266455574 podStartE2EDuration="5.901785894s" totalImagesPullingTime="3.63533032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:58:56.9008443 +0000 UTC m=+447.743216497" watchObservedRunningTime="2026-07-14 19:58:56.901785894 +0000 UTC m=+447.744158092"
Jul 14 19:58:58.667034 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.666999    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"]
Jul 14 19:58:58.669376 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.669358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:58:58.677031 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.677007    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vnt5h\""
Jul 14 19:58:58.689486 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.689462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"]
Jul 14 19:58:58.696006 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.695985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkx2h\" (UniqueName: \"kubernetes.io/projected/2516ffda-ca5b-464f-9e83-4f31e25bebb3-kube-api-access-rkx2h\") pod \"limitador-operator-controller-manager-859d7b78bd-vhr6t\" (UID: \"2516ffda-ca5b-464f-9e83-4f31e25bebb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:58:58.796505 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.796466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkx2h\" (UniqueName: \"kubernetes.io/projected/2516ffda-ca5b-464f-9e83-4f31e25bebb3-kube-api-access-rkx2h\") pod \"limitador-operator-controller-manager-859d7b78bd-vhr6t\" (UID: \"2516ffda-ca5b-464f-9e83-4f31e25bebb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:58:58.812382 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.812354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkx2h\" (UniqueName: \"kubernetes.io/projected/2516ffda-ca5b-464f-9e83-4f31e25bebb3-kube-api-access-rkx2h\") pod \"limitador-operator-controller-manager-859d7b78bd-vhr6t\" (UID: \"2516ffda-ca5b-464f-9e83-4f31e25bebb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:58:58.876165 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.876132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464" event={"ID":"8526164c-fa62-4696-b309-7fb703cdc99d","Type":"ContainerStarted","Data":"7cfc36e99d54f0d458a5fe9b12896549f9fb486b8b9bee23e7da99e49f4acf86"}
Jul 14 19:58:58.876285 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.876220    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"
Jul 14 19:58:58.904785 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.904741    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464" podStartSLOduration=2.969409541 podStartE2EDuration="4.904727858s" totalImagesPullingTime="1.935318317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:58:58.902825094 +0000 UTC m=+449.745197291" watchObservedRunningTime="2026-07-14 19:58:58.904727858 +0000 UTC m=+449.747100054"
Jul 14 19:58:58.979286 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:58.979260    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:58:59.142389 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:59.142359    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"]
Jul 14 19:58:59.143764 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:58:59.143737    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2516ffda_ca5b_464f_9e83_4f31e25bebb3.slice/crio-b98c00bfb03e615a742898fb7290ddef3916a7181b481f3b1089082d41c791e6 WatchSource:0}: Error finding container b98c00bfb03e615a742898fb7290ddef3916a7181b481f3b1089082d41c791e6: Status 404 returned error can't find the container with id b98c00bfb03e615a742898fb7290ddef3916a7181b481f3b1089082d41c791e6
Jul 14 19:58:59.881166 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:58:59.881135    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t" event={"ID":"2516ffda-ca5b-464f-9e83-4f31e25bebb3","Type":"ContainerStarted","Data":"b98c00bfb03e615a742898fb7290ddef3916a7181b481f3b1089082d41c791e6"}
Jul 14 19:59:02.897052 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:02.897017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t" event={"ID":"2516ffda-ca5b-464f-9e83-4f31e25bebb3","Type":"ContainerStarted","Data":"2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c"}
Jul 14 19:59:02.897405 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:02.897081    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:02.922417 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:02.922371    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t" podStartSLOduration=2.166628401 podStartE2EDuration="4.922356231s" totalImagesPullingTime="2.75572783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:02.921039233 +0000 UTC m=+453.763411431" watchObservedRunningTime="2026-07-14 19:59:02.922356231 +0000 UTC m=+453.764728424"
Jul 14 19:59:03.652924 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.652890    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"]
Jul 14 19:59:03.655244 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.655228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:03.657769 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.657745    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sthjk\""
Jul 14 19:59:03.671228 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.671207    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"]
Jul 14 19:59:03.738056 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.738022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c4133e-2871-45d3-a746-4ed6b72f1ace-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:03.738199 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.738091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8t4x\" (UniqueName: \"kubernetes.io/projected/93c4133e-2871-45d3-a746-4ed6b72f1ace-kube-api-access-g8t4x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:03.838876 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.838840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8t4x\" (UniqueName: \"kubernetes.io/projected/93c4133e-2871-45d3-a746-4ed6b72f1ace-kube-api-access-g8t4x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:03.839022 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.838909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c4133e-2871-45d3-a746-4ed6b72f1ace-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:03.839241 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.839219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c4133e-2871-45d3-a746-4ed6b72f1ace-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:03.853550 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.853522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8t4x\" (UniqueName: \"kubernetes.io/projected/93c4133e-2871-45d3-a746-4ed6b72f1ace-kube-api-access-g8t4x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:03.965969 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:03.965943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:04.099361 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:04.099317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"]
Jul 14 19:59:04.101464 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:59:04.101437    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c4133e_2871_45d3_a746_4ed6b72f1ace.slice/crio-69ce9fc98825215283bf58f6069b6e3094c7b6a2e185476861eee03c591a4a42 WatchSource:0}: Error finding container 69ce9fc98825215283bf58f6069b6e3094c7b6a2e185476861eee03c591a4a42: Status 404 returned error can't find the container with id 69ce9fc98825215283bf58f6069b6e3094c7b6a2e185476861eee03c591a4a42
Jul 14 19:59:04.918756 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:04.918720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7" event={"ID":"93c4133e-2871-45d3-a746-4ed6b72f1ace","Type":"ContainerStarted","Data":"69ce9fc98825215283bf58f6069b6e3094c7b6a2e185476861eee03c591a4a42"}
Jul 14 19:59:07.872816 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:07.872787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-99qjk"
Jul 14 19:59:09.884128 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:09.884044    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf464"
Jul 14 19:59:09.946164 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:09.946129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7" event={"ID":"93c4133e-2871-45d3-a746-4ed6b72f1ace","Type":"ContainerStarted","Data":"65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660"}
Jul 14 19:59:09.946324 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:09.946248    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:09.968668 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:09.968623    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7" podStartSLOduration=1.4697123429999999 podStartE2EDuration="6.968603737s" totalImagesPullingTime="5.498891394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:09.966331323 +0000 UTC m=+460.808703538" watchObservedRunningTime="2026-07-14 19:59:09.968603737 +0000 UTC m=+460.810975934"
Jul 14 19:59:13.904821 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:13.904791    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:20.953185 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:20.953143    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:22.061954 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.061915    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"]
Jul 14 19:59:22.064605 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.064581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.082686 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.082661    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"]
Jul 14 19:59:22.199022 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.198983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqdcw\" (UniqueName: \"kubernetes.io/projected/6a13acdc-62fa-4c11-98bd-dcc60022dad6-kube-api-access-gqdcw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.199195 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.199111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a13acdc-62fa-4c11-98bd-dcc60022dad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.299828 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.299788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a13acdc-62fa-4c11-98bd-dcc60022dad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.300020 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.299850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqdcw\" (UniqueName: \"kubernetes.io/projected/6a13acdc-62fa-4c11-98bd-dcc60022dad6-kube-api-access-gqdcw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.300234 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.300209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a13acdc-62fa-4c11-98bd-dcc60022dad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.308763 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.308737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqdcw\" (UniqueName: \"kubernetes.io/projected/6a13acdc-62fa-4c11-98bd-dcc60022dad6-kube-api-access-gqdcw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.374407 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.374376    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:22.511082 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.511058    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"]
Jul 14 19:59:22.512866 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:59:22.512840    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a13acdc_62fa_4c11_98bd_dcc60022dad6.slice/crio-bbeb352b11d3bf6907c4b117e6fd620eb7d5e2fe2ebc894eae9b344892522b02 WatchSource:0}: Error finding container bbeb352b11d3bf6907c4b117e6fd620eb7d5e2fe2ebc894eae9b344892522b02: Status 404 returned error can't find the container with id bbeb352b11d3bf6907c4b117e6fd620eb7d5e2fe2ebc894eae9b344892522b02
Jul 14 19:59:22.993536 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:22.993463    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"]
Jul 14 19:59:23.002815 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.002785    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"]
Jul 14 19:59:23.008762 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.008739    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x" container="manager"
Jul 14 19:59:23.011918 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.011888    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:23.018128 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.018104    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"]
Jul 14 19:59:23.018296 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.018276    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" containerName="manager" containerID="cri-o://65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660" gracePeriod=2
Jul 14 19:59:23.032937 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.032213    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"]
Jul 14 19:59:23.032937 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.032812    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" containerName="manager"
Jul 14 19:59:23.032937 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.032833    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" containerName="manager"
Jul 14 19:59:23.033557 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.032966    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" containerName="manager"
Jul 14 19:59:23.035279 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.035242    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"93c4133e-2871-45d3-a746-4ed6b72f1ace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\": pods \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:23.037207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.037186    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"]
Jul 14 19:59:23.037325 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.037304    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.037548 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.037517    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:23.040521 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.040501    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"]
Jul 14 19:59:23.040706 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.040686    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" containerName="manager" containerID="cri-o://2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c" gracePeriod=2
Jul 14 19:59:23.040979 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.040950    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:23.048578 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.048557    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"]
Jul 14 19:59:23.048950 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.048937    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" containerName="manager"
Jul 14 19:59:23.048950 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.048952    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" containerName="manager"
Jul 14 19:59:23.049037 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.049014    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" containerName="manager"
Jul 14 19:59:23.050935 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.050913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"]
Jul 14 19:59:23.051025 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.051006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.067900 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.067874    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"]
Jul 14 19:59:23.075782 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.075754    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:23.078946 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.078913    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:23.082002 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.081983    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"]
Jul 14 19:59:23.082502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.082483    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" containerName="manager"
Jul 14 19:59:23.082502 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.082503    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" containerName="manager"
Jul 14 19:59:23.082633 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.082578    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" containerName="manager"
Jul 14 19:59:23.084854 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.084837    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"
Jul 14 19:59:23.089102 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.089083    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"]
Jul 14 19:59:23.105082 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.105053    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"]
Jul 14 19:59:23.106249 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.106222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/003e7222-a70e-4573-9971-5accc907cc65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-75527\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.106400 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.106299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6zzf\" (UniqueName: \"kubernetes.io/projected/003e7222-a70e-4573-9971-5accc907cc65-kube-api-access-t6zzf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-75527\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.129819 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.129773    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vhr6t\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:23.132281 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.132250    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:23.157481 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.157444    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:23.159992 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.159958    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:23.162562 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.162520    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vhr6t\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:23.207248 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.207212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/003e7222-a70e-4573-9971-5accc907cc65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-75527\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.207573 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.207256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6zzf\" (UniqueName: \"kubernetes.io/projected/003e7222-a70e-4573-9971-5accc907cc65-kube-api-access-t6zzf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-75527\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.207573 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.207351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a163bed-a676-4827-9507-93bfbca04e33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrrvz\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.207573 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.207387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7zl\" (UniqueName: \"kubernetes.io/projected/0a163bed-a676-4827-9507-93bfbca04e33-kube-api-access-jf7zl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrrvz\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.207573 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.207434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tp95\" (UniqueName: \"kubernetes.io/projected/642ba76a-015f-4c1a-a501-03eeb9e93839-kube-api-access-6tp95\") pod \"limitador-operator-controller-manager-859d7b78bd-cbxpp\" (UID: \"642ba76a-015f-4c1a-a501-03eeb9e93839\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"
Jul 14 19:59:23.207925 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.207895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/003e7222-a70e-4573-9971-5accc907cc65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-75527\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.224697 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.224652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6zzf\" (UniqueName: \"kubernetes.io/projected/003e7222-a70e-4573-9971-5accc907cc65-kube-api-access-t6zzf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-75527\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.268452 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.268425    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:23.270584 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.270555    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vhr6t\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:23.272401 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.272373    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:23.274258 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.274229    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:23.277059 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.277042    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:23.279001 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.278979    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vhr6t\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:23.280753 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.280732    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hnqc7\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:23.282463 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:23.282443    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:23.308865 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.308839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a163bed-a676-4827-9507-93bfbca04e33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrrvz\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.308957 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.308868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7zl\" (UniqueName: \"kubernetes.io/projected/0a163bed-a676-4827-9507-93bfbca04e33-kube-api-access-jf7zl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrrvz\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.308957 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.308897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tp95\" (UniqueName: \"kubernetes.io/projected/642ba76a-015f-4c1a-a501-03eeb9e93839-kube-api-access-6tp95\") pod \"limitador-operator-controller-manager-859d7b78bd-cbxpp\" (UID: \"642ba76a-015f-4c1a-a501-03eeb9e93839\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"
Jul 14 19:59:23.309307 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.309287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a163bed-a676-4827-9507-93bfbca04e33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrrvz\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.318881 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.318856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tp95\" (UniqueName: \"kubernetes.io/projected/642ba76a-015f-4c1a-a501-03eeb9e93839-kube-api-access-6tp95\") pod \"limitador-operator-controller-manager-859d7b78bd-cbxpp\" (UID: \"642ba76a-015f-4c1a-a501-03eeb9e93839\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"
Jul 14 19:59:23.319131 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.319113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7zl\" (UniqueName: \"kubernetes.io/projected/0a163bed-a676-4827-9507-93bfbca04e33-kube-api-access-jf7zl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrrvz\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.410069 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.410039    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8t4x\" (UniqueName: \"kubernetes.io/projected/93c4133e-2871-45d3-a746-4ed6b72f1ace-kube-api-access-g8t4x\") pod \"93c4133e-2871-45d3-a746-4ed6b72f1ace\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") "
Jul 14 19:59:23.410220 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.410107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkx2h\" (UniqueName: \"kubernetes.io/projected/2516ffda-ca5b-464f-9e83-4f31e25bebb3-kube-api-access-rkx2h\") pod \"2516ffda-ca5b-464f-9e83-4f31e25bebb3\" (UID: \"2516ffda-ca5b-464f-9e83-4f31e25bebb3\") "
Jul 14 19:59:23.410220 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.410137    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c4133e-2871-45d3-a746-4ed6b72f1ace-extensions-socket-volume\") pod \"93c4133e-2871-45d3-a746-4ed6b72f1ace\" (UID: \"93c4133e-2871-45d3-a746-4ed6b72f1ace\") "
Jul 14 19:59:23.410665 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.410638    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c4133e-2871-45d3-a746-4ed6b72f1ace-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "93c4133e-2871-45d3-a746-4ed6b72f1ace" (UID: "93c4133e-2871-45d3-a746-4ed6b72f1ace"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:59:23.412208 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.412183    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c4133e-2871-45d3-a746-4ed6b72f1ace-kube-api-access-g8t4x" (OuterVolumeSpecName: "kube-api-access-g8t4x") pod "93c4133e-2871-45d3-a746-4ed6b72f1ace" (UID: "93c4133e-2871-45d3-a746-4ed6b72f1ace"). InnerVolumeSpecName "kube-api-access-g8t4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:59:23.412295 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.412275    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2516ffda-ca5b-464f-9e83-4f31e25bebb3-kube-api-access-rkx2h" (OuterVolumeSpecName: "kube-api-access-rkx2h") pod "2516ffda-ca5b-464f-9e83-4f31e25bebb3" (UID: "2516ffda-ca5b-464f-9e83-4f31e25bebb3"). InnerVolumeSpecName "kube-api-access-rkx2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:59:23.427478 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.427455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:23.436391 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.436361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:23.441184 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.441162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"
Jul 14 19:59:23.511847 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.511724    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8t4x\" (UniqueName: \"kubernetes.io/projected/93c4133e-2871-45d3-a746-4ed6b72f1ace-kube-api-access-g8t4x\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:23.511847 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.511760    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkx2h\" (UniqueName: \"kubernetes.io/projected/2516ffda-ca5b-464f-9e83-4f31e25bebb3-kube-api-access-rkx2h\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:23.511847 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.511778    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c4133e-2871-45d3-a746-4ed6b72f1ace-extensions-socket-volume\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:23.583846 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.583816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"]
Jul 14 19:59:23.585593 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:59:23.585560    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003e7222_a70e_4573_9971_5accc907cc65.slice/crio-f7e0b523bb1d8d817f42f8a1c7c38b0bdea7c4478f1d6b4cae927c6b2c1849e6 WatchSource:0}: Error finding container f7e0b523bb1d8d817f42f8a1c7c38b0bdea7c4478f1d6b4cae927c6b2c1849e6: Status 404 returned error can't find the container with id f7e0b523bb1d8d817f42f8a1c7c38b0bdea7c4478f1d6b4cae927c6b2c1849e6
Jul 14 19:59:23.815046 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.815019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"]
Jul 14 19:59:23.817849 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:59:23.817811    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642ba76a_015f_4c1a_a501_03eeb9e93839.slice/crio-6d4652319bff874ef9c9c0e7e25dbf7631843df22dccde5edd513aa6fb83878f WatchSource:0}: Error finding container 6d4652319bff874ef9c9c0e7e25dbf7631843df22dccde5edd513aa6fb83878f: Status 404 returned error can't find the container with id 6d4652319bff874ef9c9c0e7e25dbf7631843df22dccde5edd513aa6fb83878f
Jul 14 19:59:23.819140 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.819118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"]
Jul 14 19:59:23.821397 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:59:23.821371    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a163bed_a676_4827_9507_93bfbca04e33.slice/crio-956cba4ef2079fb59df25ef85101c253f634569e33f47e38d09ba82d819dbfbd WatchSource:0}: Error finding container 956cba4ef2079fb59df25ef85101c253f634569e33f47e38d09ba82d819dbfbd: Status 404 returned error can't find the container with id 956cba4ef2079fb59df25ef85101c253f634569e33f47e38d09ba82d819dbfbd
Jul 14 19:59:23.857207 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.857182    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" path="/var/lib/kubelet/pods/2516ffda-ca5b-464f-9e83-4f31e25bebb3/volumes"
Jul 14 19:59:23.857617 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:23.857601    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c4133e-2871-45d3-a746-4ed6b72f1ace" path="/var/lib/kubelet/pods/93c4133e-2871-45d3-a746-4ed6b72f1ace/volumes"
Jul 14 19:59:24.015399 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.015366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp" event={"ID":"642ba76a-015f-4c1a-a501-03eeb9e93839","Type":"ContainerStarted","Data":"86c7e048ddc1ca2ecc9f25606ec2fba65ad95d43f7105080784a2112fddb1cd6"}
Jul 14 19:59:24.015589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.015425    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp" event={"ID":"642ba76a-015f-4c1a-a501-03eeb9e93839","Type":"ContainerStarted","Data":"6d4652319bff874ef9c9c0e7e25dbf7631843df22dccde5edd513aa6fb83878f"}
Jul 14 19:59:24.015589 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.015454    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"
Jul 14 19:59:24.016618 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.016595    2576 generic.go:356] "Generic (PLEG): container finished" podID="2516ffda-ca5b-464f-9e83-4f31e25bebb3" containerID="2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c" exitCode=0
Jul 14 19:59:24.016743 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.016634    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vhr6t"
Jul 14 19:59:24.016743 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.016683    2576 scope.go:117] "RemoveContainer" containerID="2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c"
Jul 14 19:59:24.018689 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.018489    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" containerName="manager" containerID="cri-o://c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508" gracePeriod=2
Jul 14 19:59:24.020465 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.020438    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz" event={"ID":"0a163bed-a676-4827-9507-93bfbca04e33","Type":"ContainerStarted","Data":"94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4"}
Jul 14 19:59:24.020571 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.020498    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:24.020571 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.020525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz" event={"ID":"0a163bed-a676-4827-9507-93bfbca04e33","Type":"ContainerStarted","Data":"956cba4ef2079fb59df25ef85101c253f634569e33f47e38d09ba82d819dbfbd"}
Jul 14 19:59:24.021985 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.021963    2576 generic.go:356] "Generic (PLEG): container finished" podID="93c4133e-2871-45d3-a746-4ed6b72f1ace" containerID="65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660" exitCode=0
Jul 14 19:59:24.022121 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.022054    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnqc7"
Jul 14 19:59:24.025215 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.025190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527" event={"ID":"003e7222-a70e-4573-9971-5accc907cc65","Type":"ContainerStarted","Data":"d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0"}
Jul 14 19:59:24.025410 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.025390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527" event={"ID":"003e7222-a70e-4573-9971-5accc907cc65","Type":"ContainerStarted","Data":"f7e0b523bb1d8d817f42f8a1c7c38b0bdea7c4478f1d6b4cae927c6b2c1849e6"}
Jul 14 19:59:24.025545 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.025530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:24.030319 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.030229    2576 scope.go:117] "RemoveContainer" containerID="2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c"
Jul 14 19:59:24.030582 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:24.030541    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c\": container with ID starting with 2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c not found: ID does not exist" containerID="2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c"
Jul 14 19:59:24.030671 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.030583    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c"} err="failed to get container status \"2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c\": rpc error: code = NotFound desc = could not find container \"2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c\": container with ID starting with 2cd05ee98e2a7bb81bbdc6bb652f89e0b08a2cc900ceba56c11277722831c94c not found: ID does not exist"
Jul 14 19:59:24.030671 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.030634    2576 scope.go:117] "RemoveContainer" containerID="65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660"
Jul 14 19:59:24.051760 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.051720    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp" podStartSLOduration=1.051707116 podStartE2EDuration="1.051707116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:24.051653382 +0000 UTC m=+474.894025579" watchObservedRunningTime="2026-07-14 19:59:24.051707116 +0000 UTC m=+474.894079312"
Jul 14 19:59:24.090057 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.090032    2576 scope.go:117] "RemoveContainer" containerID="65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660"
Jul 14 19:59:24.090410 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:24.090376    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660\": container with ID starting with 65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660 not found: ID does not exist" containerID="65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660"
Jul 14 19:59:24.090410 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.090399    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660"} err="failed to get container status \"65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660\": rpc error: code = NotFound desc = could not find container \"65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660\": container with ID starting with 65ea0a3550773e5b0a6323cce8c96cf47d74874bbcf629f23e71bf0097c59660 not found: ID does not exist"
Jul 14 19:59:24.096100 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.096061    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz" podStartSLOduration=1.09604916 podStartE2EDuration="1.09604916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:24.093301691 +0000 UTC m=+474.935673907" watchObservedRunningTime="2026-07-14 19:59:24.09604916 +0000 UTC m=+474.938421356"
Jul 14 19:59:24.127230 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.127165    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527" podStartSLOduration=1.127144206 podStartE2EDuration="1.127144206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:24.12543525 +0000 UTC m=+474.967807448" watchObservedRunningTime="2026-07-14 19:59:24.127144206 +0000 UTC m=+474.969516404"
Jul 14 19:59:24.252805 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.252781    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:24.255226 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:24.255199    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:24.419976 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.419887    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqdcw\" (UniqueName: \"kubernetes.io/projected/6a13acdc-62fa-4c11-98bd-dcc60022dad6-kube-api-access-gqdcw\") pod \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") "
Jul 14 19:59:24.420147 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.419988    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a13acdc-62fa-4c11-98bd-dcc60022dad6-extensions-socket-volume\") pod \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\" (UID: \"6a13acdc-62fa-4c11-98bd-dcc60022dad6\") "
Jul 14 19:59:24.420332 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.420307    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a13acdc-62fa-4c11-98bd-dcc60022dad6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a13acdc-62fa-4c11-98bd-dcc60022dad6" (UID: "6a13acdc-62fa-4c11-98bd-dcc60022dad6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:59:24.422181 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.422156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a13acdc-62fa-4c11-98bd-dcc60022dad6-kube-api-access-gqdcw" (OuterVolumeSpecName: "kube-api-access-gqdcw") pod "6a13acdc-62fa-4c11-98bd-dcc60022dad6" (UID: "6a13acdc-62fa-4c11-98bd-dcc60022dad6"). InnerVolumeSpecName "kube-api-access-gqdcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:59:24.520719 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.520684    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqdcw\" (UniqueName: \"kubernetes.io/projected/6a13acdc-62fa-4c11-98bd-dcc60022dad6-kube-api-access-gqdcw\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:24.520719 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:24.520716    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a13acdc-62fa-4c11-98bd-dcc60022dad6-extensions-socket-volume\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:25.033601 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:25.033563    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" containerID="c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508" exitCode=0
Jul 14 19:59:25.033750 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:25.033609    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:25.033750 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:25.033657    2576 scope.go:117] "RemoveContainer" containerID="c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508"
Jul 14 19:59:25.036537 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:25.036505    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:25.042686 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:25.042669    2576 scope.go:117] "RemoveContainer" containerID="c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508"
Jul 14 19:59:25.042956 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:25.042937    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508\": container with ID starting with c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508 not found: ID does not exist" containerID="c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508"
Jul 14 19:59:25.043001 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:25.042965    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508"} err="failed to get container status \"c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508\": rpc error: code = NotFound desc = could not find container \"c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508\": container with ID starting with c5b10e2d1d9299c5fc6e72e4290dd93ace38c95428af037cb7296fd827b18508 not found: ID does not exist"
Jul 14 19:59:25.044669 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:25.044647    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-b4r6x\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-b4r6x"
Jul 14 19:59:25.856348 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:25.856295    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a13acdc-62fa-4c11-98bd-dcc60022dad6" path="/var/lib/kubelet/pods/6a13acdc-62fa-4c11-98bd-dcc60022dad6/volumes"
Jul 14 19:59:35.035958 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.035924    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:35.036332 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.035999    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:35.036332 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.036035    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbxpp"
Jul 14 19:59:35.107730 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.107694    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"]
Jul 14 19:59:35.107920 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.107895    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz" podUID="0a163bed-a676-4827-9507-93bfbca04e33" containerName="manager" containerID="cri-o://94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4" gracePeriod=10
Jul 14 19:59:35.369212 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.369181    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:35.470184 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.470155    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"]
Jul 14 19:59:35.470661 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.470645    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a163bed-a676-4827-9507-93bfbca04e33" containerName="manager"
Jul 14 19:59:35.470661 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.470662    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a163bed-a676-4827-9507-93bfbca04e33" containerName="manager"
Jul 14 19:59:35.470783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.470720    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a163bed-a676-4827-9507-93bfbca04e33" containerName="manager"
Jul 14 19:59:35.472672 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.472657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.501633 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.501605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"]
Jul 14 19:59:35.517997 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.517974    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf7zl\" (UniqueName: \"kubernetes.io/projected/0a163bed-a676-4827-9507-93bfbca04e33-kube-api-access-jf7zl\") pod \"0a163bed-a676-4827-9507-93bfbca04e33\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") "
Jul 14 19:59:35.518134 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.518016    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a163bed-a676-4827-9507-93bfbca04e33-extensions-socket-volume\") pod \"0a163bed-a676-4827-9507-93bfbca04e33\" (UID: \"0a163bed-a676-4827-9507-93bfbca04e33\") "
Jul 14 19:59:35.518428 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.518402    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a163bed-a676-4827-9507-93bfbca04e33-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0a163bed-a676-4827-9507-93bfbca04e33" (UID: "0a163bed-a676-4827-9507-93bfbca04e33"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:59:35.519982 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.519958    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a163bed-a676-4827-9507-93bfbca04e33-kube-api-access-jf7zl" (OuterVolumeSpecName: "kube-api-access-jf7zl") pod "0a163bed-a676-4827-9507-93bfbca04e33" (UID: "0a163bed-a676-4827-9507-93bfbca04e33"). InnerVolumeSpecName "kube-api-access-jf7zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:59:35.618975 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.618902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbps9\" (UniqueName: \"kubernetes.io/projected/a4d681ef-608e-4fa3-b775-99c4c4d87f82-kube-api-access-cbps9\") pod \"kuadrant-operator-controller-manager-86878c769f-4x78p\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.618975 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.618940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d681ef-608e-4fa3-b775-99c4c4d87f82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4x78p\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.619123 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.619062    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf7zl\" (UniqueName: \"kubernetes.io/projected/0a163bed-a676-4827-9507-93bfbca04e33-kube-api-access-jf7zl\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:35.619123 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.619075    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a163bed-a676-4827-9507-93bfbca04e33-extensions-socket-volume\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:35.719950 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.719912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbps9\" (UniqueName: \"kubernetes.io/projected/a4d681ef-608e-4fa3-b775-99c4c4d87f82-kube-api-access-cbps9\") pod \"kuadrant-operator-controller-manager-86878c769f-4x78p\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.719950 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.719952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d681ef-608e-4fa3-b775-99c4c4d87f82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4x78p\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.720271 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.720256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d681ef-608e-4fa3-b775-99c4c4d87f82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4x78p\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.733326 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.733303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbps9\" (UniqueName: \"kubernetes.io/projected/a4d681ef-608e-4fa3-b775-99c4c4d87f82-kube-api-access-cbps9\") pod \"kuadrant-operator-controller-manager-86878c769f-4x78p\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.783750 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.783716    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:35.933030 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:35.932978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"]
Jul 14 19:59:35.935431 ip-10-0-139-187 kubenswrapper[2576]: W0714 19:59:35.935402    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d681ef_608e_4fa3_b775_99c4c4d87f82.slice/crio-d731c7b8cc0fe594803791524ddea1da4c33e395f5dff4df8aecfc298232c8ec WatchSource:0}: Error finding container d731c7b8cc0fe594803791524ddea1da4c33e395f5dff4df8aecfc298232c8ec: Status 404 returned error can't find the container with id d731c7b8cc0fe594803791524ddea1da4c33e395f5dff4df8aecfc298232c8ec
Jul 14 19:59:36.093425 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.093389    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a163bed-a676-4827-9507-93bfbca04e33" containerID="94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4" exitCode=0
Jul 14 19:59:36.093849 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.093440    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"
Jul 14 19:59:36.093849 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.093470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz" event={"ID":"0a163bed-a676-4827-9507-93bfbca04e33","Type":"ContainerDied","Data":"94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4"}
Jul 14 19:59:36.093849 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.093521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz" event={"ID":"0a163bed-a676-4827-9507-93bfbca04e33","Type":"ContainerDied","Data":"956cba4ef2079fb59df25ef85101c253f634569e33f47e38d09ba82d819dbfbd"}
Jul 14 19:59:36.093849 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.093553    2576 scope.go:117] "RemoveContainer" containerID="94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4"
Jul 14 19:59:36.095567 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.095539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p" event={"ID":"a4d681ef-608e-4fa3-b775-99c4c4d87f82","Type":"ContainerStarted","Data":"ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9"}
Jul 14 19:59:36.095705 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.095616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p" event={"ID":"a4d681ef-608e-4fa3-b775-99c4c4d87f82","Type":"ContainerStarted","Data":"d731c7b8cc0fe594803791524ddea1da4c33e395f5dff4df8aecfc298232c8ec"}
Jul 14 19:59:36.095705 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.095692    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:36.102655 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.102637    2576 scope.go:117] "RemoveContainer" containerID="94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4"
Jul 14 19:59:36.102947 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:36.102919    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4\": container with ID starting with 94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4 not found: ID does not exist" containerID="94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4"
Jul 14 19:59:36.103016 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.102943    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4"} err="failed to get container status \"94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4\": rpc error: code = NotFound desc = could not find container \"94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4\": container with ID starting with 94d486f004d4fa680f0d4ad46b80b3cfca24e45cc1a5b3e66135ec6fd17eeeb4 not found: ID does not exist"
Jul 14 19:59:36.119147 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.119107    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p" podStartSLOduration=1.119093847 podStartE2EDuration="1.119093847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:36.117591869 +0000 UTC m=+486.959964080" watchObservedRunningTime="2026-07-14 19:59:36.119093847 +0000 UTC m=+486.961466043"
Jul 14 19:59:36.133043 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.133015    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"]
Jul 14 19:59:36.137208 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:36.137184    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrrvz"]
Jul 14 19:59:37.856474 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:37.856440    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a163bed-a676-4827-9507-93bfbca04e33" path="/var/lib/kubelet/pods/0a163bed-a676-4827-9507-93bfbca04e33/volumes"
Jul 14 19:59:47.103934 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.103905    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 19:59:47.170858 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.170825    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"]
Jul 14 19:59:47.171090 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.171042    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527" podUID="003e7222-a70e-4573-9971-5accc907cc65" containerName="manager" containerID="cri-o://d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0" gracePeriod=10
Jul 14 19:59:47.431087 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.431064    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:47.508413 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.508369    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/003e7222-a70e-4573-9971-5accc907cc65-extensions-socket-volume\") pod \"003e7222-a70e-4573-9971-5accc907cc65\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") "
Jul 14 19:59:47.508588 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.508434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6zzf\" (UniqueName: \"kubernetes.io/projected/003e7222-a70e-4573-9971-5accc907cc65-kube-api-access-t6zzf\") pod \"003e7222-a70e-4573-9971-5accc907cc65\" (UID: \"003e7222-a70e-4573-9971-5accc907cc65\") "
Jul 14 19:59:47.508783 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.508747    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003e7222-a70e-4573-9971-5accc907cc65-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "003e7222-a70e-4573-9971-5accc907cc65" (UID: "003e7222-a70e-4573-9971-5accc907cc65"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:59:47.510468 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.510440    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/003e7222-a70e-4573-9971-5accc907cc65-kube-api-access-t6zzf" (OuterVolumeSpecName: "kube-api-access-t6zzf") pod "003e7222-a70e-4573-9971-5accc907cc65" (UID: "003e7222-a70e-4573-9971-5accc907cc65"). InnerVolumeSpecName "kube-api-access-t6zzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:59:47.609263 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.609218    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/003e7222-a70e-4573-9971-5accc907cc65-extensions-socket-volume\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:47.609263 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:47.609256    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6zzf\" (UniqueName: \"kubernetes.io/projected/003e7222-a70e-4573-9971-5accc907cc65-kube-api-access-t6zzf\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 19:59:48.157574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.157492    2576 generic.go:356] "Generic (PLEG): container finished" podID="003e7222-a70e-4573-9971-5accc907cc65" containerID="d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0" exitCode=0
Jul 14 19:59:48.157574 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.157537    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"
Jul 14 19:59:48.158048 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.157580    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527" event={"ID":"003e7222-a70e-4573-9971-5accc907cc65","Type":"ContainerDied","Data":"d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0"}
Jul 14 19:59:48.158048 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.157627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527" event={"ID":"003e7222-a70e-4573-9971-5accc907cc65","Type":"ContainerDied","Data":"f7e0b523bb1d8d817f42f8a1c7c38b0bdea7c4478f1d6b4cae927c6b2c1849e6"}
Jul 14 19:59:48.158048 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.157649    2576 scope.go:117] "RemoveContainer" containerID="d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0"
Jul 14 19:59:48.166214 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.166197    2576 scope.go:117] "RemoveContainer" containerID="d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0"
Jul 14 19:59:48.166467 ip-10-0-139-187 kubenswrapper[2576]: E0714 19:59:48.166449    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0\": container with ID starting with d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0 not found: ID does not exist" containerID="d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0"
Jul 14 19:59:48.166546 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.166473    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0"} err="failed to get container status \"d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0\": rpc error: code = NotFound desc = could not find container \"d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0\": container with ID starting with d4c5ff14d23be3b88dcba77214bcb82fbefc0dcd5dd3ddde81b3db2bcaec23f0 not found: ID does not exist"
Jul 14 19:59:48.179851 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.179825    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"]
Jul 14 19:59:48.189007 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:48.188983    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-75527"]
Jul 14 19:59:49.856561 ip-10-0-139-187 kubenswrapper[2576]: I0714 19:59:49.856528    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="003e7222-a70e-4573-9971-5accc907cc65" path="/var/lib/kubelet/pods/003e7222-a70e-4573-9971-5accc907cc65/volumes"
Jul 14 20:00:06.534919 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.534875    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"]
Jul 14 20:00:06.535460 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.535440    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="003e7222-a70e-4573-9971-5accc907cc65" containerName="manager"
Jul 14 20:00:06.535550 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.535462    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="003e7222-a70e-4573-9971-5accc907cc65" containerName="manager"
Jul 14 20:00:06.535626 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.535613    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="003e7222-a70e-4573-9971-5accc907cc65" containerName="manager"
Jul 14 20:00:06.537838 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.537815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.540534 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.540509    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 20:00:06.540675 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.540652    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mpbkm\""
Jul 14 20:00:06.549783 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.549761    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"]
Jul 14 20:00:06.574461 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.574432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cgmk\" (UniqueName: \"kubernetes.io/projected/992d17e5-101c-4d86-8bfc-83298d0977a7-kube-api-access-5cgmk\") pod \"limitador-limitador-64c94fd64f-6zvgx\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.574602 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.574483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/992d17e5-101c-4d86-8bfc-83298d0977a7-config-file\") pod \"limitador-limitador-64c94fd64f-6zvgx\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.599654 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.599617    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"]
Jul 14 20:00:06.675187 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.675157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cgmk\" (UniqueName: \"kubernetes.io/projected/992d17e5-101c-4d86-8bfc-83298d0977a7-kube-api-access-5cgmk\") pod \"limitador-limitador-64c94fd64f-6zvgx\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.675377 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.675202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/992d17e5-101c-4d86-8bfc-83298d0977a7-config-file\") pod \"limitador-limitador-64c94fd64f-6zvgx\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.675820 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.675800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/992d17e5-101c-4d86-8bfc-83298d0977a7-config-file\") pod \"limitador-limitador-64c94fd64f-6zvgx\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.684867 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.684843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cgmk\" (UniqueName: \"kubernetes.io/projected/992d17e5-101c-4d86-8bfc-83298d0977a7-kube-api-access-5cgmk\") pod \"limitador-limitador-64c94fd64f-6zvgx\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.850953 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.850868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:06.860663 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.860448    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:00:06.863903 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.863878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:06.874944 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.874888    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:00:06.909299 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.909267    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:00:06.976879 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.976848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9422a48-080a-496f-a5a9-3057c7375d7c-config-file\") pod \"limitador-limitador-54d6d988d5-flggk\" (UID: \"f9422a48-080a-496f-a5a9-3057c7375d7c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:06.977027 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.976977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w565b\" (UniqueName: \"kubernetes.io/projected/f9422a48-080a-496f-a5a9-3057c7375d7c-kube-api-access-w565b\") pod \"limitador-limitador-54d6d988d5-flggk\" (UID: \"f9422a48-080a-496f-a5a9-3057c7375d7c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:06.995065 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:06.995036    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"]
Jul 14 20:00:06.996558 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:00:06.996534    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992d17e5_101c_4d86_8bfc_83298d0977a7.slice/crio-b5e43597250815611705db54978408fd84defac458808c059477271aa73176dd WatchSource:0}: Error finding container b5e43597250815611705db54978408fd84defac458808c059477271aa73176dd: Status 404 returned error can't find the container with id b5e43597250815611705db54978408fd84defac458808c059477271aa73176dd
Jul 14 20:00:07.077993 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:07.077966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w565b\" (UniqueName: \"kubernetes.io/projected/f9422a48-080a-496f-a5a9-3057c7375d7c-kube-api-access-w565b\") pod \"limitador-limitador-54d6d988d5-flggk\" (UID: \"f9422a48-080a-496f-a5a9-3057c7375d7c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:07.078107 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:07.078024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9422a48-080a-496f-a5a9-3057c7375d7c-config-file\") pod \"limitador-limitador-54d6d988d5-flggk\" (UID: \"f9422a48-080a-496f-a5a9-3057c7375d7c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:07.078654 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:07.078633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9422a48-080a-496f-a5a9-3057c7375d7c-config-file\") pod \"limitador-limitador-54d6d988d5-flggk\" (UID: \"f9422a48-080a-496f-a5a9-3057c7375d7c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:07.087525 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:07.087505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w565b\" (UniqueName: \"kubernetes.io/projected/f9422a48-080a-496f-a5a9-3057c7375d7c-kube-api-access-w565b\") pod \"limitador-limitador-54d6d988d5-flggk\" (UID: \"f9422a48-080a-496f-a5a9-3057c7375d7c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:07.191210 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:07.191143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:07.255370 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:07.255320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx" event={"ID":"992d17e5-101c-4d86-8bfc-83298d0977a7","Type":"ContainerStarted","Data":"b5e43597250815611705db54978408fd84defac458808c059477271aa73176dd"}
Jul 14 20:00:07.338649 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:07.338622    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:00:07.340758 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:00:07.340728    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9422a48_080a_496f_a5a9_3057c7375d7c.slice/crio-410fb9d3c31f664de430efb0551e02a317e287ddb9222d9b226ac6bd0fb2b458 WatchSource:0}: Error finding container 410fb9d3c31f664de430efb0551e02a317e287ddb9222d9b226ac6bd0fb2b458: Status 404 returned error can't find the container with id 410fb9d3c31f664de430efb0551e02a317e287ddb9222d9b226ac6bd0fb2b458
Jul 14 20:00:08.261084 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:08.261052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk" event={"ID":"f9422a48-080a-496f-a5a9-3057c7375d7c","Type":"ContainerStarted","Data":"410fb9d3c31f664de430efb0551e02a317e287ddb9222d9b226ac6bd0fb2b458"}
Jul 14 20:00:11.279672 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:11.279631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx" event={"ID":"992d17e5-101c-4d86-8bfc-83298d0977a7","Type":"ContainerStarted","Data":"8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a"}
Jul 14 20:00:11.280076 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:11.279722    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:11.281215 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:11.281189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk" event={"ID":"f9422a48-080a-496f-a5a9-3057c7375d7c","Type":"ContainerStarted","Data":"41bdcafddc37a02060ef6f0224e8fb791d48c48b66f4ca7543881f2d6286b19d"}
Jul 14 20:00:11.281313 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:11.281274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:11.299096 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:11.299053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx" podStartSLOduration=1.7721520389999998 podStartE2EDuration="5.299039538s" totalImagesPullingTime="3.526887499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:11.296530912 +0000 UTC m=+522.138903132" watchObservedRunningTime="2026-07-14 20:00:11.299039538 +0000 UTC m=+522.141411735"
Jul 14 20:00:11.314303 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:11.314259    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk" podStartSLOduration=2.13780151 podStartE2EDuration="5.314248865s" totalImagesPullingTime="3.176447355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:11.312218517 +0000 UTC m=+522.154590714" watchObservedRunningTime="2026-07-14 20:00:11.314248865 +0000 UTC m=+522.156621062"
Jul 14 20:00:22.287391 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:22.287280    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-flggk"
Jul 14 20:00:22.287880 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:22.287398    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:22.353966 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:22.353933    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"]
Jul 14 20:00:22.354161 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:22.354135    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx" podUID="992d17e5-101c-4d86-8bfc-83298d0977a7" containerName="limitador" containerID="cri-o://8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a" gracePeriod=30
Jul 14 20:00:22.914737 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:22.914675    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:23.033193 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.033160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/992d17e5-101c-4d86-8bfc-83298d0977a7-config-file\") pod \"992d17e5-101c-4d86-8bfc-83298d0977a7\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") "
Jul 14 20:00:23.033387 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.033209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cgmk\" (UniqueName: \"kubernetes.io/projected/992d17e5-101c-4d86-8bfc-83298d0977a7-kube-api-access-5cgmk\") pod \"992d17e5-101c-4d86-8bfc-83298d0977a7\" (UID: \"992d17e5-101c-4d86-8bfc-83298d0977a7\") "
Jul 14 20:00:23.033558 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.033529    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/992d17e5-101c-4d86-8bfc-83298d0977a7-config-file" (OuterVolumeSpecName: "config-file") pod "992d17e5-101c-4d86-8bfc-83298d0977a7" (UID: "992d17e5-101c-4d86-8bfc-83298d0977a7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:00:23.033706 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.033621    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/992d17e5-101c-4d86-8bfc-83298d0977a7-config-file\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:00:23.035320 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.035295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992d17e5-101c-4d86-8bfc-83298d0977a7-kube-api-access-5cgmk" (OuterVolumeSpecName: "kube-api-access-5cgmk") pod "992d17e5-101c-4d86-8bfc-83298d0977a7" (UID: "992d17e5-101c-4d86-8bfc-83298d0977a7"). InnerVolumeSpecName "kube-api-access-5cgmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:00:23.135060 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.135026    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cgmk\" (UniqueName: \"kubernetes.io/projected/992d17e5-101c-4d86-8bfc-83298d0977a7-kube-api-access-5cgmk\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:00:23.340823 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.340793    2576 generic.go:356] "Generic (PLEG): container finished" podID="992d17e5-101c-4d86-8bfc-83298d0977a7" containerID="8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a" exitCode=0
Jul 14 20:00:23.341266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.340838    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"
Jul 14 20:00:23.341266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.340878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx" event={"ID":"992d17e5-101c-4d86-8bfc-83298d0977a7","Type":"ContainerDied","Data":"8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a"}
Jul 14 20:00:23.341266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.340942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6zvgx" event={"ID":"992d17e5-101c-4d86-8bfc-83298d0977a7","Type":"ContainerDied","Data":"b5e43597250815611705db54978408fd84defac458808c059477271aa73176dd"}
Jul 14 20:00:23.341266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.340978    2576 scope.go:117] "RemoveContainer" containerID="8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a"
Jul 14 20:00:23.349925 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.349910    2576 scope.go:117] "RemoveContainer" containerID="8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a"
Jul 14 20:00:23.350170 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:00:23.350151    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a\": container with ID starting with 8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a not found: ID does not exist" containerID="8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a"
Jul 14 20:00:23.350219 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.350179    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a"} err="failed to get container status \"8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a\": rpc error: code = NotFound desc = could not find container \"8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a\": container with ID starting with 8f4384e42ed8ec663b4c2f7017b33d67ff43827dbe65b270020edd801e6b799a not found: ID does not exist"
Jul 14 20:00:23.362879 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.362857    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"]
Jul 14 20:00:23.372163 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.372142    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6zvgx"]
Jul 14 20:00:23.856468 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:23.856426    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="992d17e5-101c-4d86-8bfc-83298d0977a7" path="/var/lib/kubelet/pods/992d17e5-101c-4d86-8bfc-83298d0977a7/volumes"
Jul 14 20:00:25.779807 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.779774    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"]
Jul 14 20:00:25.780196 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.780157    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992d17e5-101c-4d86-8bfc-83298d0977a7" containerName="limitador"
Jul 14 20:00:25.780196 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.780168    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="992d17e5-101c-4d86-8bfc-83298d0977a7" containerName="limitador"
Jul 14 20:00:25.780263 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.780238    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="992d17e5-101c-4d86-8bfc-83298d0977a7" containerName="limitador"
Jul 14 20:00:25.789452 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.789423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:25.795633 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.795603    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 14 20:00:25.795763 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.795716    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f6qlt\""
Jul 14 20:00:25.796389 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.796356    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 14 20:00:25.796520 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.796499    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:00:25.813260 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.813234    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"]
Jul 14 20:00:25.959444 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.959412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl7dz\" (UniqueName: \"kubernetes.io/projected/93c2cd53-af3f-499b-93d9-120a8fdeaaac-kube-api-access-kl7dz\") pod \"postgres-69fb4594cf-nrmpz\" (UID: \"93c2cd53-af3f-499b-93d9-120a8fdeaaac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:25.959604 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:25.959497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/93c2cd53-af3f-499b-93d9-120a8fdeaaac-data\") pod \"postgres-69fb4594cf-nrmpz\" (UID: \"93c2cd53-af3f-499b-93d9-120a8fdeaaac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:26.060417 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:26.060308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/93c2cd53-af3f-499b-93d9-120a8fdeaaac-data\") pod \"postgres-69fb4594cf-nrmpz\" (UID: \"93c2cd53-af3f-499b-93d9-120a8fdeaaac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:26.060583 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:26.060421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl7dz\" (UniqueName: \"kubernetes.io/projected/93c2cd53-af3f-499b-93d9-120a8fdeaaac-kube-api-access-kl7dz\") pod \"postgres-69fb4594cf-nrmpz\" (UID: \"93c2cd53-af3f-499b-93d9-120a8fdeaaac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:26.060689 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:26.060668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/93c2cd53-af3f-499b-93d9-120a8fdeaaac-data\") pod \"postgres-69fb4594cf-nrmpz\" (UID: \"93c2cd53-af3f-499b-93d9-120a8fdeaaac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:26.074871 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:26.074843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl7dz\" (UniqueName: \"kubernetes.io/projected/93c2cd53-af3f-499b-93d9-120a8fdeaaac-kube-api-access-kl7dz\") pod \"postgres-69fb4594cf-nrmpz\" (UID: \"93c2cd53-af3f-499b-93d9-120a8fdeaaac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:26.099319 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:26.099287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:26.237451 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:26.237428    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"]
Jul 14 20:00:26.240149 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:00:26.240116    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c2cd53_af3f_499b_93d9_120a8fdeaaac.slice/crio-ec21950f875c117c7e0d0b07fc0d0311e56bcd6c51a6e95c5241ca60acc95f0c WatchSource:0}: Error finding container ec21950f875c117c7e0d0b07fc0d0311e56bcd6c51a6e95c5241ca60acc95f0c: Status 404 returned error can't find the container with id ec21950f875c117c7e0d0b07fc0d0311e56bcd6c51a6e95c5241ca60acc95f0c
Jul 14 20:00:26.358812 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:26.358715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz" event={"ID":"93c2cd53-af3f-499b-93d9-120a8fdeaaac","Type":"ContainerStarted","Data":"ec21950f875c117c7e0d0b07fc0d0311e56bcd6c51a6e95c5241ca60acc95f0c"}
Jul 14 20:00:31.055059 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:31.055035    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 14 20:00:31.389671 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:31.389589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz" event={"ID":"93c2cd53-af3f-499b-93d9-120a8fdeaaac","Type":"ContainerStarted","Data":"f032f8600b74e8604a99463606b2d6bb31a925cbe7cfbaafbf2a787565a8b40c"}
Jul 14 20:00:31.389807 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:31.389683    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:31.409705 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:31.409655    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz" podStartSLOduration=1.599246553 podStartE2EDuration="6.409638938s" totalImagesPullingTime="4.810392385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:31.408222979 +0000 UTC m=+542.250595175" watchObservedRunningTime="2026-07-14 20:00:31.409638938 +0000 UTC m=+542.252011135"
Jul 14 20:00:37.425817 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:37.425789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nrmpz"
Jul 14 20:00:47.396093 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.396053    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-696d845876-srz28"]
Jul 14 20:00:47.420164 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.420135    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-696d845876-srz28"]
Jul 14 20:00:47.420375 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.420224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.423185 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.423159    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 20:00:47.424210 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.424120    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 20:00:47.424332 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.424209    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p4clj\""
Jul 14 20:00:47.557088 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.551805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzgx\" (UniqueName: \"kubernetes.io/projected/a2e01763-8766-43cb-aae8-2b1546924dd9-kube-api-access-nzzgx\") pod \"maas-controller-696d845876-srz28\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") " pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.557088 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.551954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e01763-8766-43cb-aae8-2b1546924dd9-webhook-cert\") pod \"maas-controller-696d845876-srz28\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") " pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.653173 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.653090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e01763-8766-43cb-aae8-2b1546924dd9-webhook-cert\") pod \"maas-controller-696d845876-srz28\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") " pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.653173 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.653154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzgx\" (UniqueName: \"kubernetes.io/projected/a2e01763-8766-43cb-aae8-2b1546924dd9-kube-api-access-nzzgx\") pod \"maas-controller-696d845876-srz28\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") " pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.655568 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.655540    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e01763-8766-43cb-aae8-2b1546924dd9-webhook-cert\") pod \"maas-controller-696d845876-srz28\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") " pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.661226 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.661201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzgx\" (UniqueName: \"kubernetes.io/projected/a2e01763-8766-43cb-aae8-2b1546924dd9-kube-api-access-nzzgx\") pod \"maas-controller-696d845876-srz28\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") " pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.734218 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.734188    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:47.867472 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:47.867449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-696d845876-srz28"]
Jul 14 20:00:47.870518 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:00:47.870474    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e01763_8766_43cb_aae8_2b1546924dd9.slice/crio-f79eafb0f56722a010e6f1951d5e459c03e30027787b69790db753a67bb4d2f9 WatchSource:0}: Error finding container f79eafb0f56722a010e6f1951d5e459c03e30027787b69790db753a67bb4d2f9: Status 404 returned error can't find the container with id f79eafb0f56722a010e6f1951d5e459c03e30027787b69790db753a67bb4d2f9
Jul 14 20:00:48.476289 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:48.476253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-696d845876-srz28" event={"ID":"a2e01763-8766-43cb-aae8-2b1546924dd9","Type":"ContainerStarted","Data":"f79eafb0f56722a010e6f1951d5e459c03e30027787b69790db753a67bb4d2f9"}
Jul 14 20:00:50.488635 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:50.488598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-696d845876-srz28" event={"ID":"a2e01763-8766-43cb-aae8-2b1546924dd9","Type":"ContainerStarted","Data":"bbceaa0856f8f28ede4990fdaf134a4002f2973b7c785370c0f4cbe25dd93890"}
Jul 14 20:00:50.489055 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:50.488666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:00:50.510211 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:00:50.510162    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-696d845876-srz28" podStartSLOduration=1.490603388 podStartE2EDuration="3.510145769s" totalImagesPullingTime="2.019542381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:50.507849783 +0000 UTC m=+561.350221985" watchObservedRunningTime="2026-07-14 20:00:50.510145769 +0000 UTC m=+561.352517979"
Jul 14 20:01:01.495091 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:01.495060    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:01:23.089075 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.089039    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-kcx54"]
Jul 14 20:01:23.092247 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.092227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.095693 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.095672    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-98dtf\""
Jul 14 20:01:23.099367 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.096440    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 20:01:23.108274 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.108252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-kcx54"]
Jul 14 20:01:23.174570 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.174515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc4773d-be92-4320-b9ca-dbc05b4d9211-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-kcx54\" (UID: \"8fc4773d-be92-4320-b9ca-dbc05b4d9211\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.174784 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.174616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcwkf\" (UniqueName: \"kubernetes.io/projected/8fc4773d-be92-4320-b9ca-dbc05b4d9211-kube-api-access-kcwkf\") pod \"payload-processing-f9b8d9b9b-kcx54\" (UID: \"8fc4773d-be92-4320-b9ca-dbc05b4d9211\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.230830 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.230794    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:01:23.275388 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.275352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwkf\" (UniqueName: \"kubernetes.io/projected/8fc4773d-be92-4320-b9ca-dbc05b4d9211-kube-api-access-kcwkf\") pod \"payload-processing-f9b8d9b9b-kcx54\" (UID: \"8fc4773d-be92-4320-b9ca-dbc05b4d9211\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.275556 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.275476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc4773d-be92-4320-b9ca-dbc05b4d9211-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-kcx54\" (UID: \"8fc4773d-be92-4320-b9ca-dbc05b4d9211\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.276365 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.276309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc4773d-be92-4320-b9ca-dbc05b4d9211-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-kcx54\" (UID: \"8fc4773d-be92-4320-b9ca-dbc05b4d9211\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.284310 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.284276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcwkf\" (UniqueName: \"kubernetes.io/projected/8fc4773d-be92-4320-b9ca-dbc05b4d9211-kube-api-access-kcwkf\") pod \"payload-processing-f9b8d9b9b-kcx54\" (UID: \"8fc4773d-be92-4320-b9ca-dbc05b4d9211\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.410261 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.410177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:23.548975 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.548921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-kcx54"]
Jul 14 20:01:23.551103 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:01:23.551070    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc4773d_be92_4320_b9ca_dbc05b4d9211.slice/crio-0998292e7fcd344834bb6319880774ff73d24d29b0242ef94b379116fcdfc01d WatchSource:0}: Error finding container 0998292e7fcd344834bb6319880774ff73d24d29b0242ef94b379116fcdfc01d: Status 404 returned error can't find the container with id 0998292e7fcd344834bb6319880774ff73d24d29b0242ef94b379116fcdfc01d
Jul 14 20:01:23.652143 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:23.652113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54" event={"ID":"8fc4773d-be92-4320-b9ca-dbc05b4d9211","Type":"ContainerStarted","Data":"0998292e7fcd344834bb6319880774ff73d24d29b0242ef94b379116fcdfc01d"}
Jul 14 20:01:26.673560 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:26.673527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54" event={"ID":"8fc4773d-be92-4320-b9ca-dbc05b4d9211","Type":"ContainerStarted","Data":"015ad67b75f86710fb8e9bbb27654984f0c8490e94f7bf3b52d957b39c93eee0"}
Jul 14 20:01:26.673941 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:26.673662    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:26.691650 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:26.691606    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54" podStartSLOduration=1.228497846 podStartE2EDuration="3.691591105s" totalImagesPullingTime="2.463093259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:01:26.689793311 +0000 UTC m=+597.532165544" watchObservedRunningTime="2026-07-14 20:01:26.691591105 +0000 UTC m=+597.533963302"
Jul 14 20:01:29.619099 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:29.619066    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:01:29.619521 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:29.619160    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:01:29.621869 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:29.621850    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:01:29.621998 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:29.621931    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:01:37.681265 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:37.681235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-kcx54"
Jul 14 20:01:47.401322 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:47.401287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:01:53.173161 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.173081    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"]
Jul 14 20:01:53.176685 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.176660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.179232 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.179210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 20:01:53.179475 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.179454    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 20:01:53.180208 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.180186    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ccq98\""
Jul 14 20:01:53.180437 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.180420    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 14 20:01:53.187142 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.187109    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"]
Jul 14 20:01:53.249255 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.249218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwgld\" (UniqueName: \"kubernetes.io/projected/c34c4f36-2ff2-4203-b04a-317a0bd101b5-kube-api-access-kwgld\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.249576 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.249273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.249576 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.249295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.249576 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.249375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.249576 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.249436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.249576 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.249478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c34c4f36-2ff2-4203-b04a-317a0bd101b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350113 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350272 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350272 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350272 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350272 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c34c4f36-2ff2-4203-b04a-317a0bd101b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350494 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwgld\" (UniqueName: \"kubernetes.io/projected/c34c4f36-2ff2-4203-b04a-317a0bd101b5-kube-api-access-kwgld\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350587 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350695 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.350739 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.350699    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.352492 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.352475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c34c4f36-2ff2-4203-b04a-317a0bd101b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.352785 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.352766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c34c4f36-2ff2-4203-b04a-317a0bd101b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.359900 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.359874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwgld\" (UniqueName: \"kubernetes.io/projected/c34c4f36-2ff2-4203-b04a-317a0bd101b5-kube-api-access-kwgld\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jd9jk\" (UID: \"c34c4f36-2ff2-4203-b04a-317a0bd101b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.489538 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.489500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:01:53.624586 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.624506    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"]
Jul 14 20:01:53.626062 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:01:53.626026    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc34c4f36_2ff2_4203_b04a_317a0bd101b5.slice/crio-091832087efaf8eb7c8ebeac1994dcf66659504abe90521ea9a0d4d49c273fd9 WatchSource:0}: Error finding container 091832087efaf8eb7c8ebeac1994dcf66659504abe90521ea9a0d4d49c273fd9: Status 404 returned error can't find the container with id 091832087efaf8eb7c8ebeac1994dcf66659504abe90521ea9a0d4d49c273fd9
Jul 14 20:01:53.627878 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.627853    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:01:53.822012 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.821931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk" event={"ID":"c34c4f36-2ff2-4203-b04a-317a0bd101b5","Type":"ContainerStarted","Data":"091832087efaf8eb7c8ebeac1994dcf66659504abe90521ea9a0d4d49c273fd9"}
Jul 14 20:01:53.887213 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:53.887178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:01:54.829612 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:54.829574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk" event={"ID":"c34c4f36-2ff2-4203-b04a-317a0bd101b5","Type":"ContainerStarted","Data":"a253e9713deff8fd9a31e915a653bf227bf0839693ddc37dd8f73c29ba664f95"}
Jul 14 20:01:54.850580 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:01:54.850527    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk" podStartSLOduration=0.748395927 podStartE2EDuration="1.850507376s" totalImagesPullingTime="1.102111449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:01:54.848644523 +0000 UTC m=+625.691016764" watchObservedRunningTime="2026-07-14 20:01:54.850507376 +0000 UTC m=+625.692879574"
Jul 14 20:02:03.490181 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:03.490147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:02:03.490640 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:03.490203    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:02:03.502618 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:03.502593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:02:03.883478 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:03.883401    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jd9jk"
Jul 14 20:02:07.644864 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:07.644825    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:02:29.598928 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:29.598887    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:02:46.589684 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.589652    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"]
Jul 14 20:02:46.594266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.594244    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.596697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.596676    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 14 20:02:46.604828 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.604492    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"]
Jul 14 20:02:46.711446 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.711416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa3297e4-84da-4175-a895-78fcd5163574-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.711621 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.711454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.711621 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.711552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4vff\" (UniqueName: \"kubernetes.io/projected/aa3297e4-84da-4175-a895-78fcd5163574-kube-api-access-n4vff\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.711621 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.711598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.711743 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.711687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.711743 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.711714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.812738 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.812696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.812738 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.812742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.812982 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.812790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa3297e4-84da-4175-a895-78fcd5163574-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.812982 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.812819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.812982 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.812882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4vff\" (UniqueName: \"kubernetes.io/projected/aa3297e4-84da-4175-a895-78fcd5163574-kube-api-access-n4vff\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.812982 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.812913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.813176 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.813148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.813259 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.813234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.813412 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.813394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.815097 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.815072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa3297e4-84da-4175-a895-78fcd5163574-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.815418 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.815397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa3297e4-84da-4175-a895-78fcd5163574-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.821304 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.821276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4vff\" (UniqueName: \"kubernetes.io/projected/aa3297e4-84da-4175-a895-78fcd5163574-kube-api-access-n4vff\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fsct\" (UID: \"aa3297e4-84da-4175-a895-78fcd5163574\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:46.912928 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:46.912858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:47.055706 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:47.055679    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"]
Jul 14 20:02:47.058272 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:02:47.058236    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3297e4_84da_4175_a895_78fcd5163574.slice/crio-c1235d5f599c6761b9c1b7c952d11dfafe3f8f2d64dd482a507a8de05c0c776a WatchSource:0}: Error finding container c1235d5f599c6761b9c1b7c952d11dfafe3f8f2d64dd482a507a8de05c0c776a: Status 404 returned error can't find the container with id c1235d5f599c6761b9c1b7c952d11dfafe3f8f2d64dd482a507a8de05c0c776a
Jul 14 20:02:47.083939 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:47.083907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct" event={"ID":"aa3297e4-84da-4175-a895-78fcd5163574","Type":"ContainerStarted","Data":"c1235d5f599c6761b9c1b7c952d11dfafe3f8f2d64dd482a507a8de05c0c776a"}
Jul 14 20:02:48.090775 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:48.090738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct" event={"ID":"aa3297e4-84da-4175-a895-78fcd5163574","Type":"ContainerStarted","Data":"58eaadd8e2ad77a0043068d36ce2fab20fe8ebd51e7fbfb38f93cdb65c8fba65"}
Jul 14 20:02:48.113689 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:48.113642    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct" podStartSLOduration=1.913074575 podStartE2EDuration="2.113623792s" totalImagesPullingTime="200.549217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:02:48.11264678 +0000 UTC m=+678.955019005" watchObservedRunningTime="2026-07-14 20:02:48.113623792 +0000 UTC m=+678.955995989"
Jul 14 20:02:48.755149 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:48.755117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:02:56.913143 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:56.913106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:56.913576 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:56.913170    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:56.925950 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:56.925927    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:57.147801 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:57.147771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fsct"
Jul 14 20:02:58.986926 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:02:58.986893    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:04:38.392430 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:04:38.392394    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:04:47.887889 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:04:47.887854    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:04:58.301305 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:04:58.301225    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:05:07.200445 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:07.200413    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:05:18.327445 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:18.327405    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:05:20.610304 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:20.610269    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-696d845876-srz28"]
Jul 14 20:05:20.610714 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:20.610493    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-696d845876-srz28" podUID="a2e01763-8766-43cb-aae8-2b1546924dd9" containerName="manager" containerID="cri-o://bbceaa0856f8f28ede4990fdaf134a4002f2973b7c785370c0f4cbe25dd93890" gracePeriod=30
Jul 14 20:05:20.860144 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:20.860114    2576 generic.go:356] "Generic (PLEG): container finished" podID="a2e01763-8766-43cb-aae8-2b1546924dd9" containerID="bbceaa0856f8f28ede4990fdaf134a4002f2973b7c785370c0f4cbe25dd93890" exitCode=0
Jul 14 20:05:20.860281 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:20.860184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-696d845876-srz28" event={"ID":"a2e01763-8766-43cb-aae8-2b1546924dd9","Type":"ContainerDied","Data":"bbceaa0856f8f28ede4990fdaf134a4002f2973b7c785370c0f4cbe25dd93890"}
Jul 14 20:05:20.860281 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:20.860230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-696d845876-srz28" event={"ID":"a2e01763-8766-43cb-aae8-2b1546924dd9","Type":"ContainerDied","Data":"f79eafb0f56722a010e6f1951d5e459c03e30027787b69790db753a67bb4d2f9"}
Jul 14 20:05:20.860281 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:20.860247    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f79eafb0f56722a010e6f1951d5e459c03e30027787b69790db753a67bb4d2f9"
Jul 14 20:05:20.873903 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:20.873844    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:05:21.000431 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.000393    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzzgx\" (UniqueName: \"kubernetes.io/projected/a2e01763-8766-43cb-aae8-2b1546924dd9-kube-api-access-nzzgx\") pod \"a2e01763-8766-43cb-aae8-2b1546924dd9\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") "
Jul 14 20:05:21.000589 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.000499    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e01763-8766-43cb-aae8-2b1546924dd9-webhook-cert\") pod \"a2e01763-8766-43cb-aae8-2b1546924dd9\" (UID: \"a2e01763-8766-43cb-aae8-2b1546924dd9\") "
Jul 14 20:05:21.002642 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.002608    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e01763-8766-43cb-aae8-2b1546924dd9-kube-api-access-nzzgx" (OuterVolumeSpecName: "kube-api-access-nzzgx") pod "a2e01763-8766-43cb-aae8-2b1546924dd9" (UID: "a2e01763-8766-43cb-aae8-2b1546924dd9"). InnerVolumeSpecName "kube-api-access-nzzgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:05:21.002642 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.002619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2e01763-8766-43cb-aae8-2b1546924dd9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a2e01763-8766-43cb-aae8-2b1546924dd9" (UID: "a2e01763-8766-43cb-aae8-2b1546924dd9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:05:21.101297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.101254    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzzgx\" (UniqueName: \"kubernetes.io/projected/a2e01763-8766-43cb-aae8-2b1546924dd9-kube-api-access-nzzgx\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:05:21.101297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.101287    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e01763-8766-43cb-aae8-2b1546924dd9-webhook-cert\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:05:21.865098 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.865076    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-696d845876-srz28"
Jul 14 20:05:21.882706 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.882676    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-696d845876-srz28"]
Jul 14 20:05:21.891927 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:21.891905    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-696d845876-srz28"]
Jul 14 20:05:23.856429 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:23.856395    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2e01763-8766-43cb-aae8-2b1546924dd9" path="/var/lib/kubelet/pods/a2e01763-8766-43cb-aae8-2b1546924dd9/volumes"
Jul 14 20:05:46.491011 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:46.490977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:05:59.905179 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:05:59.905143    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:06:29.652861 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:06:29.652832    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:06:29.654634 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:06:29.654612    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:06:29.655756 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:06:29.655736    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:06:29.657595 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:06:29.657577    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:06:35.789178 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:06:35.789147    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:06:45.591040 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:06:45.591001    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:06:55.391594 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:06:55.391562    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:07:02.789024 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:07:02.788989    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:07:13.800297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:07:13.800257    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:07:24.787048 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:07:24.787009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:07:31.042110 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:07:31.042077    2576 scope.go:117] "RemoveContainer" containerID="bbceaa0856f8f28ede4990fdaf134a4002f2973b7c785370c0f4cbe25dd93890"
Jul 14 20:07:35.706288 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:07:35.706255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:07:45.791009 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:07:45.790970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:08:11.588886 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:08:11.588811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:08:23.190572 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:08:23.190536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:08:47.495476 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:08:47.495437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:08:57.589866 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:08:57.589829    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:09:13.144874 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:09:13.144840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:09:24.904836 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:09:24.904757    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:09:35.032491 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:09:35.032449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:09:46.850494 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:09:46.850456    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:10:20.262152 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:20.262112    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"]
Jul 14 20:10:20.262732 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:20.262369    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p" podUID="a4d681ef-608e-4fa3-b775-99c4c4d87f82" containerName="manager" containerID="cri-o://ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9" gracePeriod=10
Jul 14 20:10:24.219721 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.219693    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 20:10:24.355081 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.354988    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d681ef-608e-4fa3-b775-99c4c4d87f82-extensions-socket-volume\") pod \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") "
Jul 14 20:10:24.355306 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.355107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbps9\" (UniqueName: \"kubernetes.io/projected/a4d681ef-608e-4fa3-b775-99c4c4d87f82-kube-api-access-cbps9\") pod \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\" (UID: \"a4d681ef-608e-4fa3-b775-99c4c4d87f82\") "
Jul 14 20:10:24.355413 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.355382    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4d681ef-608e-4fa3-b775-99c4c4d87f82-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a4d681ef-608e-4fa3-b775-99c4c4d87f82" (UID: "a4d681ef-608e-4fa3-b775-99c4c4d87f82"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:10:24.357156 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.357134    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d681ef-608e-4fa3-b775-99c4c4d87f82-kube-api-access-cbps9" (OuterVolumeSpecName: "kube-api-access-cbps9") pod "a4d681ef-608e-4fa3-b775-99c4c4d87f82" (UID: "a4d681ef-608e-4fa3-b775-99c4c4d87f82"). InnerVolumeSpecName "kube-api-access-cbps9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:10:24.404151 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.404118    2576 generic.go:356] "Generic (PLEG): container finished" podID="a4d681ef-608e-4fa3-b775-99c4c4d87f82" containerID="ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9" exitCode=0
Jul 14 20:10:24.404297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.404162    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"
Jul 14 20:10:24.404297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.404202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p" event={"ID":"a4d681ef-608e-4fa3-b775-99c4c4d87f82","Type":"ContainerDied","Data":"ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9"}
Jul 14 20:10:24.404297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.404253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p" event={"ID":"a4d681ef-608e-4fa3-b775-99c4c4d87f82","Type":"ContainerDied","Data":"d731c7b8cc0fe594803791524ddea1da4c33e395f5dff4df8aecfc298232c8ec"}
Jul 14 20:10:24.404297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.404276    2576 scope.go:117] "RemoveContainer" containerID="ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9"
Jul 14 20:10:24.414476 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.414459    2576 scope.go:117] "RemoveContainer" containerID="ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9"
Jul 14 20:10:24.414727 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:10:24.414706    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9\": container with ID starting with ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9 not found: ID does not exist" containerID="ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9"
Jul 14 20:10:24.414781 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.414741    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9"} err="failed to get container status \"ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9\": rpc error: code = NotFound desc = could not find container \"ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9\": container with ID starting with ae9362ea3ccd75f235c40052eb0a98441c3c5e1d86465d5f9f972dc0844ab5e9 not found: ID does not exist"
Jul 14 20:10:24.432500 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.432473    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"]
Jul 14 20:10:24.436354 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.436320    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4x78p"]
Jul 14 20:10:24.456739 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.456717    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4d681ef-608e-4fa3-b775-99c4c4d87f82-extensions-socket-volume\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:10:24.456739 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:24.456736    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbps9\" (UniqueName: \"kubernetes.io/projected/a4d681ef-608e-4fa3-b775-99c4c4d87f82-kube-api-access-cbps9\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:10:25.856809 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:10:25.856776    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d681ef-608e-4fa3-b775-99c4c4d87f82" path="/var/lib/kubelet/pods/a4d681ef-608e-4fa3-b775-99c4c4d87f82/volumes"
Jul 14 20:11:21.490720 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.490685    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"]
Jul 14 20:11:21.491148 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.491136    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e01763-8766-43cb-aae8-2b1546924dd9" containerName="manager"
Jul 14 20:11:21.491192 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.491151    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e01763-8766-43cb-aae8-2b1546924dd9" containerName="manager"
Jul 14 20:11:21.491192 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.491175    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d681ef-608e-4fa3-b775-99c4c4d87f82" containerName="manager"
Jul 14 20:11:21.491192 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.491181    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d681ef-608e-4fa3-b775-99c4c4d87f82" containerName="manager"
Jul 14 20:11:21.491286 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.491249    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2e01763-8766-43cb-aae8-2b1546924dd9" containerName="manager"
Jul 14 20:11:21.491286 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.491258    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4d681ef-608e-4fa3-b775-99c4c4d87f82" containerName="manager"
Jul 14 20:11:21.494678 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.494658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.497569 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.497552    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sthjk\""
Jul 14 20:11:21.505967 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.505945    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"]
Jul 14 20:11:21.572168 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.572144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx92b\" (UniqueName: \"kubernetes.io/projected/d34a2427-1ebc-4b71-ba60-2716422f91c6-kube-api-access-xx92b\") pod \"kuadrant-operator-controller-manager-86878c769f-6d4s9\" (UID: \"d34a2427-1ebc-4b71-ba60-2716422f91c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.572299 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.572210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d34a2427-1ebc-4b71-ba60-2716422f91c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6d4s9\" (UID: \"d34a2427-1ebc-4b71-ba60-2716422f91c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.673157 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.673126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx92b\" (UniqueName: \"kubernetes.io/projected/d34a2427-1ebc-4b71-ba60-2716422f91c6-kube-api-access-xx92b\") pod \"kuadrant-operator-controller-manager-86878c769f-6d4s9\" (UID: \"d34a2427-1ebc-4b71-ba60-2716422f91c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.673308 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.673204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d34a2427-1ebc-4b71-ba60-2716422f91c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6d4s9\" (UID: \"d34a2427-1ebc-4b71-ba60-2716422f91c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.673539 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.673522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d34a2427-1ebc-4b71-ba60-2716422f91c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6d4s9\" (UID: \"d34a2427-1ebc-4b71-ba60-2716422f91c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.682638 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.682601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx92b\" (UniqueName: \"kubernetes.io/projected/d34a2427-1ebc-4b71-ba60-2716422f91c6-kube-api-access-xx92b\") pod \"kuadrant-operator-controller-manager-86878c769f-6d4s9\" (UID: \"d34a2427-1ebc-4b71-ba60-2716422f91c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.805898 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.805798    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:21.958731 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:21.958703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"]
Jul 14 20:11:21.960410 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:11:21.960376    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34a2427_1ebc_4b71_ba60_2716422f91c6.slice/crio-108fce149b8f8e6c8ddb43f21807aac6b63d93c2b7b1423b1a7884c7b2b22505 WatchSource:0}: Error finding container 108fce149b8f8e6c8ddb43f21807aac6b63d93c2b7b1423b1a7884c7b2b22505: Status 404 returned error can't find the container with id 108fce149b8f8e6c8ddb43f21807aac6b63d93c2b7b1423b1a7884c7b2b22505
Jul 14 20:11:22.691446 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:22.691401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9" event={"ID":"d34a2427-1ebc-4b71-ba60-2716422f91c6","Type":"ContainerStarted","Data":"b5e861ec9a90662d2b481d6ac8900093fd6c1805b2b10283f8ff43a9cdd89de4"}
Jul 14 20:11:22.691835 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:22.691463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9" event={"ID":"d34a2427-1ebc-4b71-ba60-2716422f91c6","Type":"ContainerStarted","Data":"108fce149b8f8e6c8ddb43f21807aac6b63d93c2b7b1423b1a7884c7b2b22505"}
Jul 14 20:11:22.691835 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:22.691483    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:22.712770 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:22.712291    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9" podStartSLOduration=1.712273996 podStartE2EDuration="1.712273996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:11:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:11:22.710758028 +0000 UTC m=+1193.553130224" watchObservedRunningTime="2026-07-14 20:11:22.712273996 +0000 UTC m=+1193.554646196"
Jul 14 20:11:29.687514 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:29.687483    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:11:29.690349 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:29.690316    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:11:29.690739 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:29.690721    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:11:29.693734 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:29.693713    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:11:33.699505 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:33.699467    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6d4s9"
Jul 14 20:11:44.588559 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:44.588522    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:11:54.277650 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:11:54.277612    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:12:07.191747 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:12:07.191709    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:12:18.386529 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:12:18.386495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:12:29.884142 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:12:29.884062    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:12:39.578975 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:12:39.578940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:12:49.884437 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:12:49.884402    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:12:59.279924 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:12:59.279884    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:13:10.980792 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:13:10.980753    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:13:18.582149 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:13:18.582101    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:13:27.475759 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:13:27.475728    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:13:37.582778 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:13:37.582745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:13:55.191915 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:13:55.191835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:14:06.086401 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:14:06.086364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:14:15.578962 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:14:15.578923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:14:24.978901 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:14:24.978863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:14:34.979003 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:14:34.978963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:14:47.486353 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:14:47.486317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:14:56.682899 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:14:56.682859    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:15:05.782927 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:15:05.782892    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:15:16.084820 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:15:16.084771    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:15:24.792264 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:15:24.792171    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:15:34.279009 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:15:34.278975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:15:46.883170 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:15:46.883140    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:15:58.485796 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:15:58.485753    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:16:07.787757 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:07.787711    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:16:20.083682 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:20.083649    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:16:29.722618 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:29.722590    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:16:29.726499 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:29.726477    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:16:29.727262 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:29.727239    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:16:29.732806 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:29.732779    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:16:30.788240 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:30.788206    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:16:37.701242 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:37.701207    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:16:53.378188 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:16:53.378094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:17:04.287579 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:04.287546    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:17:14.879802 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:14.879760    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:17:27.179106 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:27.179068    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:17:40.194714 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:40.194673    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:17:53.144192 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.144158    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"]
Jul 14 20:17:53.147808 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.147791    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"
Jul 14 20:17:53.151017 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.150995    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:17:53.158866 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.158841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"]
Jul 14 20:17:53.225123 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.225086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c732a549-0ff7-41bb-aca7-ca9a5b49a99f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df972874-fqdth\" (UID: \"c732a549-0ff7-41bb-aca7-ca9a5b49a99f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"
Jul 14 20:17:53.326273 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.326232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c732a549-0ff7-41bb-aca7-ca9a5b49a99f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df972874-fqdth\" (UID: \"c732a549-0ff7-41bb-aca7-ca9a5b49a99f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"
Jul 14 20:17:53.326852 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.326831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c732a549-0ff7-41bb-aca7-ca9a5b49a99f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df972874-fqdth\" (UID: \"c732a549-0ff7-41bb-aca7-ca9a5b49a99f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"
Jul 14 20:17:53.458090 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.458061    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"
Jul 14 20:17:53.798858 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.798771    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"]
Jul 14 20:17:53.802022 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:17:53.801991    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc732a549_0ff7_41bb_aca7_ca9a5b49a99f.slice/crio-d94d7190eb97c6c0956521193bd4ddddfc17bb9fe995050012e7e4129e9a391d WatchSource:0}: Error finding container d94d7190eb97c6c0956521193bd4ddddfc17bb9fe995050012e7e4129e9a391d: Status 404 returned error can't find the container with id d94d7190eb97c6c0956521193bd4ddddfc17bb9fe995050012e7e4129e9a391d
Jul 14 20:17:53.804392 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:53.804375    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:17:54.722044 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:54.721998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth" event={"ID":"c732a549-0ff7-41bb-aca7-ca9a5b49a99f","Type":"ContainerStarted","Data":"d94d7190eb97c6c0956521193bd4ddddfc17bb9fe995050012e7e4129e9a391d"}
Jul 14 20:17:55.818245 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:55.818215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:17:56.734005 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:56.733968    2576 generic.go:356] "Generic (PLEG): container finished" podID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerID="bbba9c1b3805c55c61c5ce8c28aa781fc6f01b332e47d184576ddf27c7313369" exitCode=7
Jul 14 20:17:56.734197 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:56.734062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth" event={"ID":"c732a549-0ff7-41bb-aca7-ca9a5b49a99f","Type":"ContainerDied","Data":"bbba9c1b3805c55c61c5ce8c28aa781fc6f01b332e47d184576ddf27c7313369"}
Jul 14 20:17:56.734262 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:56.734225    2576 scope.go:117] "RemoveContainer" containerID="bbba9c1b3805c55c61c5ce8c28aa781fc6f01b332e47d184576ddf27c7313369"
Jul 14 20:17:57.741441 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:57.741410    2576 generic.go:356] "Generic (PLEG): container finished" podID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerID="948d365c91c4fc05903e1c592f82158892b121aa2da68ec26c2a8e1f3f015ddf" exitCode=7
Jul 14 20:17:57.741861 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:57.741493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth" event={"ID":"c732a549-0ff7-41bb-aca7-ca9a5b49a99f","Type":"ContainerDied","Data":"948d365c91c4fc05903e1c592f82158892b121aa2da68ec26c2a8e1f3f015ddf"}
Jul 14 20:17:57.741861 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:57.741557    2576 scope.go:117] "RemoveContainer" containerID="bbba9c1b3805c55c61c5ce8c28aa781fc6f01b332e47d184576ddf27c7313369"
Jul 14 20:17:57.741861 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:57.741734    2576 scope.go:117] "RemoveContainer" containerID="948d365c91c4fc05903e1c592f82158892b121aa2da68ec26c2a8e1f3f015ddf"
Jul 14 20:17:57.742055 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:17:57.742020    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-df972874-fqdth_odh-ai-gateway-infra(c732a549-0ff7-41bb-aca7-ca9a5b49a99f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f"
Jul 14 20:17:58.748769 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:17:58.748743    2576 scope.go:117] "RemoveContainer" containerID="948d365c91c4fc05903e1c592f82158892b121aa2da68ec26c2a8e1f3f015ddf"
Jul 14 20:17:58.749282 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:17:58.748982    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-df972874-fqdth_odh-ai-gateway-infra(c732a549-0ff7-41bb-aca7-ca9a5b49a99f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f"
Jul 14 20:18:11.850743 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:11.850708    2576 scope.go:117] "RemoveContainer" containerID="948d365c91c4fc05903e1c592f82158892b121aa2da68ec26c2a8e1f3f015ddf"
Jul 14 20:18:12.821409 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:12.821300    2576 generic.go:356] "Generic (PLEG): container finished" podID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerID="92b26543000a5e84f5d872408926381f15cf6778f566031e3ad62f070d74159f" exitCode=0
Jul 14 20:18:12.821409 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:12.821373    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth" event={"ID":"c732a549-0ff7-41bb-aca7-ca9a5b49a99f","Type":"ContainerDied","Data":"92b26543000a5e84f5d872408926381f15cf6778f566031e3ad62f070d74159f"}
Jul 14 20:18:12.821630 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:12.821435    2576 scope.go:117] "RemoveContainer" containerID="948d365c91c4fc05903e1c592f82158892b121aa2da68ec26c2a8e1f3f015ddf"
Jul 14 20:18:13.861493 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:13.861458    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"]
Jul 14 20:18:13.967568 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:13.967543    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"
Jul 14 20:18:13.997703 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:13.997678    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c732a549-0ff7-41bb-aca7-ca9a5b49a99f-maas-api-service-ca\") pod \"c732a549-0ff7-41bb-aca7-ca9a5b49a99f\" (UID: \"c732a549-0ff7-41bb-aca7-ca9a5b49a99f\") "
Jul 14 20:18:13.998057 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:13.998026    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c732a549-0ff7-41bb-aca7-ca9a5b49a99f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c732a549-0ff7-41bb-aca7-ca9a5b49a99f" (UID: "c732a549-0ff7-41bb-aca7-ca9a5b49a99f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:18:14.099326 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:14.099246    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c732a549-0ff7-41bb-aca7-ca9a5b49a99f-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:18:14.835597 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:14.835566    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"
Jul 14 20:18:14.835844 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:14.835599    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth" event={"ID":"c732a549-0ff7-41bb-aca7-ca9a5b49a99f","Type":"ContainerDied","Data":"d94d7190eb97c6c0956521193bd4ddddfc17bb9fe995050012e7e4129e9a391d"}
Jul 14 20:18:14.835844 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:14.835684    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d94d7190eb97c6c0956521193bd4ddddfc17bb9fe995050012e7e4129e9a391d"
Jul 14 20:18:14.868719 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:14.868683    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"]
Jul 14 20:18:14.874203 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:14.874177    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-fqdth"]
Jul 14 20:18:15.856723 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:18:15.856689    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" path="/var/lib/kubelet/pods/c732a549-0ff7-41bb-aca7-ca9a5b49a99f/volumes"
Jul 14 20:19:07.553074 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:19:07.553040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:19:30.241949 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:19:30.241914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:20:28.466288 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:28.466249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:20:49.406388 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406351    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"]
Jul 14 20:20:49.406822 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406808    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:20:49.406867 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406823    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:20:49.406867 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406837    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:20:49.406867 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406843    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:20:49.406960 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406925    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:20:49.406960 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406934    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:20:49.406960 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.406941    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:20:49.409040 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.409019    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"
Jul 14 20:20:49.413857 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.413822    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:20:49.486821 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.486785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c151ca-5498-43e0-9898-0030f86fc731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d\" (UID: \"f4c151ca-5498-43e0-9898-0030f86fc731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"
Jul 14 20:20:49.500678 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.500640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"]
Jul 14 20:20:49.588245 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.588203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c151ca-5498-43e0-9898-0030f86fc731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d\" (UID: \"f4c151ca-5498-43e0-9898-0030f86fc731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"
Jul 14 20:20:49.588879 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.588855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c151ca-5498-43e0-9898-0030f86fc731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d\" (UID: \"f4c151ca-5498-43e0-9898-0030f86fc731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"
Jul 14 20:20:49.720119 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.720084    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"
Jul 14 20:20:49.886796 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:49.886747    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"]
Jul 14 20:20:49.892554 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:20:49.892521    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c151ca_5498_43e0_9898_0030f86fc731.slice/crio-f19648e0e4f0453420505f7ef27637a74fa81b8e25513491f7373be3c97815a9 WatchSource:0}: Error finding container f19648e0e4f0453420505f7ef27637a74fa81b8e25513491f7373be3c97815a9: Status 404 returned error can't find the container with id f19648e0e4f0453420505f7ef27637a74fa81b8e25513491f7373be3c97815a9
Jul 14 20:20:50.638256 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:50.638220    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4c151ca-5498-43e0-9898-0030f86fc731" containerID="3abfacdf03aae34b2bf8c055b5b6066b6059dd2f473da6bc8b82d0282bf7bd67" exitCode=7
Jul 14 20:20:50.638752 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:50.638306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d" event={"ID":"f4c151ca-5498-43e0-9898-0030f86fc731","Type":"ContainerDied","Data":"3abfacdf03aae34b2bf8c055b5b6066b6059dd2f473da6bc8b82d0282bf7bd67"}
Jul 14 20:20:50.638752 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:50.638384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d" event={"ID":"f4c151ca-5498-43e0-9898-0030f86fc731","Type":"ContainerStarted","Data":"f19648e0e4f0453420505f7ef27637a74fa81b8e25513491f7373be3c97815a9"}
Jul 14 20:20:50.638752 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:50.638492    2576 scope.go:117] "RemoveContainer" containerID="3abfacdf03aae34b2bf8c055b5b6066b6059dd2f473da6bc8b82d0282bf7bd67"
Jul 14 20:20:51.644565 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:51.644477    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4c151ca-5498-43e0-9898-0030f86fc731" containerID="423587214bb7b42f68e23d4670a51f46778dfe317bf1267c0b05ab9954ceea54" exitCode=7
Jul 14 20:20:51.644565 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:51.644539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d" event={"ID":"f4c151ca-5498-43e0-9898-0030f86fc731","Type":"ContainerDied","Data":"423587214bb7b42f68e23d4670a51f46778dfe317bf1267c0b05ab9954ceea54"}
Jul 14 20:20:51.644985 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:51.644590    2576 scope.go:117] "RemoveContainer" containerID="3abfacdf03aae34b2bf8c055b5b6066b6059dd2f473da6bc8b82d0282bf7bd67"
Jul 14 20:20:51.644985 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:51.644773    2576 scope.go:117] "RemoveContainer" containerID="423587214bb7b42f68e23d4670a51f46778dfe317bf1267c0b05ab9954ceea54"
Jul 14 20:20:51.645069 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:20:51.644992    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d_odh-ai-gateway-infra(f4c151ca-5498-43e0-9898-0030f86fc731)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d" podUID="f4c151ca-5498-43e0-9898-0030f86fc731"
Jul 14 20:20:52.651150 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:52.651113    2576 scope.go:117] "RemoveContainer" containerID="423587214bb7b42f68e23d4670a51f46778dfe317bf1267c0b05ab9954ceea54"
Jul 14 20:20:52.651547 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:20:52.651319    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d_odh-ai-gateway-infra(f4c151ca-5498-43e0-9898-0030f86fc731)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d" podUID="f4c151ca-5498-43e0-9898-0030f86fc731"
Jul 14 20:20:53.862586 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:20:53.862550    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:21:06.850503 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:06.850475    2576 scope.go:117] "RemoveContainer" containerID="423587214bb7b42f68e23d4670a51f46778dfe317bf1267c0b05ab9954ceea54"
Jul 14 20:21:07.735333 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:07.735300    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4c151ca-5498-43e0-9898-0030f86fc731" containerID="fefd6d0958872e9641492b50b8b7b0a8fa17e80dbc1a20c9f207ff9a6548b67b" exitCode=0
Jul 14 20:21:07.735513 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:07.735368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d" event={"ID":"f4c151ca-5498-43e0-9898-0030f86fc731","Type":"ContainerDied","Data":"fefd6d0958872e9641492b50b8b7b0a8fa17e80dbc1a20c9f207ff9a6548b67b"}
Jul 14 20:21:07.735513 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:07.735458    2576 scope.go:117] "RemoveContainer" containerID="423587214bb7b42f68e23d4670a51f46778dfe317bf1267c0b05ab9954ceea54"
Jul 14 20:21:08.817266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:08.817231    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"]
Jul 14 20:21:08.880627 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:08.880599    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"
Jul 14 20:21:09.074998 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.074927    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c151ca-5498-43e0-9898-0030f86fc731-maas-api-service-ca\") pod \"f4c151ca-5498-43e0-9898-0030f86fc731\" (UID: \"f4c151ca-5498-43e0-9898-0030f86fc731\") "
Jul 14 20:21:09.075248 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.075224    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c151ca-5498-43e0-9898-0030f86fc731-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4c151ca-5498-43e0-9898-0030f86fc731" (UID: "f4c151ca-5498-43e0-9898-0030f86fc731"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:21:09.175524 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.175496    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c151ca-5498-43e0-9898-0030f86fc731-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:21:09.749459 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.749426    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"
Jul 14 20:21:09.749624 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.749458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d" event={"ID":"f4c151ca-5498-43e0-9898-0030f86fc731","Type":"ContainerDied","Data":"f19648e0e4f0453420505f7ef27637a74fa81b8e25513491f7373be3c97815a9"}
Jul 14 20:21:09.749624 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.749502    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f19648e0e4f0453420505f7ef27637a74fa81b8e25513491f7373be3c97815a9"
Jul 14 20:21:09.809187 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.809156    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"]
Jul 14 20:21:09.828817 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.828789    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wkt4d"]
Jul 14 20:21:09.857162 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:09.857132    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" path="/var/lib/kubelet/pods/f4c151ca-5498-43e0-9898-0030f86fc731/volumes"
Jul 14 20:21:29.764858 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:29.764828    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:21:29.767788 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:29.767761    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:21:29.773258 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:29.773240    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:21:29.776375 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:29.776358    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:21:49.514212 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514174    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"]
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514627    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514640    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514652    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514658    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c732a549-0ff7-41bb-aca7-ca9a5b49a99f" containerName="revoke-keys"
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514676    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514682    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514690    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.514697 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514695    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.514962 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514775    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.514962 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.514783    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:21:49.516960 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.516942    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"
Jul 14 20:21:49.521409 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.521386    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:21:49.544544 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.544510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/398e6903-d52a-497d-8bc1-7c519815411b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk\" (UID: \"398e6903-d52a-497d-8bc1-7c519815411b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"
Jul 14 20:21:49.576579 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.576550    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"]
Jul 14 20:21:49.645415 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.645382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/398e6903-d52a-497d-8bc1-7c519815411b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk\" (UID: \"398e6903-d52a-497d-8bc1-7c519815411b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"
Jul 14 20:21:49.645980 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.645962    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/398e6903-d52a-497d-8bc1-7c519815411b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk\" (UID: \"398e6903-d52a-497d-8bc1-7c519815411b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"
Jul 14 20:21:49.827313 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:49.827219    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"
Jul 14 20:21:50.183332 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:50.183310    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"]
Jul 14 20:21:50.960375 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:50.960311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk" event={"ID":"398e6903-d52a-497d-8bc1-7c519815411b","Type":"ContainerStarted","Data":"9d6b7724934e5a4c23dc11b633f1ad8ad476bc0c7f46e1f3a5196e2c53c298de"}
Jul 14 20:21:50.960733 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:50.960399    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk" event={"ID":"398e6903-d52a-497d-8bc1-7c519815411b","Type":"ContainerStarted","Data":"dd209a94945848def5adb262796dd948a2f973cb17e9a4408c3f221b6c7c5b88"}
Jul 14 20:21:51.967487 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:51.967451    2576 generic.go:356] "Generic (PLEG): container finished" podID="398e6903-d52a-497d-8bc1-7c519815411b" containerID="9d6b7724934e5a4c23dc11b633f1ad8ad476bc0c7f46e1f3a5196e2c53c298de" exitCode=0
Jul 14 20:21:51.967918 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:51.967578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk" event={"ID":"398e6903-d52a-497d-8bc1-7c519815411b","Type":"ContainerDied","Data":"9d6b7724934e5a4c23dc11b633f1ad8ad476bc0c7f46e1f3a5196e2c53c298de"}
Jul 14 20:21:53.110995 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:53.110971    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"
Jul 14 20:21:53.177163 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:53.177135    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/398e6903-d52a-497d-8bc1-7c519815411b-maas-api-service-ca\") pod \"398e6903-d52a-497d-8bc1-7c519815411b\" (UID: \"398e6903-d52a-497d-8bc1-7c519815411b\") "
Jul 14 20:21:53.177534 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:53.177511    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398e6903-d52a-497d-8bc1-7c519815411b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "398e6903-d52a-497d-8bc1-7c519815411b" (UID: "398e6903-d52a-497d-8bc1-7c519815411b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:21:53.278617 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:53.278521    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/398e6903-d52a-497d-8bc1-7c519815411b-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:21:53.980135 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:53.980105    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk"
Jul 14 20:21:53.980298 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:53.980143    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk" event={"ID":"398e6903-d52a-497d-8bc1-7c519815411b","Type":"ContainerDied","Data":"dd209a94945848def5adb262796dd948a2f973cb17e9a4408c3f221b6c7c5b88"}
Jul 14 20:21:53.980298 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:21:53.980194    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd209a94945848def5adb262796dd948a2f973cb17e9a4408c3f221b6c7c5b88"
Jul 14 20:22:03.249564 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:03.249526    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:22:21.594555 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.594513    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"]
Jul 14 20:22:21.595155 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.595135    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398e6903-d52a-497d-8bc1-7c519815411b" containerName="revoke-keys"
Jul 14 20:22:21.595248 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.595158    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="398e6903-d52a-497d-8bc1-7c519815411b" containerName="revoke-keys"
Jul 14 20:22:21.595303 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.595256    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="398e6903-d52a-497d-8bc1-7c519815411b" containerName="revoke-keys"
Jul 14 20:22:21.595303 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.595277    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c151ca-5498-43e0-9898-0030f86fc731" containerName="revoke-keys"
Jul 14 20:22:21.597468 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.597446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"
Jul 14 20:22:21.603223 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.603198    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:22:21.614115 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.614088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"]
Jul 14 20:22:21.744452 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.744418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092ebfb0-72f0-4934-848a-bec28f5a9ef7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7044c372-75zrg\" (UID: \"092ebfb0-72f0-4934-848a-bec28f5a9ef7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"
Jul 14 20:22:21.845889 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.845794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092ebfb0-72f0-4934-848a-bec28f5a9ef7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7044c372-75zrg\" (UID: \"092ebfb0-72f0-4934-848a-bec28f5a9ef7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"
Jul 14 20:22:21.846481 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.846461    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092ebfb0-72f0-4934-848a-bec28f5a9ef7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7044c372-75zrg\" (UID: \"092ebfb0-72f0-4934-848a-bec28f5a9ef7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"
Jul 14 20:22:21.907779 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:21.907750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"
Jul 14 20:22:22.263883 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:22.263857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"]
Jul 14 20:22:22.265210 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:22:22.265175    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092ebfb0_72f0_4934_848a_bec28f5a9ef7.slice/crio-8d5c492bb20b317dd3a710517837b4a0aa4bc26256bbda405c6c994cf6ec91b7 WatchSource:0}: Error finding container 8d5c492bb20b317dd3a710517837b4a0aa4bc26256bbda405c6c994cf6ec91b7: Status 404 returned error can't find the container with id 8d5c492bb20b317dd3a710517837b4a0aa4bc26256bbda405c6c994cf6ec91b7
Jul 14 20:22:23.145034 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:23.145000    2576 generic.go:356] "Generic (PLEG): container finished" podID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerID="7ef9a531059064dacb6b5cc7b870ca02ee44baf17c069cf1111d0e4c51cff479" exitCode=7
Jul 14 20:22:23.145407 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:23.145075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" event={"ID":"092ebfb0-72f0-4934-848a-bec28f5a9ef7","Type":"ContainerDied","Data":"7ef9a531059064dacb6b5cc7b870ca02ee44baf17c069cf1111d0e4c51cff479"}
Jul 14 20:22:23.145407 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:23.145133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" event={"ID":"092ebfb0-72f0-4934-848a-bec28f5a9ef7","Type":"ContainerStarted","Data":"8d5c492bb20b317dd3a710517837b4a0aa4bc26256bbda405c6c994cf6ec91b7"}
Jul 14 20:22:23.145407 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:23.145235    2576 scope.go:117] "RemoveContainer" containerID="7ef9a531059064dacb6b5cc7b870ca02ee44baf17c069cf1111d0e4c51cff479"
Jul 14 20:22:24.152410 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:24.152305    2576 generic.go:356] "Generic (PLEG): container finished" podID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerID="9e3608c9ef9566c8a23d204540a702cfd6f6faaabf8bcc979f50d136596c3283" exitCode=7
Jul 14 20:22:24.152410 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:24.152386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" event={"ID":"092ebfb0-72f0-4934-848a-bec28f5a9ef7","Type":"ContainerDied","Data":"9e3608c9ef9566c8a23d204540a702cfd6f6faaabf8bcc979f50d136596c3283"}
Jul 14 20:22:24.152821 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:24.152445    2576 scope.go:117] "RemoveContainer" containerID="7ef9a531059064dacb6b5cc7b870ca02ee44baf17c069cf1111d0e4c51cff479"
Jul 14 20:22:24.152821 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:24.152631    2576 scope.go:117] "RemoveContainer" containerID="9e3608c9ef9566c8a23d204540a702cfd6f6faaabf8bcc979f50d136596c3283"
Jul 14 20:22:24.152903 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:22:24.152865    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7044c372-75zrg_odh-ai-gateway-infra(092ebfb0-72f0-4934-848a-bec28f5a9ef7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7"
Jul 14 20:22:25.159477 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:25.159444    2576 scope.go:117] "RemoveContainer" containerID="9e3608c9ef9566c8a23d204540a702cfd6f6faaabf8bcc979f50d136596c3283"
Jul 14 20:22:25.159866 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:22:25.159644    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7044c372-75zrg_odh-ai-gateway-infra(092ebfb0-72f0-4934-848a-bec28f5a9ef7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7"
Jul 14 20:22:25.922147 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:25.922117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:22:35.850952 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:35.850916    2576 scope.go:117] "RemoveContainer" containerID="9e3608c9ef9566c8a23d204540a702cfd6f6faaabf8bcc979f50d136596c3283"
Jul 14 20:22:36.221140 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:36.221104    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" event={"ID":"092ebfb0-72f0-4934-848a-bec28f5a9ef7","Type":"ContainerStarted","Data":"9625552d44265053d4a1af1fbd3a7422fb810ff431f134ae9fc5ef06cfb2d257"}
Jul 14 20:22:36.240482 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:36.240431    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" podStartSLOduration=15.240415777 podStartE2EDuration="15.240415777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:36.238455477 +0000 UTC m=+1867.080827672" watchObservedRunningTime="2026-07-14 20:22:36.240415777 +0000 UTC m=+1867.082787973"
Jul 14 20:22:37.228765 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:37.228732    2576 generic.go:356] "Generic (PLEG): container finished" podID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerID="9625552d44265053d4a1af1fbd3a7422fb810ff431f134ae9fc5ef06cfb2d257" exitCode=0
Jul 14 20:22:37.229145 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:37.228808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" event={"ID":"092ebfb0-72f0-4934-848a-bec28f5a9ef7","Type":"ContainerDied","Data":"9625552d44265053d4a1af1fbd3a7422fb810ff431f134ae9fc5ef06cfb2d257"}
Jul 14 20:22:37.229145 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:37.228866    2576 scope.go:117] "RemoveContainer" containerID="9e3608c9ef9566c8a23d204540a702cfd6f6faaabf8bcc979f50d136596c3283"
Jul 14 20:22:37.256635 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:37.256610    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"]
Jul 14 20:22:38.369290 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:38.369264    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"
Jul 14 20:22:38.397109 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:38.397083    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092ebfb0-72f0-4934-848a-bec28f5a9ef7-maas-api-service-ca\") pod \"092ebfb0-72f0-4934-848a-bec28f5a9ef7\" (UID: \"092ebfb0-72f0-4934-848a-bec28f5a9ef7\") "
Jul 14 20:22:38.397442 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:38.397419    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092ebfb0-72f0-4934-848a-bec28f5a9ef7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "092ebfb0-72f0-4934-848a-bec28f5a9ef7" (UID: "092ebfb0-72f0-4934-848a-bec28f5a9ef7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:22:38.497925 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:38.497845    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092ebfb0-72f0-4934-848a-bec28f5a9ef7-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:22:39.243100 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:39.243062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg" event={"ID":"092ebfb0-72f0-4934-848a-bec28f5a9ef7","Type":"ContainerDied","Data":"8d5c492bb20b317dd3a710517837b4a0aa4bc26256bbda405c6c994cf6ec91b7"}
Jul 14 20:22:39.243266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:39.243107    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"
Jul 14 20:22:39.243266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:39.243120    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d5c492bb20b317dd3a710517837b4a0aa4bc26256bbda405c6c994cf6ec91b7"
Jul 14 20:22:39.276874 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:39.276848    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"]
Jul 14 20:22:39.284208 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:39.284187    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-75zrg"]
Jul 14 20:22:39.856575 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:22:39.856545    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" path="/var/lib/kubelet/pods/092ebfb0-72f0-4934-848a-bec28f5a9ef7/volumes"
Jul 14 20:23:25.087442 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:23:25.087404    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:24:31.194713 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:24:31.194637    2576 scope.go:117] "RemoveContainer" containerID="92b26543000a5e84f5d872408926381f15cf6778f566031e3ad62f070d74159f"
Jul 14 20:25:03.421294 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:25:03.421260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:25:11.225654 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:25:11.225617    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:25:20.197120 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:25:20.197085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:25:32.308776 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:25:32.308740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:25:47.823038 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:25:47.823000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:26:29.800918 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:29.800888    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:26:29.803702 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:29.803678    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:26:29.807014 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:29.806989    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:26:29.809868 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:29.809851    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:26:31.140378 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:31.140300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:26:36.904542 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.904510    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"]
Jul 14 20:26:36.904977 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.904916    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.904977 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.904926    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.904977 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.904945    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.904977 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.904951    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.904977 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.904966    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.904977 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.904971    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.905166 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.905050    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.905166 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.905057    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:26:36.908098 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.908080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:36.911754 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.911732    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-08c922cd\"/\"openshift-service-ca.crt\""
Jul 14 20:26:36.911754 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.911747    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-08c922cd\"/\"kube-root-ca.crt\""
Jul 14 20:26:36.912756 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.912738    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-08c922cd\"/\"e2e-lifecycle-model-08c922cd-kserve-self-signed-certs\""
Jul 14 20:26:36.912846 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.912784    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-08c922cd\"/\"default-dockercfg-gzt45\""
Jul 14 20:26:36.926411 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.926388    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"]
Jul 14 20:26:36.962963 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.962928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc97f3d6-8969-432c-a919-ed0ae98b6989-tls-certs\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:36.962963 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.962967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-model-cache\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:36.963188 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.963065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-home\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:36.963188 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.963095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-dshm\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:36.963188 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.963122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-tmp-dir\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:36.963188 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:36.963147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4lhs\" (UniqueName: \"kubernetes.io/projected/fc97f3d6-8969-432c-a919-ed0ae98b6989-kube-api-access-l4lhs\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064246 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc97f3d6-8969-432c-a919-ed0ae98b6989-tls-certs\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064246 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-model-cache\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064529 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-home\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064529 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-dshm\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064529 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-tmp-dir\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064529 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4lhs\" (UniqueName: \"kubernetes.io/projected/fc97f3d6-8969-432c-a919-ed0ae98b6989-kube-api-access-l4lhs\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064808 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-home\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064871 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-model-cache\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.064908 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.064869    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-tmp-dir\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.066636 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.066616    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-dshm\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.066810 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.066793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc97f3d6-8969-432c-a919-ed0ae98b6989-tls-certs\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.075185 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.075163    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4lhs\" (UniqueName: \"kubernetes.io/projected/fc97f3d6-8969-432c-a919-ed0ae98b6989-kube-api-access-l4lhs\") pod \"e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") " pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.218228 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.218197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:37.368294 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.368252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"]
Jul 14 20:26:37.372475 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:26:37.372430    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc97f3d6_8969_432c_a919_ed0ae98b6989.slice/crio-28cfd05d0026247b7265c2133fababd39d426e6505bd6141c56102e0c23bd936 WatchSource:0}: Error finding container 28cfd05d0026247b7265c2133fababd39d426e6505bd6141c56102e0c23bd936: Status 404 returned error can't find the container with id 28cfd05d0026247b7265c2133fababd39d426e6505bd6141c56102e0c23bd936
Jul 14 20:26:37.506782 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.506691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9" event={"ID":"fc97f3d6-8969-432c-a919-ed0ae98b6989","Type":"ContainerStarted","Data":"03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569"}
Jul 14 20:26:37.506782 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.506735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9" event={"ID":"fc97f3d6-8969-432c-a919-ed0ae98b6989","Type":"ContainerStarted","Data":"28cfd05d0026247b7265c2133fababd39d426e6505bd6141c56102e0c23bd936"}
Jul 14 20:26:37.536196 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:37.536145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9" podStartSLOduration=1.5361282539999999 podStartE2EDuration="1.536128254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:37.532809693 +0000 UTC m=+2108.375181890" watchObservedRunningTime="2026-07-14 20:26:37.536128254 +0000 UTC m=+2108.378500450"
Jul 14 20:26:39.600413 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:39.600377    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:26:47.218452 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:47.218419    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:47.218853 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:47.218472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:47.233454 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:47.233427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:47.572855 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:47.572779    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:26:54.914013 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:26:54.913975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:27:12.505034 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:12.504996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:27:18.410364 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:18.410317    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"]
Jul 14 20:27:31.234913 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:31.234881    2576 scope.go:117] "RemoveContainer" containerID="fefd6d0958872e9641492b50b8b7b0a8fa17e80dbc1a20c9f207ff9a6548b67b"
Jul 14 20:27:33.430914 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.430870    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9" podUID="fc97f3d6-8969-432c-a919-ed0ae98b6989" containerName="main" containerID="cri-o://03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569" gracePeriod=45
Jul 14 20:27:33.688795 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.688733    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:27:33.784951 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.784921    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc97f3d6-8969-432c-a919-ed0ae98b6989-tls-certs\") pod \"fc97f3d6-8969-432c-a919-ed0ae98b6989\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") "
Jul 14 20:27:33.785126 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.784998    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-tmp-dir\") pod \"fc97f3d6-8969-432c-a919-ed0ae98b6989\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") "
Jul 14 20:27:33.785126 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-home\") pod \"fc97f3d6-8969-432c-a919-ed0ae98b6989\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") "
Jul 14 20:27:33.785126 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785052    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4lhs\" (UniqueName: \"kubernetes.io/projected/fc97f3d6-8969-432c-a919-ed0ae98b6989-kube-api-access-l4lhs\") pod \"fc97f3d6-8969-432c-a919-ed0ae98b6989\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") "
Jul 14 20:27:33.785126 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-model-cache\") pod \"fc97f3d6-8969-432c-a919-ed0ae98b6989\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") "
Jul 14 20:27:33.785126 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785115    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-dshm\") pod \"fc97f3d6-8969-432c-a919-ed0ae98b6989\" (UID: \"fc97f3d6-8969-432c-a919-ed0ae98b6989\") "
Jul 14 20:27:33.785445 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785260    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc97f3d6-8969-432c-a919-ed0ae98b6989" (UID: "fc97f3d6-8969-432c-a919-ed0ae98b6989"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:27:33.785445 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785333    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-home" (OuterVolumeSpecName: "home") pod "fc97f3d6-8969-432c-a919-ed0ae98b6989" (UID: "fc97f3d6-8969-432c-a919-ed0ae98b6989"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:27:33.785555 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785476    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-home\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:27:33.785555 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785486    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc97f3d6-8969-432c-a919-ed0ae98b6989" (UID: "fc97f3d6-8969-432c-a919-ed0ae98b6989"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:27:33.785555 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.785497    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-tmp-dir\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:27:33.787191 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.787169    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc97f3d6-8969-432c-a919-ed0ae98b6989-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc97f3d6-8969-432c-a919-ed0ae98b6989" (UID: "fc97f3d6-8969-432c-a919-ed0ae98b6989"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:27:33.787294 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.787234    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-dshm" (OuterVolumeSpecName: "dshm") pod "fc97f3d6-8969-432c-a919-ed0ae98b6989" (UID: "fc97f3d6-8969-432c-a919-ed0ae98b6989"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:27:33.787294 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.787244    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc97f3d6-8969-432c-a919-ed0ae98b6989-kube-api-access-l4lhs" (OuterVolumeSpecName: "kube-api-access-l4lhs") pod "fc97f3d6-8969-432c-a919-ed0ae98b6989" (UID: "fc97f3d6-8969-432c-a919-ed0ae98b6989"). InnerVolumeSpecName "kube-api-access-l4lhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:27:33.813917 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.813887    2576 generic.go:356] "Generic (PLEG): container finished" podID="fc97f3d6-8969-432c-a919-ed0ae98b6989" containerID="03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569" exitCode=0
Jul 14 20:27:33.814027 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.813922    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"
Jul 14 20:27:33.814027 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.813930    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9" event={"ID":"fc97f3d6-8969-432c-a919-ed0ae98b6989","Type":"ContainerDied","Data":"03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569"}
Jul 14 20:27:33.814027 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.813975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9" event={"ID":"fc97f3d6-8969-432c-a919-ed0ae98b6989","Type":"ContainerDied","Data":"28cfd05d0026247b7265c2133fababd39d426e6505bd6141c56102e0c23bd936"}
Jul 14 20:27:33.814027 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.813989    2576 scope.go:117] "RemoveContainer" containerID="03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569"
Jul 14 20:27:33.823428 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.823411    2576 scope.go:117] "RemoveContainer" containerID="03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569"
Jul 14 20:27:33.823677 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:27:33.823659    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569\": container with ID starting with 03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569 not found: ID does not exist" containerID="03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569"
Jul 14 20:27:33.823746 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.823689    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569"} err="failed to get container status \"03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569\": rpc error: code = NotFound desc = could not find container \"03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569\": container with ID starting with 03d047188233056ba928cdece114e35d767346386c1e06b03a8067fd593ea569 not found: ID does not exist"
Jul 14 20:27:33.850415 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.850387    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"]
Jul 14 20:27:33.858014 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.857989    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-08c922cd/e2e-lifecycle-model-08c922cd-kserve-7f8c8bd88c-gjxf9"]
Jul 14 20:27:33.886214 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.886186    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-dshm\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:27:33.886214 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.886210    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc97f3d6-8969-432c-a919-ed0ae98b6989-tls-certs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:27:33.886382 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.886221    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4lhs\" (UniqueName: \"kubernetes.io/projected/fc97f3d6-8969-432c-a919-ed0ae98b6989-kube-api-access-l4lhs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:27:33.886382 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:33.886231    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc97f3d6-8969-432c-a919-ed0ae98b6989-model-cache\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:27:35.856876 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:27:35.856837    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc97f3d6-8969-432c-a919-ed0ae98b6989" path="/var/lib/kubelet/pods/fc97f3d6-8969-432c-a919-ed0ae98b6989/volumes"
Jul 14 20:28:10.889488 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:28:10.889445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:28:24.908900 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:28:24.908857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:29:14.591655 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:14.591560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:29:25.304942 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:25.304895    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:29:28.084651 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.084608    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"]
Jul 14 20:29:28.085389 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.085370    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc97f3d6-8969-432c-a919-ed0ae98b6989" containerName="main"
Jul 14 20:29:28.085450 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.085392    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc97f3d6-8969-432c-a919-ed0ae98b6989" containerName="main"
Jul 14 20:29:28.085537 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.085525    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc97f3d6-8969-432c-a919-ed0ae98b6989" containerName="main"
Jul 14 20:29:28.085572 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.085549    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="092ebfb0-72f0-4934-848a-bec28f5a9ef7" containerName="revoke-keys"
Jul 14 20:29:28.089180 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.089158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.092947 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.092903    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e56337\"/\"kube-root-ca.crt\""
Jul 14 20:29:28.093091 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.093038    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e56337\"/\"test-model-e56337-kserve-self-signed-certs\""
Jul 14 20:29:28.093091 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.093071    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e56337\"/\"default-dockercfg-78lm6\""
Jul 14 20:29:28.093198 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.093111    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e56337\"/\"openshift-service-ca.crt\""
Jul 14 20:29:28.098060 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.098038    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"]
Jul 14 20:29:28.120571 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.120539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-tmp-dir\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.120723 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.120583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-home\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.120723 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.120636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-dshm\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.120723 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.120673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-model-cache\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.120723 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.120697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570f4340-d29c-4d80-84b1-eb8441d8f17d-tls-certs\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.120723 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.120719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcdtq\" (UniqueName: \"kubernetes.io/projected/570f4340-d29c-4d80-84b1-eb8441d8f17d-kube-api-access-fcdtq\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221183 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-dshm\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221183 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-model-cache\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221460 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570f4340-d29c-4d80-84b1-eb8441d8f17d-tls-certs\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221460 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcdtq\" (UniqueName: \"kubernetes.io/projected/570f4340-d29c-4d80-84b1-eb8441d8f17d-kube-api-access-fcdtq\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221575 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-tmp-dir\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221575 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-home\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221685 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-model-cache\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221895 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-tmp-dir\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.221895 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.221889    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-home\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.223444 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.223422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-dshm\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.223939 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.223915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570f4340-d29c-4d80-84b1-eb8441d8f17d-tls-certs\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.232412 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.232386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcdtq\" (UniqueName: \"kubernetes.io/projected/570f4340-d29c-4d80-84b1-eb8441d8f17d-kube-api-access-fcdtq\") pod \"test-model-e56337-kserve-56cdcf6f5-r6znx\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") " pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.400909 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.400817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:28.543604 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:28.543583    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"]
Jul 14 20:29:28.545452 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:29:28.545427    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod570f4340_d29c_4d80_84b1_eb8441d8f17d.slice/crio-aef22488165876da9d9c783f370586f3c6e4ce5fd8da5ab3a84bad4e8615feec WatchSource:0}: Error finding container aef22488165876da9d9c783f370586f3c6e4ce5fd8da5ab3a84bad4e8615feec: Status 404 returned error can't find the container with id aef22488165876da9d9c783f370586f3c6e4ce5fd8da5ab3a84bad4e8615feec
Jul 14 20:29:29.423643 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:29.423603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx" event={"ID":"570f4340-d29c-4d80-84b1-eb8441d8f17d","Type":"ContainerStarted","Data":"06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846"}
Jul 14 20:29:29.424043 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:29.423655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx" event={"ID":"570f4340-d29c-4d80-84b1-eb8441d8f17d","Type":"ContainerStarted","Data":"aef22488165876da9d9c783f370586f3c6e4ce5fd8da5ab3a84bad4e8615feec"}
Jul 14 20:29:29.447884 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:29.447840    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx" podStartSLOduration=1.447825568 podStartE2EDuration="1.447825568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:29.447112107 +0000 UTC m=+2280.289484312" watchObservedRunningTime="2026-07-14 20:29:29.447825568 +0000 UTC m=+2280.290197765"
Jul 14 20:29:31.269850 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:31.269816    2576 scope.go:117] "RemoveContainer" containerID="9625552d44265053d4a1af1fbd3a7422fb810ff431f134ae9fc5ef06cfb2d257"
Jul 14 20:29:32.699456 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:32.699414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:29:38.401115 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:38.401081    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:38.401598 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:38.401133    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:38.413219 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:38.413195    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:38.486279 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:38.486249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:29:53.190142 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:29:53.190099    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:30:00.133533 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.133491    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"]
Jul 14 20:30:00.137549 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.137526    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"]
Jul 14 20:30:00.137703 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.137646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"
Jul 14 20:30:00.140115 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.140093    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:30:00.140875 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.140852    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r"]
Jul 14 20:30:00.140966 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.140951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"
Jul 14 20:30:00.144646 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.144619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r"
Jul 14 20:30:00.147536 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.146813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"]
Jul 14 20:30:00.149565 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.149545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"]
Jul 14 20:30:00.152374 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.152326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r"]
Jul 14 20:30:00.152642 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.152614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"
Jul 14 20:30:00.162717 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.162698    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"
Jul 14 20:30:00.200564 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.200535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r"
Jul 14 20:30:00.375889 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.375855    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r"]
Jul 14 20:30:00.377891 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:30:00.377864    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aebc38c_830b_492a_8838_c9b508dfedc2.slice/crio-fdae7a6be2f984656d40d9d8cc84f930311c71248bb90536f99776934f72975d WatchSource:0}: Error finding container fdae7a6be2f984656d40d9d8cc84f930311c71248bb90536f99776934f72975d: Status 404 returned error can't find the container with id fdae7a6be2f984656d40d9d8cc84f930311c71248bb90536f99776934f72975d
Jul 14 20:30:00.518433 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.518402    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"]
Jul 14 20:30:00.521399 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:30:00.521368    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516e751a_4f1d_49ff_af97_08a9223fb763.slice/crio-b247d18cfd6d371ba8e1675e0191b58b07de97afce4af01cdf97ec36b38ee897 WatchSource:0}: Error finding container b247d18cfd6d371ba8e1675e0191b58b07de97afce4af01cdf97ec36b38ee897: Status 404 returned error can't find the container with id b247d18cfd6d371ba8e1675e0191b58b07de97afce4af01cdf97ec36b38ee897
Jul 14 20:30:00.557260 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.557155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"]
Jul 14 20:30:00.559186 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:30:00.559165    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd386d908_6ebc_4913_8a81_53fb9c75197e.slice/crio-70713c47ad606e751145715a0bd69f282d76b7f353439a5e93af1c8acbfa2766 WatchSource:0}: Error finding container 70713c47ad606e751145715a0bd69f282d76b7f353439a5e93af1c8acbfa2766: Status 404 returned error can't find the container with id 70713c47ad606e751145715a0bd69f282d76b7f353439a5e93af1c8acbfa2766
Jul 14 20:30:00.590191 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.590160    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f" event={"ID":"d386d908-6ebc-4913-8a81-53fb9c75197e","Type":"ContainerStarted","Data":"70713c47ad606e751145715a0bd69f282d76b7f353439a5e93af1c8acbfa2766"}
Jul 14 20:30:00.591263 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.591244    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l" event={"ID":"516e751a-4f1d-49ff-af97-08a9223fb763","Type":"ContainerStarted","Data":"b247d18cfd6d371ba8e1675e0191b58b07de97afce4af01cdf97ec36b38ee897"}
Jul 14 20:30:00.592362 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:00.592321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r" event={"ID":"1aebc38c-830b-492a-8838-c9b508dfedc2","Type":"ContainerStarted","Data":"fdae7a6be2f984656d40d9d8cc84f930311c71248bb90536f99776934f72975d"}
Jul 14 20:30:01.599018 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:01.598989    2576 generic.go:356] "Generic (PLEG): container finished" podID="1aebc38c-830b-492a-8838-c9b508dfedc2" containerID="dededc5d98b1f1c54126ee2370523d26c0e687348b6a5959a23f714af68e6cd6" exitCode=0
Jul 14 20:30:01.599461 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:01.599071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r" event={"ID":"1aebc38c-830b-492a-8838-c9b508dfedc2","Type":"ContainerDied","Data":"dededc5d98b1f1c54126ee2370523d26c0e687348b6a5959a23f714af68e6cd6"}
Jul 14 20:30:01.600584 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:01.600559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f" event={"ID":"d386d908-6ebc-4913-8a81-53fb9c75197e","Type":"ContainerStarted","Data":"db69474a5f1bef22a0981b54a2e87d978fb4743a02146efac213a61990732976"}
Jul 14 20:30:01.602134 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:01.602107    2576 generic.go:356] "Generic (PLEG): container finished" podID="516e751a-4f1d-49ff-af97-08a9223fb763" containerID="c7d877221df3d0b92ea66e8b99855529c20304956a52bb9f8183b0bccb6fdd62" exitCode=0
Jul 14 20:30:01.602257 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:01.602162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l" event={"ID":"516e751a-4f1d-49ff-af97-08a9223fb763","Type":"ContainerDied","Data":"c7d877221df3d0b92ea66e8b99855529c20304956a52bb9f8183b0bccb6fdd62"}
Jul 14 20:30:01.649094 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:01.649053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f" podStartSLOduration=1.649038615 podStartE2EDuration="1.649038615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:01.64777939 +0000 UTC m=+2312.490151590" watchObservedRunningTime="2026-07-14 20:30:01.649038615 +0000 UTC m=+2312.491410823"
Jul 14 20:30:02.609287 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:02.609253    2576 generic.go:356] "Generic (PLEG): container finished" podID="d386d908-6ebc-4913-8a81-53fb9c75197e" containerID="db69474a5f1bef22a0981b54a2e87d978fb4743a02146efac213a61990732976" exitCode=0
Jul 14 20:30:02.609704 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:02.609352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f" event={"ID":"d386d908-6ebc-4913-8a81-53fb9c75197e","Type":"ContainerDied","Data":"db69474a5f1bef22a0981b54a2e87d978fb4743a02146efac213a61990732976"}
Jul 14 20:30:02.774589 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:02.774560    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"
Jul 14 20:30:02.777743 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:02.777723    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r"
Jul 14 20:30:03.615492 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:03.615465    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"
Jul 14 20:30:03.615914 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:03.615465    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l" event={"ID":"516e751a-4f1d-49ff-af97-08a9223fb763","Type":"ContainerDied","Data":"b247d18cfd6d371ba8e1675e0191b58b07de97afce4af01cdf97ec36b38ee897"}
Jul 14 20:30:03.615914 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:03.615587    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b247d18cfd6d371ba8e1675e0191b58b07de97afce4af01cdf97ec36b38ee897"
Jul 14 20:30:03.616780 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:03.616757    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r"
Jul 14 20:30:03.616910 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:03.616790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734350-6b95r" event={"ID":"1aebc38c-830b-492a-8838-c9b508dfedc2","Type":"ContainerDied","Data":"fdae7a6be2f984656d40d9d8cc84f930311c71248bb90536f99776934f72975d"}
Jul 14 20:30:03.616910 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:03.616832    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdae7a6be2f984656d40d9d8cc84f930311c71248bb90536f99776934f72975d"
Jul 14 20:30:03.758348 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:03.758314    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"
Jul 14 20:30:04.623616 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:04.623582    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"
Jul 14 20:30:04.623616 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:04.623591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f" event={"ID":"d386d908-6ebc-4913-8a81-53fb9c75197e","Type":"ContainerDied","Data":"70713c47ad606e751145715a0bd69f282d76b7f353439a5e93af1c8acbfa2766"}
Jul 14 20:30:04.624072 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:04.623672    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70713c47ad606e751145715a0bd69f282d76b7f353439a5e93af1c8acbfa2766"
Jul 14 20:30:09.295799 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:09.295765    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"]
Jul 14 20:30:10.512349 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512301    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"]
Jul 14 20:30:10.512736 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512722    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d386d908-6ebc-4913-8a81-53fb9c75197e" containerName="cleanup"
Jul 14 20:30:10.512736 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512737    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d386d908-6ebc-4913-8a81-53fb9c75197e" containerName="cleanup"
Jul 14 20:30:10.512814 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512749    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516e751a-4f1d-49ff-af97-08a9223fb763" containerName="cleanup"
Jul 14 20:30:10.512814 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512755    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="516e751a-4f1d-49ff-af97-08a9223fb763" containerName="cleanup"
Jul 14 20:30:10.512814 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512777    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aebc38c-830b-492a-8838-c9b508dfedc2" containerName="cleanup"
Jul 14 20:30:10.512814 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512784    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aebc38c-830b-492a-8838-c9b508dfedc2" containerName="cleanup"
Jul 14 20:30:10.512932 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512851    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="516e751a-4f1d-49ff-af97-08a9223fb763" containerName="cleanup"
Jul 14 20:30:10.512932 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512858    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d386d908-6ebc-4913-8a81-53fb9c75197e" containerName="cleanup"
Jul 14 20:30:10.512932 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.512865    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aebc38c-830b-492a-8838-c9b508dfedc2" containerName="cleanup"
Jul 14 20:30:10.515969 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.515947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"
Jul 14 20:30:10.519357 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.519314    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:30:10.530678 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.530650    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"]
Jul 14 20:30:10.612720 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.612680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47661ece-4c16-4c07-a3cf-68a17e74e0ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e56337-f82w6\" (UID: \"47661ece-4c16-4c07-a3cf-68a17e74e0ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"
Jul 14 20:30:10.714214 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.714163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47661ece-4c16-4c07-a3cf-68a17e74e0ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e56337-f82w6\" (UID: \"47661ece-4c16-4c07-a3cf-68a17e74e0ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"
Jul 14 20:30:10.714859 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.714839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47661ece-4c16-4c07-a3cf-68a17e74e0ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e56337-f82w6\" (UID: \"47661ece-4c16-4c07-a3cf-68a17e74e0ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"
Jul 14 20:30:10.827478 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:10.827388    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"
Jul 14 20:30:11.181102 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:11.181071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"]
Jul 14 20:30:11.182542 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:30:11.182517    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47661ece_4c16_4c07_a3cf_68a17e74e0ea.slice/crio-470451ede8407ff7abb50025541a951602f7152c464eef3aa6ea38b8ee11c07d WatchSource:0}: Error finding container 470451ede8407ff7abb50025541a951602f7152c464eef3aa6ea38b8ee11c07d: Status 404 returned error can't find the container with id 470451ede8407ff7abb50025541a951602f7152c464eef3aa6ea38b8ee11c07d
Jul 14 20:30:11.663713 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:11.663675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6" event={"ID":"47661ece-4c16-4c07-a3cf-68a17e74e0ea","Type":"ContainerStarted","Data":"46a9864e37f5ed633f340df55c21bb7c9446480d52530f8edfc4d10e281cce19"}
Jul 14 20:30:11.664041 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:11.663738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6" event={"ID":"47661ece-4c16-4c07-a3cf-68a17e74e0ea","Type":"ContainerStarted","Data":"470451ede8407ff7abb50025541a951602f7152c464eef3aa6ea38b8ee11c07d"}
Jul 14 20:30:11.680169 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:11.680116    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6" podStartSLOduration=1.68009846 podStartE2EDuration="1.68009846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:11.679589459 +0000 UTC m=+2322.521961674" watchObservedRunningTime="2026-07-14 20:30:11.68009846 +0000 UTC m=+2322.522470656"
Jul 14 20:30:12.503199 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:12.503160    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:30:12.670563 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:12.670522    2576 generic.go:356] "Generic (PLEG): container finished" podID="47661ece-4c16-4c07-a3cf-68a17e74e0ea" containerID="46a9864e37f5ed633f340df55c21bb7c9446480d52530f8edfc4d10e281cce19" exitCode=0
Jul 14 20:30:12.670930 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:12.670604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6" event={"ID":"47661ece-4c16-4c07-a3cf-68a17e74e0ea","Type":"ContainerDied","Data":"46a9864e37f5ed633f340df55c21bb7c9446480d52530f8edfc4d10e281cce19"}
Jul 14 20:30:13.824222 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:13.824198    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"
Jul 14 20:30:13.943403 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:13.943314    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47661ece-4c16-4c07-a3cf-68a17e74e0ea-maas-api-service-ca\") pod \"47661ece-4c16-4c07-a3cf-68a17e74e0ea\" (UID: \"47661ece-4c16-4c07-a3cf-68a17e74e0ea\") "
Jul 14 20:30:13.943672 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:13.943647    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47661ece-4c16-4c07-a3cf-68a17e74e0ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47661ece-4c16-4c07-a3cf-68a17e74e0ea" (UID: "47661ece-4c16-4c07-a3cf-68a17e74e0ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:30:14.044450 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:14.044417    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47661ece-4c16-4c07-a3cf-68a17e74e0ea-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:14.685391 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:14.685332    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6"
Jul 14 20:30:14.685391 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:14.685370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e56337-f82w6" event={"ID":"47661ece-4c16-4c07-a3cf-68a17e74e0ea","Type":"ContainerDied","Data":"470451ede8407ff7abb50025541a951602f7152c464eef3aa6ea38b8ee11c07d"}
Jul 14 20:30:14.685627 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:14.685427    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="470451ede8407ff7abb50025541a951602f7152c464eef3aa6ea38b8ee11c07d"
Jul 14 20:30:21.015762 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:21.015723    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"]
Jul 14 20:30:21.019033 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:21.018999    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e56337-29734350-mmt5l"]
Jul 14 20:30:21.856513 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:21.856480    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="516e751a-4f1d-49ff-af97-08a9223fb763" path="/var/lib/kubelet/pods/516e751a-4f1d-49ff-af97-08a9223fb763/volumes"
Jul 14 20:30:24.316301 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.316248    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx" podUID="570f4340-d29c-4d80-84b1-eb8441d8f17d" containerName="main" containerID="cri-o://06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846" gracePeriod=45
Jul 14 20:30:24.582644 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.582616    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:30:24.641528 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641494    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570f4340-d29c-4d80-84b1-eb8441d8f17d-tls-certs\") pod \"570f4340-d29c-4d80-84b1-eb8441d8f17d\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") "
Jul 14 20:30:24.641690 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-dshm\") pod \"570f4340-d29c-4d80-84b1-eb8441d8f17d\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") "
Jul 14 20:30:24.641690 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641601    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-model-cache\") pod \"570f4340-d29c-4d80-84b1-eb8441d8f17d\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") "
Jul 14 20:30:24.641690 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-tmp-dir\") pod \"570f4340-d29c-4d80-84b1-eb8441d8f17d\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") "
Jul 14 20:30:24.641851 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641704    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-home\") pod \"570f4340-d29c-4d80-84b1-eb8441d8f17d\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") "
Jul 14 20:30:24.641851 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641754    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcdtq\" (UniqueName: \"kubernetes.io/projected/570f4340-d29c-4d80-84b1-eb8441d8f17d-kube-api-access-fcdtq\") pod \"570f4340-d29c-4d80-84b1-eb8441d8f17d\" (UID: \"570f4340-d29c-4d80-84b1-eb8441d8f17d\") "
Jul 14 20:30:24.641999 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641960    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-home" (OuterVolumeSpecName: "home") pod "570f4340-d29c-4d80-84b1-eb8441d8f17d" (UID: "570f4340-d29c-4d80-84b1-eb8441d8f17d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:24.642075 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-model-cache" (OuterVolumeSpecName: "model-cache") pod "570f4340-d29c-4d80-84b1-eb8441d8f17d" (UID: "570f4340-d29c-4d80-84b1-eb8441d8f17d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:24.642075 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.641985    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "570f4340-d29c-4d80-84b1-eb8441d8f17d" (UID: "570f4340-d29c-4d80-84b1-eb8441d8f17d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:24.642159 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.642113    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-model-cache\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:24.642159 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.642129    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-tmp-dir\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:24.642159 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.642144    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-home\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:24.643825 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.643793    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570f4340-d29c-4d80-84b1-eb8441d8f17d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "570f4340-d29c-4d80-84b1-eb8441d8f17d" (UID: "570f4340-d29c-4d80-84b1-eb8441d8f17d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:30:24.643933 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.643844    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-dshm" (OuterVolumeSpecName: "dshm") pod "570f4340-d29c-4d80-84b1-eb8441d8f17d" (UID: "570f4340-d29c-4d80-84b1-eb8441d8f17d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:24.643933 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.643872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/570f4340-d29c-4d80-84b1-eb8441d8f17d-kube-api-access-fcdtq" (OuterVolumeSpecName: "kube-api-access-fcdtq") pod "570f4340-d29c-4d80-84b1-eb8441d8f17d" (UID: "570f4340-d29c-4d80-84b1-eb8441d8f17d"). InnerVolumeSpecName "kube-api-access-fcdtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:30:24.738440 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.738394    2576 generic.go:356] "Generic (PLEG): container finished" podID="570f4340-d29c-4d80-84b1-eb8441d8f17d" containerID="06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846" exitCode=0
Jul 14 20:30:24.738440 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.738436    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"
Jul 14 20:30:24.738663 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.738454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx" event={"ID":"570f4340-d29c-4d80-84b1-eb8441d8f17d","Type":"ContainerDied","Data":"06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846"}
Jul 14 20:30:24.738663 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.738498    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx" event={"ID":"570f4340-d29c-4d80-84b1-eb8441d8f17d","Type":"ContainerDied","Data":"aef22488165876da9d9c783f370586f3c6e4ce5fd8da5ab3a84bad4e8615feec"}
Jul 14 20:30:24.738663 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.738516    2576 scope.go:117] "RemoveContainer" containerID="06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846"
Jul 14 20:30:24.742914 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.742892    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcdtq\" (UniqueName: \"kubernetes.io/projected/570f4340-d29c-4d80-84b1-eb8441d8f17d-kube-api-access-fcdtq\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:24.742914 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.742912    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570f4340-d29c-4d80-84b1-eb8441d8f17d-tls-certs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:24.743101 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.742922    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570f4340-d29c-4d80-84b1-eb8441d8f17d-dshm\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:24.747854 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.747837    2576 scope.go:117] "RemoveContainer" containerID="06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846"
Jul 14 20:30:24.748115 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:30:24.748095    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846\": container with ID starting with 06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846 not found: ID does not exist" containerID="06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846"
Jul 14 20:30:24.748165 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.748124    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846"} err="failed to get container status \"06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846\": rpc error: code = NotFound desc = could not find container \"06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846\": container with ID starting with 06cd859b511a2451d631dcc4f75d6d9c5634c890364493847db6d47fb58e8846 not found: ID does not exist"
Jul 14 20:30:24.760809 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.760781    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"]
Jul 14 20:30:24.765495 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:24.765475    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e56337/test-model-e56337-kserve-56cdcf6f5-r6znx"]
Jul 14 20:30:25.856724 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:25.856692    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="570f4340-d29c-4d80-84b1-eb8441d8f17d" path="/var/lib/kubelet/pods/570f4340-d29c-4d80-84b1-eb8441d8f17d/volumes"
Jul 14 20:30:27.793499 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:27.793465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:30:36.798286 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.798253    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"]
Jul 14 20:30:36.798726 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.798712    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="570f4340-d29c-4d80-84b1-eb8441d8f17d" containerName="main"
Jul 14 20:30:36.798775 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.798727    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="570f4340-d29c-4d80-84b1-eb8441d8f17d" containerName="main"
Jul 14 20:30:36.798775 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.798741    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47661ece-4c16-4c07-a3cf-68a17e74e0ea" containerName="revoke-keys"
Jul 14 20:30:36.798775 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.798748    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="47661ece-4c16-4c07-a3cf-68a17e74e0ea" containerName="revoke-keys"
Jul 14 20:30:36.798872 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.798826    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="570f4340-d29c-4d80-84b1-eb8441d8f17d" containerName="main"
Jul 14 20:30:36.798872 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.798833    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="47661ece-4c16-4c07-a3cf-68a17e74e0ea" containerName="revoke-keys"
Jul 14 20:30:36.801962 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.801944    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"
Jul 14 20:30:36.804566 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.804544    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:30:36.809693 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.809653    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"]
Jul 14 20:30:36.851487 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.851450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42260474-4ddc-42eb-9fbe-dbbe32607626-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26\" (UID: \"42260474-4ddc-42eb-9fbe-dbbe32607626\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"
Jul 14 20:30:36.952296 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.952258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42260474-4ddc-42eb-9fbe-dbbe32607626-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26\" (UID: \"42260474-4ddc-42eb-9fbe-dbbe32607626\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"
Jul 14 20:30:36.952902 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:36.952882    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42260474-4ddc-42eb-9fbe-dbbe32607626-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26\" (UID: \"42260474-4ddc-42eb-9fbe-dbbe32607626\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"
Jul 14 20:30:37.113095 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:37.113021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"
Jul 14 20:30:37.254167 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:37.254138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"]
Jul 14 20:30:37.255793 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:30:37.255766    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42260474_4ddc_42eb_9fbe_dbbe32607626.slice/crio-827c6b45acbf6422833fdc2f42a303f62b1c702a1f7b8f2511148a9ccda294e0 WatchSource:0}: Error finding container 827c6b45acbf6422833fdc2f42a303f62b1c702a1f7b8f2511148a9ccda294e0: Status 404 returned error can't find the container with id 827c6b45acbf6422833fdc2f42a303f62b1c702a1f7b8f2511148a9ccda294e0
Jul 14 20:30:37.811064 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:37.811027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26" event={"ID":"42260474-4ddc-42eb-9fbe-dbbe32607626","Type":"ContainerStarted","Data":"4b159eb492697ccf98807096d10c9209fbc9997d84dea2e2f1f2d73915dcb497"}
Jul 14 20:30:37.811478 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:37.811086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26" event={"ID":"42260474-4ddc-42eb-9fbe-dbbe32607626","Type":"ContainerStarted","Data":"827c6b45acbf6422833fdc2f42a303f62b1c702a1f7b8f2511148a9ccda294e0"}
Jul 14 20:30:37.826729 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:37.826669    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26" podStartSLOduration=1.826649982 podStartE2EDuration="1.826649982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:37.826185929 +0000 UTC m=+2348.668558126" watchObservedRunningTime="2026-07-14 20:30:37.826649982 +0000 UTC m=+2348.669022179"
Jul 14 20:30:38.817236 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:38.817201    2576 generic.go:356] "Generic (PLEG): container finished" podID="42260474-4ddc-42eb-9fbe-dbbe32607626" containerID="4b159eb492697ccf98807096d10c9209fbc9997d84dea2e2f1f2d73915dcb497" exitCode=0
Jul 14 20:30:38.817643 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:38.817290    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26" event={"ID":"42260474-4ddc-42eb-9fbe-dbbe32607626","Type":"ContainerDied","Data":"4b159eb492697ccf98807096d10c9209fbc9997d84dea2e2f1f2d73915dcb497"}
Jul 14 20:30:39.967183 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:39.967157    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"
Jul 14 20:30:40.080722 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:40.080640    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42260474-4ddc-42eb-9fbe-dbbe32607626-maas-api-service-ca\") pod \"42260474-4ddc-42eb-9fbe-dbbe32607626\" (UID: \"42260474-4ddc-42eb-9fbe-dbbe32607626\") "
Jul 14 20:30:40.080981 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:40.080957    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42260474-4ddc-42eb-9fbe-dbbe32607626-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42260474-4ddc-42eb-9fbe-dbbe32607626" (UID: "42260474-4ddc-42eb-9fbe-dbbe32607626"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:30:40.181945 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:40.181899    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42260474-4ddc-42eb-9fbe-dbbe32607626-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:30:40.834511 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:40.834469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26" event={"ID":"42260474-4ddc-42eb-9fbe-dbbe32607626","Type":"ContainerDied","Data":"827c6b45acbf6422833fdc2f42a303f62b1c702a1f7b8f2511148a9ccda294e0"}
Jul 14 20:30:40.834511 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:40.834501    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26"
Jul 14 20:30:40.834717 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:40.834535    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="827c6b45acbf6422833fdc2f42a303f62b1c702a1f7b8f2511148a9ccda294e0"
Jul 14 20:30:47.494666 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:47.494629    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"]
Jul 14 20:30:47.498513 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:47.498487    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d86aa8-29734350-ndj4f"]
Jul 14 20:30:47.856710 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:47.856619    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d386d908-6ebc-4913-8a81-53fb9c75197e" path="/var/lib/kubelet/pods/d386d908-6ebc-4913-8a81-53fb9c75197e/volumes"
Jul 14 20:30:50.583674 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:30:50.583639    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:31:10.890331 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:10.890292    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:31:23.899557 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:23.899519    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:31:28.559067 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.559029    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"]
Jul 14 20:31:28.559501 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.559487    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42260474-4ddc-42eb-9fbe-dbbe32607626" containerName="revoke-keys"
Jul 14 20:31:28.559501 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.559502    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="42260474-4ddc-42eb-9fbe-dbbe32607626" containerName="revoke-keys"
Jul 14 20:31:28.559598 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.559588    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="42260474-4ddc-42eb-9fbe-dbbe32607626" containerName="revoke-keys"
Jul 14 20:31:28.562763 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.562746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"
Jul 14 20:31:28.565259 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.565236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:31:28.572354 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.572309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"]
Jul 14 20:31:28.656862 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.656830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60e1172-f46b-432a-8d66-e51b0b6c8f85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-16b455-xqsvq\" (UID: \"a60e1172-f46b-432a-8d66-e51b0b6c8f85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"
Jul 14 20:31:28.757490 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.757457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60e1172-f46b-432a-8d66-e51b0b6c8f85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-16b455-xqsvq\" (UID: \"a60e1172-f46b-432a-8d66-e51b0b6c8f85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"
Jul 14 20:31:28.758024 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.758007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60e1172-f46b-432a-8d66-e51b0b6c8f85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-16b455-xqsvq\" (UID: \"a60e1172-f46b-432a-8d66-e51b0b6c8f85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"
Jul 14 20:31:28.873944 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:28.873862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"
Jul 14 20:31:29.013875 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:29.013848    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"]
Jul 14 20:31:29.015657 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:31:29.015632    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60e1172_f46b_432a_8d66_e51b0b6c8f85.slice/crio-c0de8588b8bf912fac4b8d0a4c8bb8834b2b4a7eb4610a518367b4acd6905f23 WatchSource:0}: Error finding container c0de8588b8bf912fac4b8d0a4c8bb8834b2b4a7eb4610a518367b4acd6905f23: Status 404 returned error can't find the container with id c0de8588b8bf912fac4b8d0a4c8bb8834b2b4a7eb4610a518367b4acd6905f23
Jul 14 20:31:29.093486 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:29.093451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq" event={"ID":"a60e1172-f46b-432a-8d66-e51b0b6c8f85","Type":"ContainerStarted","Data":"c0de8588b8bf912fac4b8d0a4c8bb8834b2b4a7eb4610a518367b4acd6905f23"}
Jul 14 20:31:29.840775 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:29.840740    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:31:29.844205 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:29.844182    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:31:29.849820 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:29.849801    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:31:29.853215 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:29.853197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:31:30.099761 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:30.099672    2576 generic.go:356] "Generic (PLEG): container finished" podID="a60e1172-f46b-432a-8d66-e51b0b6c8f85" containerID="e8698ba5d32db6802ddfd4ebcc9f444227f73e6e8c537d38bbf024e218ed1330" exitCode=0
Jul 14 20:31:30.099761 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:30.099723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq" event={"ID":"a60e1172-f46b-432a-8d66-e51b0b6c8f85","Type":"ContainerDied","Data":"e8698ba5d32db6802ddfd4ebcc9f444227f73e6e8c537d38bbf024e218ed1330"}
Jul 14 20:31:31.241799 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:31.241773    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"
Jul 14 20:31:31.381384 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:31.381284    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60e1172-f46b-432a-8d66-e51b0b6c8f85-maas-api-service-ca\") pod \"a60e1172-f46b-432a-8d66-e51b0b6c8f85\" (UID: \"a60e1172-f46b-432a-8d66-e51b0b6c8f85\") "
Jul 14 20:31:31.381680 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:31.381655    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a60e1172-f46b-432a-8d66-e51b0b6c8f85-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a60e1172-f46b-432a-8d66-e51b0b6c8f85" (UID: "a60e1172-f46b-432a-8d66-e51b0b6c8f85"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:31:31.482237 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:31.482195    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60e1172-f46b-432a-8d66-e51b0b6c8f85-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:31:32.112177 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:32.112145    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq"
Jul 14 20:31:32.112177 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:32.112154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-16b455-xqsvq" event={"ID":"a60e1172-f46b-432a-8d66-e51b0b6c8f85","Type":"ContainerDied","Data":"c0de8588b8bf912fac4b8d0a4c8bb8834b2b4a7eb4610a518367b4acd6905f23"}
Jul 14 20:31:32.112421 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:32.112203    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0de8588b8bf912fac4b8d0a4c8bb8834b2b4a7eb4610a518367b4acd6905f23"
Jul 14 20:31:42.988325 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:42.988268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:31:54.935257 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.935161    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"]
Jul 14 20:31:54.935687 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.935673    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60e1172-f46b-432a-8d66-e51b0b6c8f85" containerName="revoke-keys"
Jul 14 20:31:54.935743 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.935689    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60e1172-f46b-432a-8d66-e51b0b6c8f85" containerName="revoke-keys"
Jul 14 20:31:54.935781 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.935758    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60e1172-f46b-432a-8d66-e51b0b6c8f85" containerName="revoke-keys"
Jul 14 20:31:54.939125 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.939103    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"
Jul 14 20:31:54.942014 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.941992    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:31:54.948395 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.948373    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"]
Jul 14 20:31:54.982750 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:54.982722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8144f017-08cf-4786-8874-0d12e644bd08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2\" (UID: \"8144f017-08cf-4786-8874-0d12e644bd08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"
Jul 14 20:31:55.083718 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:55.083678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8144f017-08cf-4786-8874-0d12e644bd08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2\" (UID: \"8144f017-08cf-4786-8874-0d12e644bd08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"
Jul 14 20:31:55.084421 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:55.084398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8144f017-08cf-4786-8874-0d12e644bd08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2\" (UID: \"8144f017-08cf-4786-8874-0d12e644bd08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"
Jul 14 20:31:55.250247 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:55.250215    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"
Jul 14 20:31:55.393441 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:55.393414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"]
Jul 14 20:31:55.395511 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:31:55.395478    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8144f017_08cf_4786_8874_0d12e644bd08.slice/crio-4e241fc3fc59c4493c71262b19c3974904cbacbd79bab34df2f3dbbf932d298c WatchSource:0}: Error finding container 4e241fc3fc59c4493c71262b19c3974904cbacbd79bab34df2f3dbbf932d298c: Status 404 returned error can't find the container with id 4e241fc3fc59c4493c71262b19c3974904cbacbd79bab34df2f3dbbf932d298c
Jul 14 20:31:56.246184 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:56.246149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2" event={"ID":"8144f017-08cf-4786-8874-0d12e644bd08","Type":"ContainerStarted","Data":"946fdbde9557b55b20a6befec21f62a9dc9120763431fd72a4b1de0ec7b16d83"}
Jul 14 20:31:56.246511 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:56.246222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2" event={"ID":"8144f017-08cf-4786-8874-0d12e644bd08","Type":"ContainerStarted","Data":"4e241fc3fc59c4493c71262b19c3974904cbacbd79bab34df2f3dbbf932d298c"}
Jul 14 20:31:56.270135 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:56.270074    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2" podStartSLOduration=2.270051869 podStartE2EDuration="2.270051869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:56.268008035 +0000 UTC m=+2427.110380233" watchObservedRunningTime="2026-07-14 20:31:56.270051869 +0000 UTC m=+2427.112424070"
Jul 14 20:31:57.253248 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:57.253211    2576 generic.go:356] "Generic (PLEG): container finished" podID="8144f017-08cf-4786-8874-0d12e644bd08" containerID="946fdbde9557b55b20a6befec21f62a9dc9120763431fd72a4b1de0ec7b16d83" exitCode=0
Jul 14 20:31:57.253677 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:57.253305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2" event={"ID":"8144f017-08cf-4786-8874-0d12e644bd08","Type":"ContainerDied","Data":"946fdbde9557b55b20a6befec21f62a9dc9120763431fd72a4b1de0ec7b16d83"}
Jul 14 20:31:58.417511 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:58.417484    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"
Jul 14 20:31:58.515356 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:58.515273    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8144f017-08cf-4786-8874-0d12e644bd08-maas-api-service-ca\") pod \"8144f017-08cf-4786-8874-0d12e644bd08\" (UID: \"8144f017-08cf-4786-8874-0d12e644bd08\") "
Jul 14 20:31:58.515611 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:58.515589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8144f017-08cf-4786-8874-0d12e644bd08-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8144f017-08cf-4786-8874-0d12e644bd08" (UID: "8144f017-08cf-4786-8874-0d12e644bd08"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:31:58.616424 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:58.616391    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8144f017-08cf-4786-8874-0d12e644bd08-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.265153 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:59.265121    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2"
Jul 14 20:31:59.265363 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:59.265157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2" event={"ID":"8144f017-08cf-4786-8874-0d12e644bd08","Type":"ContainerDied","Data":"4e241fc3fc59c4493c71262b19c3974904cbacbd79bab34df2f3dbbf932d298c"}
Jul 14 20:31:59.265363 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:31:59.265219    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e241fc3fc59c4493c71262b19c3974904cbacbd79bab34df2f3dbbf932d298c"
Jul 14 20:32:08.296133 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:32:08.296093    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:32:29.702549 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:32:29.702517    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:32:40.492704 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:32:40.492672    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:32:53.707678 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:32:53.707644    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:33:21.215399 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.215362    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"]
Jul 14 20:33:21.215884 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.215779    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8144f017-08cf-4786-8874-0d12e644bd08" containerName="revoke-keys"
Jul 14 20:33:21.215884 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.215790    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8144f017-08cf-4786-8874-0d12e644bd08" containerName="revoke-keys"
Jul 14 20:33:21.215884 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.215871    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8144f017-08cf-4786-8874-0d12e644bd08" containerName="revoke-keys"
Jul 14 20:33:21.218929 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.218912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.223024 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.222999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"auth-test-model-d4143c-kserve-self-signed-certs\""
Jul 14 20:33:21.223145 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.223056    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"kube-root-ca.crt\""
Jul 14 20:33:21.223145 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.223064    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"default-dockercfg-fslzx\""
Jul 14 20:33:21.223263 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.223182    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"openshift-service-ca.crt\""
Jul 14 20:33:21.236764 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.236738    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"]
Jul 14 20:33:21.278354 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.278305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-tmp-dir\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.278519 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.278366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57b3872-fae3-4462-b6b2-e3a5965e3135-tls-certs\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.278519 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.278420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-model-cache\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.278595 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.278538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-dshm\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.278595 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.278569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-home\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.278595 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.278587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvc8l\" (UniqueName: \"kubernetes.io/projected/d57b3872-fae3-4462-b6b2-e3a5965e3135-kube-api-access-vvc8l\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380015 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.379979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-dshm\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380015 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-home\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380231 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvc8l\" (UniqueName: \"kubernetes.io/projected/d57b3872-fae3-4462-b6b2-e3a5965e3135-kube-api-access-vvc8l\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380231 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-tmp-dir\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380231 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57b3872-fae3-4462-b6b2-e3a5965e3135-tls-certs\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380231 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-model-cache\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380548 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380525    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-home\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380612 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-tmp-dir\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.380612 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.380576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-model-cache\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.382280 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.382260    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-dshm\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.382622 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.382601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57b3872-fae3-4462-b6b2-e3a5965e3135-tls-certs\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.389621 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.389597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvc8l\" (UniqueName: \"kubernetes.io/projected/d57b3872-fae3-4462-b6b2-e3a5965e3135-kube-api-access-vvc8l\") pod \"auth-test-model-d4143c-kserve-68696885b7-dzvz7\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") " pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.529518 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.529361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:21.666316 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.666291    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"]
Jul 14 20:33:21.667874 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:33:21.667848    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd57b3872_fae3_4462_b6b2_e3a5965e3135.slice/crio-82486b7107a5f3427988778a9eb6b3c3f7184f3c42fa80176f7d1830c303b048 WatchSource:0}: Error finding container 82486b7107a5f3427988778a9eb6b3c3f7184f3c42fa80176f7d1830c303b048: Status 404 returned error can't find the container with id 82486b7107a5f3427988778a9eb6b3c3f7184f3c42fa80176f7d1830c303b048
Jul 14 20:33:21.725986 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:21.725950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7" event={"ID":"d57b3872-fae3-4462-b6b2-e3a5965e3135","Type":"ContainerStarted","Data":"82486b7107a5f3427988778a9eb6b3c3f7184f3c42fa80176f7d1830c303b048"}
Jul 14 20:33:22.734441 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:22.734350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7" event={"ID":"d57b3872-fae3-4462-b6b2-e3a5965e3135","Type":"ContainerStarted","Data":"6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da"}
Jul 14 20:33:24.930429 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:24.930359    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7" podStartSLOduration=3.93031056 podStartE2EDuration="3.93031056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:22.754136352 +0000 UTC m=+2513.596508551" watchObservedRunningTime="2026-07-14 20:33:24.93031056 +0000 UTC m=+2515.772682758"
Jul 14 20:33:24.932348 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:24.932315    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:33:31.530313 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:31.530274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:31.530313 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:31.530322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:31.542844 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:31.542821    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:31.796542 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:31.796466    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:33:40.624685 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:40.624640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:33:57.729031 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:33:57.728998    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:34:13.708507 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:34:13.708471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:34:32.708543 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:34:32.708507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:34:50.308432 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:34:50.308393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:35:03.392467 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:03.392389    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:35:20.692670 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:20.692627    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:35:26.479903 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:26.479869    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"]
Jul 14 20:35:33.692468 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.692436    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"]
Jul 14 20:35:33.699054 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.698999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.701895 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.701860    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"default-dockercfg-4hzc6\""
Jul 14 20:35:33.702661 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.702634    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"openshift-service-ca.crt\""
Jul 14 20:35:33.702791 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.702662    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"sub-test-model-e55cd3-kserve-self-signed-certs\""
Jul 14 20:35:33.702791 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.702762    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"kube-root-ca.crt\""
Jul 14 20:35:33.708660 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.708637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"]
Jul 14 20:35:33.801716 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.801679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-dshm\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.801901 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.801744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cdz9\" (UniqueName: \"kubernetes.io/projected/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-kube-api-access-7cdz9\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.801901 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.801779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tmp-dir\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.801901 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.801813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tls-certs\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.801901 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.801846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-home\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.802066 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.801933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-model-cache\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.902623 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.902586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tls-certs\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.902623 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.902628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-home\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.902825 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.902658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-model-cache\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.902825 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.902705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-dshm\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.902825 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.902739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cdz9\" (UniqueName: \"kubernetes.io/projected/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-kube-api-access-7cdz9\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.902825 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.902768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tmp-dir\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.903164 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.903128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-home\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.903252 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.903127    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-model-cache\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.903252 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.903172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tmp-dir\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.904999 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.904976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-dshm\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.905261 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.905246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tls-certs\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:33.912202 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:33.912183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cdz9\" (UniqueName: \"kubernetes.io/projected/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-kube-api-access-7cdz9\") pod \"sub-test-model-e55cd3-kserve-6df64745c-c2lxh\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") " pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:34.010365 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:34.010305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:34.152227 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:34.152195    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"]
Jul 14 20:35:34.153950 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:35:34.153922    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88898fd0_5b6d_462c_8d2e_0bc2aaeb72bd.slice/crio-a83df9276be65bba01b838870d010b7b34defbc6e575cc4cba80485940d9778e WatchSource:0}: Error finding container a83df9276be65bba01b838870d010b7b34defbc6e575cc4cba80485940d9778e: Status 404 returned error can't find the container with id a83df9276be65bba01b838870d010b7b34defbc6e575cc4cba80485940d9778e
Jul 14 20:35:34.474520 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:34.474473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh" event={"ID":"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd","Type":"ContainerStarted","Data":"e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab"}
Jul 14 20:35:34.474729 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:34.474530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh" event={"ID":"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd","Type":"ContainerStarted","Data":"a83df9276be65bba01b838870d010b7b34defbc6e575cc4cba80485940d9778e"}
Jul 14 20:35:34.499320 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:34.499273    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh" podStartSLOduration=1.4992572929999999 podStartE2EDuration="1.499257293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:35:34.498147158 +0000 UTC m=+2645.340519357" watchObservedRunningTime="2026-07-14 20:35:34.499257293 +0000 UTC m=+2645.341629532"
Jul 14 20:35:39.705653 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:39.705616    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:35:41.500284 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.500237    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7" podUID="d57b3872-fae3-4462-b6b2-e3a5965e3135" containerName="main" containerID="cri-o://6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da" gracePeriod=45
Jul 14 20:35:41.758238 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.758183    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:35:41.877989 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.877961    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57b3872-fae3-4462-b6b2-e3a5965e3135-tls-certs\") pod \"d57b3872-fae3-4462-b6b2-e3a5965e3135\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") "
Jul 14 20:35:41.878151 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878016    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-dshm\") pod \"d57b3872-fae3-4462-b6b2-e3a5965e3135\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") "
Jul 14 20:35:41.878151 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878042    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-tmp-dir\") pod \"d57b3872-fae3-4462-b6b2-e3a5965e3135\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") "
Jul 14 20:35:41.878229 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878153    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-home\") pod \"d57b3872-fae3-4462-b6b2-e3a5965e3135\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") "
Jul 14 20:35:41.878274 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878262    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvc8l\" (UniqueName: \"kubernetes.io/projected/d57b3872-fae3-4462-b6b2-e3a5965e3135-kube-api-access-vvc8l\") pod \"d57b3872-fae3-4462-b6b2-e3a5965e3135\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") "
Jul 14 20:35:41.878316 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878292    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d57b3872-fae3-4462-b6b2-e3a5965e3135" (UID: "d57b3872-fae3-4462-b6b2-e3a5965e3135"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:41.878395 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-model-cache\") pod \"d57b3872-fae3-4462-b6b2-e3a5965e3135\" (UID: \"d57b3872-fae3-4462-b6b2-e3a5965e3135\") "
Jul 14 20:35:41.878447 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878418    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-home" (OuterVolumeSpecName: "home") pod "d57b3872-fae3-4462-b6b2-e3a5965e3135" (UID: "d57b3872-fae3-4462-b6b2-e3a5965e3135"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:41.878648 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878625    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-tmp-dir\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.878648 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878632    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-model-cache" (OuterVolumeSpecName: "model-cache") pod "d57b3872-fae3-4462-b6b2-e3a5965e3135" (UID: "d57b3872-fae3-4462-b6b2-e3a5965e3135"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:41.878833 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.878646    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-home\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.880350 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.880298    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57b3872-fae3-4462-b6b2-e3a5965e3135-kube-api-access-vvc8l" (OuterVolumeSpecName: "kube-api-access-vvc8l") pod "d57b3872-fae3-4462-b6b2-e3a5965e3135" (UID: "d57b3872-fae3-4462-b6b2-e3a5965e3135"). InnerVolumeSpecName "kube-api-access-vvc8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:35:41.880461 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.880319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57b3872-fae3-4462-b6b2-e3a5965e3135-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d57b3872-fae3-4462-b6b2-e3a5965e3135" (UID: "d57b3872-fae3-4462-b6b2-e3a5965e3135"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:35:41.880461 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.880387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-dshm" (OuterVolumeSpecName: "dshm") pod "d57b3872-fae3-4462-b6b2-e3a5965e3135" (UID: "d57b3872-fae3-4462-b6b2-e3a5965e3135"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:41.979561 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.979522    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvc8l\" (UniqueName: \"kubernetes.io/projected/d57b3872-fae3-4462-b6b2-e3a5965e3135-kube-api-access-vvc8l\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.979561 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.979552    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-model-cache\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.979561 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.979561    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57b3872-fae3-4462-b6b2-e3a5965e3135-tls-certs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.979561 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:41.979569    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57b3872-fae3-4462-b6b2-e3a5965e3135-dshm\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:35:42.519910 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.519874    2576 generic.go:356] "Generic (PLEG): container finished" podID="d57b3872-fae3-4462-b6b2-e3a5965e3135" containerID="6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da" exitCode=0
Jul 14 20:35:42.520297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.519918    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"
Jul 14 20:35:42.520297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.519969    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7" event={"ID":"d57b3872-fae3-4462-b6b2-e3a5965e3135","Type":"ContainerDied","Data":"6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da"}
Jul 14 20:35:42.520297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.520022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7" event={"ID":"d57b3872-fae3-4462-b6b2-e3a5965e3135","Type":"ContainerDied","Data":"82486b7107a5f3427988778a9eb6b3c3f7184f3c42fa80176f7d1830c303b048"}
Jul 14 20:35:42.520297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.520048    2576 scope.go:117] "RemoveContainer" containerID="6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da"
Jul 14 20:35:42.533087 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.533005    2576 scope.go:117] "RemoveContainer" containerID="6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da"
Jul 14 20:35:42.533735 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:35:42.533708    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da\": container with ID starting with 6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da not found: ID does not exist" containerID="6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da"
Jul 14 20:35:42.533850 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.533738    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da"} err="failed to get container status \"6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da\": rpc error: code = NotFound desc = could not find container \"6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da\": container with ID starting with 6851db5633915afdfb3998e4f36145f6bf2181427648fc7958385c4f3f2dc7da not found: ID does not exist"
Jul 14 20:35:42.545713 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.545692    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"]
Jul 14 20:35:42.551047 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:42.551023    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/auth-test-model-d4143c-kserve-68696885b7-dzvz7"]
Jul 14 20:35:43.856692 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:43.856656    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57b3872-fae3-4462-b6b2-e3a5965e3135" path="/var/lib/kubelet/pods/d57b3872-fae3-4462-b6b2-e3a5965e3135/volumes"
Jul 14 20:35:44.011432 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:44.011396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:44.011623 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:44.011475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:44.024235 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:44.024201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:35:44.543415 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:35:44.543387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:36:01.804928 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:01.804892    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:36:26.891227 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:26.891151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:36:29.884003 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:29.883973    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:36:29.886996 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:29.886974    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:36:29.893727 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:29.893707    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:36:29.896686 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:29.896671    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxh4w_09694e64-0629-4763-b878-aa61824440d9/ovn-acl-logging/0.log"
Jul 14 20:36:31.353591 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:31.353562    2576 scope.go:117] "RemoveContainer" containerID="c7d877221df3d0b92ea66e8b99855529c20304956a52bb9f8183b0bccb6fdd62"
Jul 14 20:36:31.362528 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:31.362502    2576 scope.go:117] "RemoveContainer" containerID="db69474a5f1bef22a0981b54a2e87d978fb4743a02146efac213a61990732976"
Jul 14 20:36:32.930297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:32.930259    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"]
Jul 14 20:36:46.901488 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:46.901454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:36:47.951624 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:47.951587    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh" podUID="88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" containerName="main" containerID="cri-o://e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab" gracePeriod=45
Jul 14 20:36:48.212028 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.211970    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:36:48.291948 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.291921    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tls-certs\") pod \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") "
Jul 14 20:36:48.292099 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.291958    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cdz9\" (UniqueName: \"kubernetes.io/projected/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-kube-api-access-7cdz9\") pod \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") "
Jul 14 20:36:48.292099 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.292024    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-dshm\") pod \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") "
Jul 14 20:36:48.292099 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.292046    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tmp-dir\") pod \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") "
Jul 14 20:36:48.292243 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.292133    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-home\") pod \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") "
Jul 14 20:36:48.292243 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.292159    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-model-cache\") pod \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\" (UID: \"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd\") "
Jul 14 20:36:48.292454 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.292423    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" (UID: "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:48.292584 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.292506    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-home" (OuterVolumeSpecName: "home") pod "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" (UID: "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:48.292584 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.292516    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" (UID: "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:48.294218 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.294193    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-dshm" (OuterVolumeSpecName: "dshm") pod "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" (UID: "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:48.294313 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.294293    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-kube-api-access-7cdz9" (OuterVolumeSpecName: "kube-api-access-7cdz9") pod "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" (UID: "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd"). InnerVolumeSpecName "kube-api-access-7cdz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:36:48.294381 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.294315    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" (UID: "88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:36:48.393652 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.393620    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-dshm\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:36:48.393652 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.393646    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tmp-dir\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:36:48.393652 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.393656    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-home\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:36:48.393875 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.393666    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-model-cache\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:36:48.393875 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.393674    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-tls-certs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:36:48.393875 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.393683    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cdz9\" (UniqueName: \"kubernetes.io/projected/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd-kube-api-access-7cdz9\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:36:48.896814 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.896771    2576 generic.go:356] "Generic (PLEG): container finished" podID="88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" containerID="e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab" exitCode=0
Jul 14 20:36:48.896996 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.896836    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"
Jul 14 20:36:48.896996 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.896839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh" event={"ID":"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd","Type":"ContainerDied","Data":"e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab"}
Jul 14 20:36:48.896996 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.896879    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh" event={"ID":"88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd","Type":"ContainerDied","Data":"a83df9276be65bba01b838870d010b7b34defbc6e575cc4cba80485940d9778e"}
Jul 14 20:36:48.896996 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.896901    2576 scope.go:117] "RemoveContainer" containerID="e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab"
Jul 14 20:36:48.907068 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.907050    2576 scope.go:117] "RemoveContainer" containerID="e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab"
Jul 14 20:36:48.907294 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:36:48.907279    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab\": container with ID starting with e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab not found: ID does not exist" containerID="e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab"
Jul 14 20:36:48.907404 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.907301    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab"} err="failed to get container status \"e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab\": rpc error: code = NotFound desc = could not find container \"e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab\": container with ID starting with e5dc1a7c28f6ccae4f54fa3577959b056ac8fb625b009944828d82ea18eed8ab not found: ID does not exist"
Jul 14 20:36:48.920671 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.920649    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"]
Jul 14 20:36:48.928243 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:48.928221    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/sub-test-model-e55cd3-kserve-6df64745c-c2lxh"]
Jul 14 20:36:49.856665 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:49.856628    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" path="/var/lib/kubelet/pods/88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd/volumes"
Jul 14 20:36:59.201272 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:36:59.201234    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:37:29.002001 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.001970    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"]
Jul 14 20:37:29.004265 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.002421    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" containerName="main"
Jul 14 20:37:29.004265 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.002433    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" containerName="main"
Jul 14 20:37:29.004265 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.002447    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57b3872-fae3-4462-b6b2-e3a5965e3135" containerName="main"
Jul 14 20:37:29.004265 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.002452    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57b3872-fae3-4462-b6b2-e3a5965e3135" containerName="main"
Jul 14 20:37:29.004265 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.002509    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88898fd0-5b6d-462c-8d2e-0bc2aaeb72bd" containerName="main"
Jul 14 20:37:29.004265 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.002519    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57b3872-fae3-4462-b6b2-e3a5965e3135" containerName="main"
Jul 14 20:37:29.005502 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.005482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.008055 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.008032    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"kube-root-ca.crt\""
Jul 14 20:37:29.008140 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.008036    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"openshift-service-ca.crt\""
Jul 14 20:37:29.008970 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.008951    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"default-dockercfg-fslzx\""
Jul 14 20:37:29.009040 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.008996    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"rate-test-model-d4143c-kserve-self-signed-certs\""
Jul 14 20:37:29.016890 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.016866    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"]
Jul 14 20:37:29.067297 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.067258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rsgp\" (UniqueName: \"kubernetes.io/projected/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-kube-api-access-6rsgp\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.067489 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.067364    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tls-certs\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.067489 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.067400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-model-cache\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.067489 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.067425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-dshm\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.067489 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.067447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tmp-dir\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.067683 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.067555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-home\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169012 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.168977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-home\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169012 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rsgp\" (UniqueName: \"kubernetes.io/projected/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-kube-api-access-6rsgp\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169274 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tls-certs\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169274 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-model-cache\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169274 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-dshm\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169274 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tmp-dir\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169528 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-home\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169575 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-model-cache\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.169643 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.169623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tmp-dir\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.171301 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.171280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-dshm\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.171646 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.171630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tls-certs\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.178264 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.178246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rsgp\" (UniqueName: \"kubernetes.io/projected/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-kube-api-access-6rsgp\") pod \"rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") " pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.315637 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.315562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:29.460192 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:29.460165    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"]
Jul 14 20:37:29.462140 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:37:29.462102    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8480f4f_1dbf_42ca_9100_89c1d1c6c513.slice/crio-54419e42f09aba2531e7004532ab69705c2d0f52b7a6705d4ea3b2566b35522c WatchSource:0}: Error finding container 54419e42f09aba2531e7004532ab69705c2d0f52b7a6705d4ea3b2566b35522c: Status 404 returned error can't find the container with id 54419e42f09aba2531e7004532ab69705c2d0f52b7a6705d4ea3b2566b35522c
Jul 14 20:37:30.119029 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:30.118982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd" event={"ID":"d8480f4f-1dbf-42ca-9100-89c1d1c6c513","Type":"ContainerStarted","Data":"ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d"}
Jul 14 20:37:30.119422 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:30.119039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd" event={"ID":"d8480f4f-1dbf-42ca-9100-89c1d1c6c513","Type":"ContainerStarted","Data":"54419e42f09aba2531e7004532ab69705c2d0f52b7a6705d4ea3b2566b35522c"}
Jul 14 20:37:30.137908 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:30.137864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd" podStartSLOduration=2.137849204 podStartE2EDuration="2.137849204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:37:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:37:30.137161042 +0000 UTC m=+2760.979533241" watchObservedRunningTime="2026-07-14 20:37:30.137849204 +0000 UTC m=+2760.980221400"
Jul 14 20:37:33.694944 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:33.694906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:37:39.316546 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:39.316500    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:39.316947 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:39.316565    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:39.331750 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:39.331724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:40.187069 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:40.187039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:37:50.712472 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:37:50.712437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:38:07.411027 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:07.410942    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:38:15.041073 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:15.041041    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"]
Jul 14 20:38:16.069296 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.069252    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8524-140590132648112"]
Jul 14 20:38:16.073031 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.073006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:16.077461 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.077438    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7zqjm\""
Jul 14 20:38:16.087823 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.087801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132648112"]
Jul 14 20:38:16.204252 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.204215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5wfs\" (UniqueName: \"kubernetes.io/projected/159700e6-2938-4ee5-a768-f000ff5e6488-kube-api-access-h5wfs\") pod \"test-curl-8524-140590132648112\" (UID: \"159700e6-2938-4ee5-a768-f000ff5e6488\") " pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:16.305614 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.305578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5wfs\" (UniqueName: \"kubernetes.io/projected/159700e6-2938-4ee5-a768-f000ff5e6488-kube-api-access-h5wfs\") pod \"test-curl-8524-140590132648112\" (UID: \"159700e6-2938-4ee5-a768-f000ff5e6488\") " pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:16.314842 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.314807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5wfs\" (UniqueName: \"kubernetes.io/projected/159700e6-2938-4ee5-a768-f000ff5e6488-kube-api-access-h5wfs\") pod \"test-curl-8524-140590132648112\" (UID: \"159700e6-2938-4ee5-a768-f000ff5e6488\") " pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:16.383451 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.383366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:16.520544 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.520516    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132648112"]
Jul 14 20:38:16.522728 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:38:16.522699    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod159700e6_2938_4ee5_a768_f000ff5e6488.slice/crio-96e98243beb70dc6e87a8dd4b6e14c12cddf65b5c1b620a7a68aadcc7ec90ab9 WatchSource:0}: Error finding container 96e98243beb70dc6e87a8dd4b6e14c12cddf65b5c1b620a7a68aadcc7ec90ab9: Status 404 returned error can't find the container with id 96e98243beb70dc6e87a8dd4b6e14c12cddf65b5c1b620a7a68aadcc7ec90ab9
Jul 14 20:38:16.524562 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:16.524539    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:38:17.378790 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:17.378757    2576 generic.go:356] "Generic (PLEG): container finished" podID="159700e6-2938-4ee5-a768-f000ff5e6488" containerID="b2001df31b18e44142b12b92029f0a05d46d52029ab606e4ba976d1a941800ab" exitCode=0
Jul 14 20:38:17.379152 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:17.378845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132648112" event={"ID":"159700e6-2938-4ee5-a768-f000ff5e6488","Type":"ContainerDied","Data":"b2001df31b18e44142b12b92029f0a05d46d52029ab606e4ba976d1a941800ab"}
Jul 14 20:38:17.379152 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:17.378885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132648112" event={"ID":"159700e6-2938-4ee5-a768-f000ff5e6488","Type":"ContainerStarted","Data":"96e98243beb70dc6e87a8dd4b6e14c12cddf65b5c1b620a7a68aadcc7ec90ab9"}
Jul 14 20:38:18.530843 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:18.530818    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:18.569193 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:18.569164    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8524-140590132648112_159700e6-2938-4ee5-a768-f000ff5e6488/test-curl-8524-140590132648112/0.log"
Jul 14 20:38:18.593881 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:18.593854    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8524-140590132648112"]
Jul 14 20:38:18.598188 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:18.598167    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8524-140590132648112"]
Jul 14 20:38:18.624971 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:18.624945    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5wfs\" (UniqueName: \"kubernetes.io/projected/159700e6-2938-4ee5-a768-f000ff5e6488-kube-api-access-h5wfs\") pod \"159700e6-2938-4ee5-a768-f000ff5e6488\" (UID: \"159700e6-2938-4ee5-a768-f000ff5e6488\") "
Jul 14 20:38:18.626991 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:18.626966    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/159700e6-2938-4ee5-a768-f000ff5e6488-kube-api-access-h5wfs" (OuterVolumeSpecName: "kube-api-access-h5wfs") pod "159700e6-2938-4ee5-a768-f000ff5e6488" (UID: "159700e6-2938-4ee5-a768-f000ff5e6488"). InnerVolumeSpecName "kube-api-access-h5wfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:18.726151 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:18.726109    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5wfs\" (UniqueName: \"kubernetes.io/projected/159700e6-2938-4ee5-a768-f000ff5e6488-kube-api-access-h5wfs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:19.394254 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:19.394217    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:19.394450 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:19.394272    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96e98243beb70dc6e87a8dd4b6e14c12cddf65b5c1b620a7a68aadcc7ec90ab9"
Jul 14 20:38:19.404839 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:38:19.404808    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8524-140590132648112\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="159700e6-2938-4ee5-a768-f000ff5e6488" pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:19.855190 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:38:19.855154    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8524-140590132648112\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="159700e6-2938-4ee5-a768-f000ff5e6488" pod="opendatahub/test-curl-8524-140590132648112"
Jul 14 20:38:19.856658 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:19.856636    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="159700e6-2938-4ee5-a768-f000ff5e6488" path="/var/lib/kubelet/pods/159700e6-2938-4ee5-a768-f000ff5e6488/volumes"
Jul 14 20:38:22.387402 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.387366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:38:22.435467 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.435436    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:22.435876 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.435863    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="159700e6-2938-4ee5-a768-f000ff5e6488" containerName="test-curl-8524-140590132648112"
Jul 14 20:38:22.435927 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.435878    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="159700e6-2938-4ee5-a768-f000ff5e6488" containerName="test-curl-8524-140590132648112"
Jul 14 20:38:22.435967 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.435939    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="159700e6-2938-4ee5-a768-f000ff5e6488" containerName="test-curl-8524-140590132648112"
Jul 14 20:38:22.439253 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.439226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:22.441873 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.441853    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7zqjm\""
Jul 14 20:38:22.445900 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.445878    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:22.561564 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.561529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njvb4\" (UniqueName: \"kubernetes.io/projected/72a349d4-3f9e-46e2-bfec-a54934f812c1-kube-api-access-njvb4\") pod \"test-curl-8524-140590132510768\" (UID: \"72a349d4-3f9e-46e2-bfec-a54934f812c1\") " pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:22.662647 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.662563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njvb4\" (UniqueName: \"kubernetes.io/projected/72a349d4-3f9e-46e2-bfec-a54934f812c1-kube-api-access-njvb4\") pod \"test-curl-8524-140590132510768\" (UID: \"72a349d4-3f9e-46e2-bfec-a54934f812c1\") " pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:22.671800 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.671767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njvb4\" (UniqueName: \"kubernetes.io/projected/72a349d4-3f9e-46e2-bfec-a54934f812c1-kube-api-access-njvb4\") pod \"test-curl-8524-140590132510768\" (UID: \"72a349d4-3f9e-46e2-bfec-a54934f812c1\") " pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:22.749475 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.749440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:22.886707 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:22.886682    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:22.888774 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:38:22.888748    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72a349d4_3f9e_46e2_bfec_a54934f812c1.slice/crio-6fc600ab4dae4387738e7c5ec8e9bc2760efe2ea97f94b988f6d145ec9a95fc3 WatchSource:0}: Error finding container 6fc600ab4dae4387738e7c5ec8e9bc2760efe2ea97f94b988f6d145ec9a95fc3: Status 404 returned error can't find the container with id 6fc600ab4dae4387738e7c5ec8e9bc2760efe2ea97f94b988f6d145ec9a95fc3
Jul 14 20:38:23.417380 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:23.417323    2576 generic.go:356] "Generic (PLEG): container finished" podID="72a349d4-3f9e-46e2-bfec-a54934f812c1" containerID="a47e735bde268e0c6c51a7389a9e6dc41f02ae591e589055e6b719838c1bdacd" exitCode=0
Jul 14 20:38:23.417763 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:23.417386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132510768" event={"ID":"72a349d4-3f9e-46e2-bfec-a54934f812c1","Type":"ContainerDied","Data":"a47e735bde268e0c6c51a7389a9e6dc41f02ae591e589055e6b719838c1bdacd"}
Jul 14 20:38:23.417763 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:23.417429    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132510768" event={"ID":"72a349d4-3f9e-46e2-bfec-a54934f812c1","Type":"ContainerStarted","Data":"6fc600ab4dae4387738e7c5ec8e9bc2760efe2ea97f94b988f6d145ec9a95fc3"}
Jul 14 20:38:24.560609 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.560583    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:24.583088 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.583063    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8524-140590132510768_72a349d4-3f9e-46e2-bfec-a54934f812c1/test-curl-8524-140590132510768/0.log"
Jul 14 20:38:24.609780 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.609747    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:24.613723 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.613699    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:24.681908 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.681821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njvb4\" (UniqueName: \"kubernetes.io/projected/72a349d4-3f9e-46e2-bfec-a54934f812c1-kube-api-access-njvb4\") pod \"72a349d4-3f9e-46e2-bfec-a54934f812c1\" (UID: \"72a349d4-3f9e-46e2-bfec-a54934f812c1\") "
Jul 14 20:38:24.683861 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.683832    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a349d4-3f9e-46e2-bfec-a54934f812c1-kube-api-access-njvb4" (OuterVolumeSpecName: "kube-api-access-njvb4") pod "72a349d4-3f9e-46e2-bfec-a54934f812c1" (UID: "72a349d4-3f9e-46e2-bfec-a54934f812c1"). InnerVolumeSpecName "kube-api-access-njvb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:24.737620 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.737589    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:24.738030 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.738015    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a349d4-3f9e-46e2-bfec-a54934f812c1" containerName="test-curl-8524-140590132510768"
Jul 14 20:38:24.738030 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.738030    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a349d4-3f9e-46e2-bfec-a54934f812c1" containerName="test-curl-8524-140590132510768"
Jul 14 20:38:24.738165 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.738103    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a349d4-3f9e-46e2-bfec-a54934f812c1" containerName="test-curl-8524-140590132510768"
Jul 14 20:38:24.741065 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.741046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:24.746660 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.746632    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:24.782725 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.782700    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njvb4\" (UniqueName: \"kubernetes.io/projected/72a349d4-3f9e-46e2-bfec-a54934f812c1-kube-api-access-njvb4\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:24.884134 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.884102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwrf\" (UniqueName: \"kubernetes.io/projected/3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af-kube-api-access-hfwrf\") pod \"test-curl-8524-140590132510768\" (UID: \"3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af\") " pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:24.985467 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.985430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwrf\" (UniqueName: \"kubernetes.io/projected/3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af-kube-api-access-hfwrf\") pod \"test-curl-8524-140590132510768\" (UID: \"3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af\") " pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:24.995160 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:24.995133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwrf\" (UniqueName: \"kubernetes.io/projected/3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af-kube-api-access-hfwrf\") pod \"test-curl-8524-140590132510768\" (UID: \"3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af\") " pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:25.051070 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:25.051040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:25.185093 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:25.185070    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:25.186752 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:38:25.186721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a8f3a73_d3ee_4ea1_b7de_cd7b34d5e8af.slice/crio-2f990d1e9463682ec7708e4f43a754827d4e3df994cd0bae2cfea3688c3ec23a WatchSource:0}: Error finding container 2f990d1e9463682ec7708e4f43a754827d4e3df994cd0bae2cfea3688c3ec23a: Status 404 returned error can't find the container with id 2f990d1e9463682ec7708e4f43a754827d4e3df994cd0bae2cfea3688c3ec23a
Jul 14 20:38:25.431797 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:25.431709    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132510768" event={"ID":"3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af","Type":"ContainerStarted","Data":"2f990d1e9463682ec7708e4f43a754827d4e3df994cd0bae2cfea3688c3ec23a"}
Jul 14 20:38:25.433195 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:25.433173    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fc600ab4dae4387738e7c5ec8e9bc2760efe2ea97f94b988f6d145ec9a95fc3"
Jul 14 20:38:25.433321 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:25.433220    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:25.445644 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:25.445613    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-8524-140590132510768" oldPodUID="72a349d4-3f9e-46e2-bfec-a54934f812c1" podUID="3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af"
Jul 14 20:38:25.864087 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:25.864051    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a349d4-3f9e-46e2-bfec-a54934f812c1" path="/var/lib/kubelet/pods/72a349d4-3f9e-46e2-bfec-a54934f812c1/volumes"
Jul 14 20:38:26.440788 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:26.440756    2576 generic.go:356] "Generic (PLEG): container finished" podID="3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af" containerID="419a2df220c7a6bcf18ed37d4b5d9e29b7ceae8667a9f1c6044549c4b3170606" exitCode=0
Jul 14 20:38:26.440965 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:26.440844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132510768" event={"ID":"3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af","Type":"ContainerDied","Data":"419a2df220c7a6bcf18ed37d4b5d9e29b7ceae8667a9f1c6044549c4b3170606"}
Jul 14 20:38:27.579229 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.579205    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:27.599759 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.599727    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8524-140590132510768_3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af/test-curl-8524-140590132510768/0.log"
Jul 14 20:38:27.624838 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.624798    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:27.628452 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.628417    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8524-140590132510768"]
Jul 14 20:38:27.709819 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.709719    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfwrf\" (UniqueName: \"kubernetes.io/projected/3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af-kube-api-access-hfwrf\") pod \"3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af\" (UID: \"3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af\") "
Jul 14 20:38:27.711804 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.711761    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af-kube-api-access-hfwrf" (OuterVolumeSpecName: "kube-api-access-hfwrf") pod "3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af" (UID: "3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af"). InnerVolumeSpecName "kube-api-access-hfwrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:27.810495 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.810461    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfwrf\" (UniqueName: \"kubernetes.io/projected/3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af-kube-api-access-hfwrf\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:27.859121 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:27.859078    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af" path="/var/lib/kubelet/pods/3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af/volumes"
Jul 14 20:38:28.452655 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:28.452624    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132510768"
Jul 14 20:38:28.452655 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:28.452652    2576 scope.go:117] "RemoveContainer" containerID="419a2df220c7a6bcf18ed37d4b5d9e29b7ceae8667a9f1c6044549c4b3170606"
Jul 14 20:38:30.060724 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.060668    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd" podUID="d8480f4f-1dbf-42ca-9100-89c1d1c6c513" containerName="main" containerID="cri-o://ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d" gracePeriod=45
Jul 14 20:38:30.176685 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.176648    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd" podUID="d8480f4f-1dbf-42ca-9100-89c1d1c6c513" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": dial tcp 10.132.0.64:8000: connect: connection refused"
Jul 14 20:38:30.324673 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.324615    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:38:30.435069 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-home\") pod \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") "
Jul 14 20:38:30.435246 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435092    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-model-cache\") pod \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") "
Jul 14 20:38:30.435246 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435117    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-dshm\") pod \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") "
Jul 14 20:38:30.435246 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435194    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rsgp\" (UniqueName: \"kubernetes.io/projected/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-kube-api-access-6rsgp\") pod \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") "
Jul 14 20:38:30.435246 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tmp-dir\") pod \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") "
Jul 14 20:38:30.435514 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435247    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tls-certs\") pod \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\" (UID: \"d8480f4f-1dbf-42ca-9100-89c1d1c6c513\") "
Jul 14 20:38:30.435514 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435324    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-home" (OuterVolumeSpecName: "home") pod "d8480f4f-1dbf-42ca-9100-89c1d1c6c513" (UID: "d8480f4f-1dbf-42ca-9100-89c1d1c6c513"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:30.435514 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435419    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8480f4f-1dbf-42ca-9100-89c1d1c6c513" (UID: "d8480f4f-1dbf-42ca-9100-89c1d1c6c513"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:30.435692 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8480f4f-1dbf-42ca-9100-89c1d1c6c513" (UID: "d8480f4f-1dbf-42ca-9100-89c1d1c6c513"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:30.435692 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435679    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-model-cache\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:30.435804 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435699    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tmp-dir\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:30.435804 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.435713    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-home\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:30.437889 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.437848    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8480f4f-1dbf-42ca-9100-89c1d1c6c513" (UID: "d8480f4f-1dbf-42ca-9100-89c1d1c6c513"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:38:30.438017 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.437961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-dshm" (OuterVolumeSpecName: "dshm") pod "d8480f4f-1dbf-42ca-9100-89c1d1c6c513" (UID: "d8480f4f-1dbf-42ca-9100-89c1d1c6c513"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:30.438111 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.438079    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-kube-api-access-6rsgp" (OuterVolumeSpecName: "kube-api-access-6rsgp") pod "d8480f4f-1dbf-42ca-9100-89c1d1c6c513" (UID: "d8480f4f-1dbf-42ca-9100-89c1d1c6c513"). InnerVolumeSpecName "kube-api-access-6rsgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:30.446891 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.446873    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:30.447411 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.447390    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8480f4f-1dbf-42ca-9100-89c1d1c6c513" containerName="main"
Jul 14 20:38:30.447411 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.447412    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8480f4f-1dbf-42ca-9100-89c1d1c6c513" containerName="main"
Jul 14 20:38:30.447569 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.447442    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af" containerName="test-curl-8524-140590132510768"
Jul 14 20:38:30.447569 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.447453    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af" containerName="test-curl-8524-140590132510768"
Jul 14 20:38:30.447569 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.447561    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8480f4f-1dbf-42ca-9100-89c1d1c6c513" containerName="main"
Jul 14 20:38:30.447724 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.447575    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8f3a73-d3ee-4ea1-b7de-cd7b34d5e8af" containerName="test-curl-8524-140590132510768"
Jul 14 20:38:30.451042 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.451028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:30.453595 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.453576    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7zqjm\""
Jul 14 20:38:30.456194 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.456170    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:30.466240 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.466212    2576 generic.go:356] "Generic (PLEG): container finished" podID="d8480f4f-1dbf-42ca-9100-89c1d1c6c513" containerID="ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d" exitCode=0
Jul 14 20:38:30.466363 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.466272    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"
Jul 14 20:38:30.466363 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.466305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd" event={"ID":"d8480f4f-1dbf-42ca-9100-89c1d1c6c513","Type":"ContainerDied","Data":"ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d"}
Jul 14 20:38:30.466489 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.466375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd" event={"ID":"d8480f4f-1dbf-42ca-9100-89c1d1c6c513","Type":"ContainerDied","Data":"54419e42f09aba2531e7004532ab69705c2d0f52b7a6705d4ea3b2566b35522c"}
Jul 14 20:38:30.466489 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.466402    2576 scope.go:117] "RemoveContainer" containerID="ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d"
Jul 14 20:38:30.477540 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.477521    2576 scope.go:117] "RemoveContainer" containerID="ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d"
Jul 14 20:38:30.477810 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:38:30.477792    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d\": container with ID starting with ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d not found: ID does not exist" containerID="ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d"
Jul 14 20:38:30.477870 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.477817    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d"} err="failed to get container status \"ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d\": rpc error: code = NotFound desc = could not find container \"ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d\": container with ID starting with ea204e7b093b72f8513b06c84deae7bceeb909f3814a0273e60ca776ebb8605d not found: ID does not exist"
Jul 14 20:38:30.489222 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.489195    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"]
Jul 14 20:38:30.494022 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.494000    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/rate-test-model-d4143c-kserve-5c4c77cd75-jjvfd"]
Jul 14 20:38:30.536193 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.536176    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-dshm\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:30.536193 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.536196    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rsgp\" (UniqueName: \"kubernetes.io/projected/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-kube-api-access-6rsgp\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:30.536326 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.536206    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8480f4f-1dbf-42ca-9100-89c1d1c6c513-tls-certs\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:30.637649 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.637572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2lw\" (UniqueName: \"kubernetes.io/projected/998a0eb0-67de-4494-b161-0335bdfc3a09-kube-api-access-jg2lw\") pod \"test-curl-8524-140590132511776\" (UID: \"998a0eb0-67de-4494-b161-0335bdfc3a09\") " pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:30.738605 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.738570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2lw\" (UniqueName: \"kubernetes.io/projected/998a0eb0-67de-4494-b161-0335bdfc3a09-kube-api-access-jg2lw\") pod \"test-curl-8524-140590132511776\" (UID: \"998a0eb0-67de-4494-b161-0335bdfc3a09\") " pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:30.747717 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.747686    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2lw\" (UniqueName: \"kubernetes.io/projected/998a0eb0-67de-4494-b161-0335bdfc3a09-kube-api-access-jg2lw\") pod \"test-curl-8524-140590132511776\" (UID: \"998a0eb0-67de-4494-b161-0335bdfc3a09\") " pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:30.769166 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.769144    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:30.915506 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:30.915414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:30.921370 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:38:30.921329    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod998a0eb0_67de_4494_b161_0335bdfc3a09.slice/crio-30f02eecc452930917548db3f5e5e57d76be2da1c2c3caff38ce113923b3c801 WatchSource:0}: Error finding container 30f02eecc452930917548db3f5e5e57d76be2da1c2c3caff38ce113923b3c801: Status 404 returned error can't find the container with id 30f02eecc452930917548db3f5e5e57d76be2da1c2c3caff38ce113923b3c801
Jul 14 20:38:31.473459 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:31.473370    2576 generic.go:356] "Generic (PLEG): container finished" podID="998a0eb0-67de-4494-b161-0335bdfc3a09" containerID="08a0c3365ec605ab031cebfed856e19633329e0e323c9e5341db1b069b542c07" exitCode=0
Jul 14 20:38:31.473807 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:31.473492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132511776" event={"ID":"998a0eb0-67de-4494-b161-0335bdfc3a09","Type":"ContainerDied","Data":"08a0c3365ec605ab031cebfed856e19633329e0e323c9e5341db1b069b542c07"}
Jul 14 20:38:31.473807 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:31.473518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132511776" event={"ID":"998a0eb0-67de-4494-b161-0335bdfc3a09","Type":"ContainerStarted","Data":"30f02eecc452930917548db3f5e5e57d76be2da1c2c3caff38ce113923b3c801"}
Jul 14 20:38:31.856751 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:31.856670    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8480f4f-1dbf-42ca-9100-89c1d1c6c513" path="/var/lib/kubelet/pods/d8480f4f-1dbf-42ca-9100-89c1d1c6c513/volumes"
Jul 14 20:38:32.621252 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.621228    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:32.644168 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.644137    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8524-140590132511776_998a0eb0-67de-4494-b161-0335bdfc3a09/test-curl-8524-140590132511776/0.log"
Jul 14 20:38:32.655380 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.655327    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg2lw\" (UniqueName: \"kubernetes.io/projected/998a0eb0-67de-4494-b161-0335bdfc3a09-kube-api-access-jg2lw\") pod \"998a0eb0-67de-4494-b161-0335bdfc3a09\" (UID: \"998a0eb0-67de-4494-b161-0335bdfc3a09\") "
Jul 14 20:38:32.657360 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.657311    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/998a0eb0-67de-4494-b161-0335bdfc3a09-kube-api-access-jg2lw" (OuterVolumeSpecName: "kube-api-access-jg2lw") pod "998a0eb0-67de-4494-b161-0335bdfc3a09" (UID: "998a0eb0-67de-4494-b161-0335bdfc3a09"). InnerVolumeSpecName "kube-api-access-jg2lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:32.669729 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.669703    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:32.676317 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.676297    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:32.756646 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.756586    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg2lw\" (UniqueName: \"kubernetes.io/projected/998a0eb0-67de-4494-b161-0335bdfc3a09-kube-api-access-jg2lw\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:32.866620 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.866587    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"]
Jul 14 20:38:32.866996 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.866983    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998a0eb0-67de-4494-b161-0335bdfc3a09" containerName="test-curl-8524-140590132511776"
Jul 14 20:38:32.867050 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.866998    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="998a0eb0-67de-4494-b161-0335bdfc3a09" containerName="test-curl-8524-140590132511776"
Jul 14 20:38:32.867130 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.867072    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="998a0eb0-67de-4494-b161-0335bdfc3a09" containerName="test-curl-8524-140590132511776"
Jul 14 20:38:32.870254 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.870238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"
Jul 14 20:38:32.872724 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.872708    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:38:32.878716 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.878691    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"]
Jul 14 20:38:32.958824 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:32.958789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d104e-0b06-4cda-803a-3a517167ecea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t\" (UID: \"fb1d104e-0b06-4cda-803a-3a517167ecea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"
Jul 14 20:38:33.060150 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.060057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d104e-0b06-4cda-803a-3a517167ecea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t\" (UID: \"fb1d104e-0b06-4cda-803a-3a517167ecea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"
Jul 14 20:38:33.060783 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.060764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d104e-0b06-4cda-803a-3a517167ecea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t\" (UID: \"fb1d104e-0b06-4cda-803a-3a517167ecea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"
Jul 14 20:38:33.182494 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.182459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"
Jul 14 20:38:33.320680 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.320655    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"]
Jul 14 20:38:33.323119 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:38:33.323094    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1d104e_0b06_4cda_803a_3a517167ecea.slice/crio-33ac928757448d195d84cc4ab47acddcf8331267e9ce8cc734f89f4f87ab1c9a WatchSource:0}: Error finding container 33ac928757448d195d84cc4ab47acddcf8331267e9ce8cc734f89f4f87ab1c9a: Status 404 returned error can't find the container with id 33ac928757448d195d84cc4ab47acddcf8331267e9ce8cc734f89f4f87ab1c9a
Jul 14 20:38:33.486305 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.486269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t" event={"ID":"fb1d104e-0b06-4cda-803a-3a517167ecea","Type":"ContainerStarted","Data":"33ac928757448d195d84cc4ab47acddcf8331267e9ce8cc734f89f4f87ab1c9a"}
Jul 14 20:38:33.487533 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.487509    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:33.487611 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.487559    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30f02eecc452930917548db3f5e5e57d76be2da1c2c3caff38ce113923b3c801"
Jul 14 20:38:33.499197 ip-10-0-139-187 kubenswrapper[2576]: E0714 20:38:33.499172    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8524-140590132511776\" is forbidden: User \"system:node:ip-10-0-139-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-187.ec2.internal' and this object" podUID="998a0eb0-67de-4494-b161-0335bdfc3a09" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:33.856571 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:33.856537    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="998a0eb0-67de-4494-b161-0335bdfc3a09" path="/var/lib/kubelet/pods/998a0eb0-67de-4494-b161-0335bdfc3a09/volumes"
Jul 14 20:38:34.494305 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:34.494274    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb1d104e-0b06-4cda-803a-3a517167ecea" containerID="aab0a4c502789e10b9e7f1012635b5f6bbf19c0811aa705dc650d8acd1bd3dba" exitCode=0
Jul 14 20:38:34.494482 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:34.494328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t" event={"ID":"fb1d104e-0b06-4cda-803a-3a517167ecea","Type":"ContainerDied","Data":"aab0a4c502789e10b9e7f1012635b5f6bbf19c0811aa705dc650d8acd1bd3dba"}
Jul 14 20:38:35.650192 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:35.650167    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"
Jul 14 20:38:35.683830 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:35.683791    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d104e-0b06-4cda-803a-3a517167ecea-maas-api-service-ca\") pod \"fb1d104e-0b06-4cda-803a-3a517167ecea\" (UID: \"fb1d104e-0b06-4cda-803a-3a517167ecea\") "
Jul 14 20:38:35.684114 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:35.684094    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb1d104e-0b06-4cda-803a-3a517167ecea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb1d104e-0b06-4cda-803a-3a517167ecea" (UID: "fb1d104e-0b06-4cda-803a-3a517167ecea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:38:35.684192 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:35.684167    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d104e-0b06-4cda-803a-3a517167ecea-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:38:36.506056 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:36.506022    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t"
Jul 14 20:38:36.506214 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:36.506070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t" event={"ID":"fb1d104e-0b06-4cda-803a-3a517167ecea","Type":"ContainerDied","Data":"33ac928757448d195d84cc4ab47acddcf8331267e9ce8cc734f89f4f87ab1c9a"}
Jul 14 20:38:36.506214 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:36.506116    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33ac928757448d195d84cc4ab47acddcf8331267e9ce8cc734f89f4f87ab1c9a"
Jul 14 20:38:46.798925 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:46.798881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:38:59.097991 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.097957    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"]
Jul 14 20:38:59.098419 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.098405    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1d104e-0b06-4cda-803a-3a517167ecea" containerName="revoke-keys"
Jul 14 20:38:59.098478 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.098420    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1d104e-0b06-4cda-803a-3a517167ecea" containerName="revoke-keys"
Jul 14 20:38:59.098519 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.098496    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1d104e-0b06-4cda-803a-3a517167ecea" containerName="revoke-keys"
Jul 14 20:38:59.101747 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.101728    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"
Jul 14 20:38:59.104179 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.104144    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:38:59.110986 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.110947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"]
Jul 14 20:38:59.187798 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.187763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e34535-6e4e-4b63-8b42-0e8d15fc0052-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2\" (UID: \"36e34535-6e4e-4b63-8b42-0e8d15fc0052\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"
Jul 14 20:38:59.289168 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.289125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e34535-6e4e-4b63-8b42-0e8d15fc0052-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2\" (UID: \"36e34535-6e4e-4b63-8b42-0e8d15fc0052\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"
Jul 14 20:38:59.289776 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.289755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e34535-6e4e-4b63-8b42-0e8d15fc0052-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2\" (UID: \"36e34535-6e4e-4b63-8b42-0e8d15fc0052\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"
Jul 14 20:38:59.413741 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.413662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"
Jul 14 20:38:59.558025 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.558000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"]
Jul 14 20:38:59.560656 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:38:59.560613    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e34535_6e4e_4b63_8b42_0e8d15fc0052.slice/crio-318f9844ebe18b24e79bc562f347c025d031400b7ce843bf4851769f5e46a87e WatchSource:0}: Error finding container 318f9844ebe18b24e79bc562f347c025d031400b7ce843bf4851769f5e46a87e: Status 404 returned error can't find the container with id 318f9844ebe18b24e79bc562f347c025d031400b7ce843bf4851769f5e46a87e
Jul 14 20:38:59.636100 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:38:59.636069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2" event={"ID":"36e34535-6e4e-4b63-8b42-0e8d15fc0052","Type":"ContainerStarted","Data":"318f9844ebe18b24e79bc562f347c025d031400b7ce843bf4851769f5e46a87e"}
Jul 14 20:39:00.643270 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:00.643181    2576 generic.go:356] "Generic (PLEG): container finished" podID="36e34535-6e4e-4b63-8b42-0e8d15fc0052" containerID="387baed26ad357ee59aae87e16956d33d66819029de315e696d1c6d15058d9cb" exitCode=0
Jul 14 20:39:00.643664 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:00.643272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2" event={"ID":"36e34535-6e4e-4b63-8b42-0e8d15fc0052","Type":"ContainerDied","Data":"387baed26ad357ee59aae87e16956d33d66819029de315e696d1c6d15058d9cb"}
Jul 14 20:39:01.786490 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:01.786461    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"
Jul 14 20:39:01.911733 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:01.911662    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e34535-6e4e-4b63-8b42-0e8d15fc0052-maas-api-service-ca\") pod \"36e34535-6e4e-4b63-8b42-0e8d15fc0052\" (UID: \"36e34535-6e4e-4b63-8b42-0e8d15fc0052\") "
Jul 14 20:39:01.911992 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:01.911970    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36e34535-6e4e-4b63-8b42-0e8d15fc0052-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36e34535-6e4e-4b63-8b42-0e8d15fc0052" (UID: "36e34535-6e4e-4b63-8b42-0e8d15fc0052"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:39:02.012706 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:02.012674    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e34535-6e4e-4b63-8b42-0e8d15fc0052-maas-api-service-ca\") on node \"ip-10-0-139-187.ec2.internal\" DevicePath \"\""
Jul 14 20:39:02.655430 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:02.655398    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2"
Jul 14 20:39:02.655611 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:02.655432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2" event={"ID":"36e34535-6e4e-4b63-8b42-0e8d15fc0052","Type":"ContainerDied","Data":"318f9844ebe18b24e79bc562f347c025d031400b7ce843bf4851769f5e46a87e"}
Jul 14 20:39:02.655611 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:02.655508    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="318f9844ebe18b24e79bc562f347c025d031400b7ce843bf4851769f5e46a87e"
Jul 14 20:39:13.099383 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:13.099349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-flggk"]
Jul 14 20:39:30.806632 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:30.806546    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gtw96_43a764fb-7684-4078-a6fd-b6007174a14a/manager/0.log"
Jul 14 20:39:30.925045 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:30.925010    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vvzjq_ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4/manager/0.log"
Jul 14 20:39:31.212048 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:31.212025    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tz6mx_68bea68f-6400-456f-adfe-be7848d0dc4a/server/0.log"
Jul 14 20:39:31.345828 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:31.345801    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nkpkv_6e83348f-ec90-4853-818f-d5aac5f5e3f4/manager/0.log"
Jul 14 20:39:31.742779 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:31.742748    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-r4922_227d786e-94c4-481b-980e-b518e1c55d2c/manager/0.log"
Jul 14 20:39:31.757472 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:31.757443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-r4922_227d786e-94c4-481b-980e-b518e1c55d2c/copy-manifests/0.log"
Jul 14 20:39:32.407827 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:32.407803    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734350-6b95r_1aebc38c-830b-492a-8838-c9b508dfedc2/cleanup/0.log"
Jul 14 20:39:32.531560 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:32.531529    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-c7cbf2c9-wgksk_398e6903-d52a-497d-8bc1-7c519815411b/revoke-keys/0.log"
Jul 14 20:39:32.783792 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:32.783765    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-16b455-xqsvq_a60e1172-f46b-432a-8d66-e51b0b6c8f85/revoke-keys/0.log"
Jul 14 20:39:32.909084 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:32.909053    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-ad0405-wrjf2_8144f017-08cf-4786-8874-0d12e644bd08/revoke-keys/0.log"
Jul 14 20:39:33.159088 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:33.159011    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-e56337-f82w6_47661ece-4c16-4c07-a3cf-68a17e74e0ea/revoke-keys/0.log"
Jul 14 20:39:33.283119 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:33.283092    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-d86aa8-slv26_42260474-4ddc-42eb-9fbe-dbbe32607626/revoke-keys/0.log"
Jul 14 20:39:33.794087 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:33.794050    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-e55cd3-swr2t_fb1d104e-0b06-4cda-803a-3a517167ecea/revoke-keys/0.log"
Jul 14 20:39:33.915206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:33.915174    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-d4143c-w4db2_36e34535-6e4e-4b63-8b42-0e8d15fc0052/revoke-keys/0.log"
Jul 14 20:39:34.042822 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:34.042793    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-nrmpz_93c2cd53-af3f-499b-93d9-120a8fdeaaac/postgres/0.log"
Jul 14 20:39:35.574827 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:35.574794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-99qjk_2fc97411-93d8-46d5-bbe2-b1d568b09704/manager/0.log"
Jul 14 20:39:35.727103 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:35.727076    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mf464_8526164c-fa62-4696-b309-7fb703cdc99d/manager/0.log"
Jul 14 20:39:35.979022 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:35.978990    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wj45r_097b6613-281a-4f0f-a869-65ac9fce6823/registry-server/0.log"
Jul 14 20:39:36.118015 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:36.117985    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6d4s9_d34a2427-1ebc-4b71-ba60-2716422f91c6/manager/0.log"
Jul 14 20:39:36.258148 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:36.258069    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-flggk_f9422a48-080a-496f-a5a9-3057c7375d7c/limitador/0.log"
Jul 14 20:39:36.384910 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:36.384878    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cbxpp_642ba76a-015f-4c1a-a501-03eeb9e93839/manager/0.log"
Jul 14 20:39:37.034933 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:37.034901    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-dlp8r_da15a176-2566-49df-b22e-316cb1ddf585/kube-auth-proxy/0.log"
Jul 14 20:39:37.540110 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:37.540080    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-kcx54_8fc4773d-be92-4320-b9ca-dbc05b4d9211/payload-processing/0.log"
Jul 14 20:39:38.148206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:38.148176    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jd9jk_c34c4f36-2ff2-4203-b04a-317a0bd101b5/main/0.log"
Jul 14 20:39:38.520253 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:38.520201    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4fsct_aa3297e4-84da-4175-a895-78fcd5163574/main/0.log"
Jul 14 20:39:46.488235 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:46.488205    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c2g72_8a3952e8-d7e4-4aa5-bad1-5a5fd530ed4f/global-pull-secret-syncer/0.log"
Jul 14 20:39:46.630050 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:46.630011    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lpdd2_33b4da87-cfc0-47c5-82d0-2413a5d3c1b1/konnectivity-agent/0.log"
Jul 14 20:39:46.700855 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:46.700826    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-187.ec2.internal_d48ced1008c46a99937ed2f0f9a90832/haproxy/0.log"
Jul 14 20:39:51.839664 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:51.839628    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-99qjk_2fc97411-93d8-46d5-bbe2-b1d568b09704/manager/0.log"
Jul 14 20:39:51.866889 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:51.866858    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mf464_8526164c-fa62-4696-b309-7fb703cdc99d/manager/0.log"
Jul 14 20:39:51.940127 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:51.940096    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wj45r_097b6613-281a-4f0f-a869-65ac9fce6823/registry-server/0.log"
Jul 14 20:39:52.090173 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:52.090083    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6d4s9_d34a2427-1ebc-4b71-ba60-2716422f91c6/manager/0.log"
Jul 14 20:39:52.119958 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:52.119934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-flggk_f9422a48-080a-496f-a5a9-3057c7375d7c/limitador/0.log"
Jul 14 20:39:52.189899 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:52.189865    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cbxpp_642ba76a-015f-4c1a-a501-03eeb9e93839/manager/0.log"
Jul 14 20:39:54.353681 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.353655    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d9d4bc989-8kkbw_2188428a-0b7d-4e98-b043-69f18ea36416/metrics-server/0.log"
Jul 14 20:39:54.387720 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.387674    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-xwjss_ec99a656-cdb1-424a-941c-1db016871616/monitoring-plugin/0.log"
Jul 14 20:39:54.432377 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.432348    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8f4nd_59789efe-d225-48c7-818b-a7f43484c6af/node-exporter/0.log"
Jul 14 20:39:54.457605 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.457568    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8f4nd_59789efe-d225-48c7-818b-a7f43484c6af/kube-rbac-proxy/0.log"
Jul 14 20:39:54.481602 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.481578    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8f4nd_59789efe-d225-48c7-818b-a7f43484c6af/init-textfile/0.log"
Jul 14 20:39:54.667439 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.667359    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-d5mxq_abe4257d-6933-4faf-abb2-f3c424405b49/kube-rbac-proxy-main/0.log"
Jul 14 20:39:54.701507 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.701470    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-d5mxq_abe4257d-6933-4faf-abb2-f3c424405b49/kube-rbac-proxy-self/0.log"
Jul 14 20:39:54.745747 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.745710    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-d5mxq_abe4257d-6933-4faf-abb2-f3c424405b49/openshift-state-metrics/0.log"
Jul 14 20:39:54.789677 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.789655    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93cabaa0-103c-4830-96e9-80ce0526371b/prometheus/0.log"
Jul 14 20:39:54.818983 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.818962    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93cabaa0-103c-4830-96e9-80ce0526371b/config-reloader/0.log"
Jul 14 20:39:54.842547 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.842528    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93cabaa0-103c-4830-96e9-80ce0526371b/thanos-sidecar/0.log"
Jul 14 20:39:54.869561 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.869542    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93cabaa0-103c-4830-96e9-80ce0526371b/kube-rbac-proxy-web/0.log"
Jul 14 20:39:54.897793 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.897774    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93cabaa0-103c-4830-96e9-80ce0526371b/kube-rbac-proxy/0.log"
Jul 14 20:39:54.922146 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.922072    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93cabaa0-103c-4830-96e9-80ce0526371b/kube-rbac-proxy-thanos/0.log"
Jul 14 20:39:54.947585 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:54.947561    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93cabaa0-103c-4830-96e9-80ce0526371b/init-config-reloader/0.log"
Jul 14 20:39:55.149206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:55.149175    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf586b875-98jkc_a9897332-8cde-4642-bd84-500024ba84e2/thanos-query/0.log"
Jul 14 20:39:55.181315 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:55.181244    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf586b875-98jkc_a9897332-8cde-4642-bd84-500024ba84e2/kube-rbac-proxy-web/0.log"
Jul 14 20:39:55.207040 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:55.207010    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf586b875-98jkc_a9897332-8cde-4642-bd84-500024ba84e2/kube-rbac-proxy/0.log"
Jul 14 20:39:55.255105 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:55.255076    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf586b875-98jkc_a9897332-8cde-4642-bd84-500024ba84e2/prom-label-proxy/0.log"
Jul 14 20:39:55.280501 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:55.280474    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf586b875-98jkc_a9897332-8cde-4642-bd84-500024ba84e2/kube-rbac-proxy-rules/0.log"
Jul 14 20:39:55.305708 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:55.305677    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf586b875-98jkc_a9897332-8cde-4642-bd84-500024ba84e2/kube-rbac-proxy-metrics/0.log"
Jul 14 20:39:56.524775 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.524741    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"]
Jul 14 20:39:56.525170 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.525157    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e34535-6e4e-4b63-8b42-0e8d15fc0052" containerName="revoke-keys"
Jul 14 20:39:56.525170 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.525171    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e34535-6e4e-4b63-8b42-0e8d15fc0052" containerName="revoke-keys"
Jul 14 20:39:56.525266 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.525250    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36e34535-6e4e-4b63-8b42-0e8d15fc0052" containerName="revoke-keys"
Jul 14 20:39:56.530685 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.530655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.534093 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.534070    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6mzxq\"/\"default-dockercfg-w8ncr\""
Jul 14 20:39:56.534705 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.534687    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mzxq\"/\"openshift-service-ca.crt\""
Jul 14 20:39:56.534930 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.534915    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mzxq\"/\"kube-root-ca.crt\""
Jul 14 20:39:56.543940 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.543918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"]
Jul 14 20:39:56.598605 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.598578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8rr\" (UniqueName: \"kubernetes.io/projected/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-kube-api-access-cc8rr\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.598750 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.598616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-sys\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.598750 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.598650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-lib-modules\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.598750 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.598694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-podres\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.598750 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.598734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-proc\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700019 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.699979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-proc\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700099    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-proc\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8rr\" (UniqueName: \"kubernetes.io/projected/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-kube-api-access-cc8rr\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-sys\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-lib-modules\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700206 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-podres\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700483 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-sys\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700483 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-lib-modules\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.700483 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.700332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-podres\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.708674 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.708647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8rr\" (UniqueName: \"kubernetes.io/projected/05e3fe42-0b84-4a02-8c29-550a5e1bcf63-kube-api-access-cc8rr\") pod \"perf-node-gather-daemonset-8kptm\" (UID: \"05e3fe42-0b84-4a02-8c29-550a5e1bcf63\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.843072 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.842975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:56.988387 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:56.988361    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"]
Jul 14 20:39:56.990277 ip-10-0-139-187 kubenswrapper[2576]: W0714 20:39:56.990247    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05e3fe42_0b84_4a02_8c29_550a5e1bcf63.slice/crio-f88fd058e12942704a22c0961ed57fd0c2e2d94574070a58460d8e888465af9c WatchSource:0}: Error finding container f88fd058e12942704a22c0961ed57fd0c2e2d94574070a58460d8e888465af9c: Status 404 returned error can't find the container with id f88fd058e12942704a22c0961ed57fd0c2e2d94574070a58460d8e888465af9c
Jul 14 20:39:57.206758 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:57.206732    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/1.log"
Jul 14 20:39:57.210315 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:57.210289    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-f2pfv_a69b6751-ce3a-4490-a068-934961a7b976/console-operator/2.log"
Jul 14 20:39:57.753406 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:57.753376    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-xzdx7_058e5e8d-b0b1-4f0b-9e8b-9cec29fa5e69/download-server/0.log"
Jul 14 20:39:57.967088 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:57.967057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm" event={"ID":"05e3fe42-0b84-4a02-8c29-550a5e1bcf63","Type":"ContainerStarted","Data":"45e0a2c140776e004db1883508fa3e978232dcbf6a902650fdcc43f952f29c64"}
Jul 14 20:39:57.967259 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:57.967106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm" event={"ID":"05e3fe42-0b84-4a02-8c29-550a5e1bcf63","Type":"ContainerStarted","Data":"f88fd058e12942704a22c0961ed57fd0c2e2d94574070a58460d8e888465af9c"}
Jul 14 20:39:57.967259 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:57.967200    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:39:57.997365 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:57.997306    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm" podStartSLOduration=1.9972923630000001 podStartE2EDuration="1.997292363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:39:57.994186868 +0000 UTC m=+2908.836559065" watchObservedRunningTime="2026-07-14 20:39:57.997292363 +0000 UTC m=+2908.839664583"
Jul 14 20:39:59.601665 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:59.601640    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2zxw_7ef4cfe7-c7f4-4178-81f5-672a74c457ba/dns/0.log"
Jul 14 20:39:59.625726 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:59.625700    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2zxw_7ef4cfe7-c7f4-4178-81f5-672a74c457ba/kube-rbac-proxy/0.log"
Jul 14 20:39:59.679116 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:39:59.679091    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fm5x5_8173761e-40fd-4e25-9eaa-4006f6b1ecec/dns-node-resolver/0.log"
Jul 14 20:40:00.364168 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:00.364136    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwxkh_12e08452-1fd9-4bb7-baaf-404dd0344ca1/node-ca/0.log"
Jul 14 20:40:01.611995 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:01.611968    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-dlp8r_da15a176-2566-49df-b22e-316cb1ddf585/kube-auth-proxy/0.log"
Jul 14 20:40:01.812702 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:01.812672    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-kcx54_8fc4773d-be92-4320-b9ca-dbc05b4d9211/payload-processing/0.log"
Jul 14 20:40:02.611166 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:02.611138    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rzzt4_5ed8d5a2-2f49-4ec0-866b-7bc1e4e0688e/serve-healthcheck-canary/0.log"
Jul 14 20:40:03.103167 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:03.103133    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-62jx7_ca098121-4efe-46e0-a524-4be7b1de1f1d/insights-operator/0.log"
Jul 14 20:40:03.104291 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:03.104271    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-62jx7_ca098121-4efe-46e0-a524-4be7b1de1f1d/insights-operator/1.log"
Jul 14 20:40:03.205144 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:03.205120    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7p8q8_0c649611-ab91-4010-a4a6-e98109f53f8d/kube-rbac-proxy/0.log"
Jul 14 20:40:03.228608 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:03.228587    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7p8q8_0c649611-ab91-4010-a4a6-e98109f53f8d/exporter/0.log"
Jul 14 20:40:03.252037 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:03.252013    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7p8q8_0c649611-ab91-4010-a4a6-e98109f53f8d/extractor/0.log"
Jul 14 20:40:03.982944 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:03.982911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-8kptm"
Jul 14 20:40:05.707139 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:05.707114    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gtw96_43a764fb-7684-4078-a6fd-b6007174a14a/manager/0.log"
Jul 14 20:40:05.846014 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:05.845982    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vvzjq_ea593e5d-f3eb-40b9-8972-bf62fbf1e1b4/manager/0.log"
Jul 14 20:40:06.040761 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:06.040732    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tz6mx_68bea68f-6400-456f-adfe-be7848d0dc4a/server/0.log"
Jul 14 20:40:06.108106 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:06.108079    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nkpkv_6e83348f-ec90-4853-818f-d5aac5f5e3f4/manager/0.log"
Jul 14 20:40:06.293215 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:06.293125    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-r4922_227d786e-94c4-481b-980e-b518e1c55d2c/manager/0.log"
Jul 14 20:40:06.325735 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:06.325710    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-r4922_227d786e-94c4-481b-980e-b518e1c55d2c/copy-manifests/0.log"
Jul 14 20:40:07.482938 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:07.482889    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-dlp8r_da15a176-2566-49df-b22e-316cb1ddf585/kube-auth-proxy/0.log"
Jul 14 20:40:07.625001 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:07.624968    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-df9fq_274eeaac-84ec-4826-abf7-c21743c780dc/openshift-lws-operator/0.log"
Jul 14 20:40:07.633946 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:07.633923    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-kcx54_8fc4773d-be92-4320-b9ca-dbc05b4d9211/payload-processing/0.log"
Jul 14 20:40:09.104209 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:09.104180    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-dlp8r_da15a176-2566-49df-b22e-316cb1ddf585/kube-auth-proxy/0.log"
Jul 14 20:40:09.257016 ip-10-0-139-187 kubenswrapper[2576]: I0714 20:40:09.256974    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-kcx54_8fc4773d-be92-4320-b9ca-dbc05b4d9211/payload-processing/0.log"