Jul 29 12:23:22.208947 ip-10-0-142-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 12:23:22.208958 ip-10-0-142-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 12:23:22.208966 ip-10-0-142-162 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 12:23:22.209236 ip-10-0-142-162 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 12:23:32.356794 ip-10-0-142-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 12:23:32.356812 ip-10-0-142-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c49c4d2fbc4b492aaa7eab07dc0018e5 --
Jul 29 12:25:21.180841 ip-10-0-142-162 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 12:25:21.599284 ip-10-0-142-162 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 12:25:21.599284 ip-10-0-142-162 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 12:25:21.599284 ip-10-0-142-162 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 12:25:21.599284 ip-10-0-142-162 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 12:25:21.599284 ip-10-0-142-162 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 12:25:21.601261 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.601162    2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 12:25:21.604597 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604583    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 12:25:21.604597 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604597    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604602    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604605    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604608    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604611    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604613    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604616    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604619    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604621    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604624    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604627    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604629    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604632    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604634    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604637    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604640    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604642    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604645    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604648    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604651    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 12:25:21.604657 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604653    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604656    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604659    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604662    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604665    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604668    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604670    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604673    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604676    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604678    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604681    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604683    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604686    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604688    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604691    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604694    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604697    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604699    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604701    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 12:25:21.605164 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604704    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604707    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604710    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604713    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604715    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604718    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604720    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604723    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604726    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604728    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604731    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604733    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604736    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604738    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604741    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604746    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604750    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604753    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604756    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604759    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 12:25:21.605630 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604762    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604764    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604767    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604770    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604773    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604775    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604778    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604781    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604783    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604786    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604788    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604791    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604794    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604797    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604799    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604802    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604805    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604807    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604810    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604812    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 12:25:21.606120 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604815    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604817    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604820    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604823    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604826    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604828    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604832    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604836    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604840    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604844    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604848    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604852    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604855    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604858    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604861    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604864    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604866    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604869    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.604872    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 12:25:21.606623 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605542    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605548    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605551    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605568    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605571    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605576    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605580    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605583    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605586    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605589    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605592    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605594    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605597    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605600    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605603    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605605    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605608    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605611    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605613    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 12:25:21.607086 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605617    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605619    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605622    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605625    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605627    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605630    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605632    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605635    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605638    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605641    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605643    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605646    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605648    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605651    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605653    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605656    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605658    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605661    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605664    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605666    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 12:25:21.607563 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605669    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605671    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605674    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605676    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605679    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605682    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605685    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605688    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605690    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605693    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605695    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605698    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605702    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605705    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605707    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605710    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605712    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605716    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605718    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605721    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 12:25:21.608053 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605724    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605726    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605729    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605732    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605734    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605737    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605739    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605742    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605744    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605747    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605750    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605753    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605759    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605762    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605765    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605768    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605770    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605774    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605776    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 12:25:21.608541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605780    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605784    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605786    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605789    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605792    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605795    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605798    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605801    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605803    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605806    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605809    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605812    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605814    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605817    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605819    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605822    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605825    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605827    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605830    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605833    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 12:25:21.609034 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.605835    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606185    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606190    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606193    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606195    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606198    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606201    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606203    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606206    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606208    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606211    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606213    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606216    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606218    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606221    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606223    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606225    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606228    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606231    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606234    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 12:25:21.609521 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606237    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606239    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606242    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606244    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606247    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606250    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606252    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606255    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606257    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606260    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606262    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606265    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606267    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606270    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606273    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606276    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606279    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606281    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606284    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606287    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 12:25:21.610031 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606289    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606291    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606294    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606296    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606299    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606301    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606304    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606306    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606309    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606312    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606314    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606317    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606319    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606322    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606324    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606327    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606329    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606332    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606334    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 12:25:21.610546 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606338    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606342    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606345    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606349    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606352    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606355    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606358    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606362    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606364    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606367    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606370    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606373    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606376    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606379    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606382    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606384    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606387    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606389    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606392    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606394    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 12:25:21.611139 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606397    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606399    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606402    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606405    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606407    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606410    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606413    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606416    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606419    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606422    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606425    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606427    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606430    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606432    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606435    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606438    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606441    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606443    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606446    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 12:25:21.611664 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606448    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.606451    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606517    2549 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606524    2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606530    2549 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606534    2549 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606539    2549 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606542    2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606546    2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606550    2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606570    2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606575    2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606580    2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606584    2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606587    2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606592    2549 flags.go:64] FLAG: --cgroup-root=""
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606595    2549 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606598    2549 flags.go:64] FLAG: --client-ca-file=""
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606602    2549 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606605    2549 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606609    2549 flags.go:64] FLAG: --cluster-domain=""
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606612    2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606615    2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606624    2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 12:25:21.612157 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606628    2549 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606633    2549 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606636    2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606639    2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606642    2549 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606645    2549 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606648    2549 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606651    2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606654    2549 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606657    2549 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606662    2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606665    2549 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606668    2549 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606670    2549 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606673    2549 flags.go:64] FLAG: --enable-server="true"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606678    2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606682    2549 flags.go:64] FLAG: --event-burst="100"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606686    2549 flags.go:64] FLAG: --event-qps="50"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606688    2549 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606691    2549 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606694    2549 flags.go:64] FLAG: --eviction-hard=""
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606698    2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606701    2549 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606705    2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606708    2549 flags.go:64] FLAG: --eviction-soft=""
Jul 29 12:25:21.612757 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606711    2549 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606714    2549 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606717    2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606720    2549 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606723    2549 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606726    2549 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606729    2549 flags.go:64] FLAG: --feature-gates=""
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606733    2549 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606735    2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606738    2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606742    2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606745    2549 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606747    2549 flags.go:64] FLAG: --help="false"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606750    2549 flags.go:64] FLAG: --hostname-override="ip-10-0-142-162.ec2.internal"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606753    2549 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606756    2549 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606759    2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606762    2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606766    2549 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606768    2549 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606771    2549 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606774    2549 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606777    2549 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 12:25:21.613369 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606781    2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606784    2549 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606787    2549 flags.go:64] FLAG: --kube-reserved=""
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606790    2549 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606792    2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606795    2549 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606798    2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606802    2549 flags.go:64] FLAG: --lock-file=""
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606805    2549 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606808    2549 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606811    2549 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606816    2549 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606818    2549 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606821    2549 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606824    2549 flags.go:64] FLAG: --logging-format="text"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606827    2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606830    2549 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606833    2549 flags.go:64] FLAG: --manifest-url=""
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606836    2549 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606840    2549 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606843    2549 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606846    2549 flags.go:64] FLAG: --max-pods="110"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606849    2549 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606852    2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606855    2549 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 12:25:21.613992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606858    2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606861    2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606864    2549 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606866    2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606874    2549 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606877    2549 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606880    2549 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606883    2549 flags.go:64] FLAG: --pod-cidr=""
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606886    2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606892    2549 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606894    2549 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606897    2549 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606900    2549 flags.go:64] FLAG: --port="10250"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606903    2549 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606906    2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fdcfa8d18c69c055"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606913    2549 flags.go:64] FLAG: --qos-reserved=""
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606916    2549 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606918    2549 flags.go:64] FLAG: --register-node="true"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606921    2549 flags.go:64] FLAG: --register-with-taints=""
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606925    2549 flags.go:64] FLAG: --registry-burst="10"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606928    2549 flags.go:64] FLAG: --registry-qps="5"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606930    2549 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606933    2549 flags.go:64] FLAG: --reserved-memory=""
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606937    2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606940    2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 12:25:21.614605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606943    2549 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606946    2549 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606948    2549 flags.go:64] FLAG: --runonce="false"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606951    2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606954    2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606957    2549 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606960    2549 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606963    2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606966    2549 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606969    2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606972    2549 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606975    2549 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606977    2549 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606981    2549 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606983    2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606987    2549 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606990    2549 flags.go:64] FLAG: --system-cgroups=""
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606993    2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.606998    2549 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607000    2549 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607004    2549 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607008    2549 flags.go:64] FLAG: --tls-min-version=""
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607011    2549 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607014    2549 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607017    2549 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 12:25:21.615233 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607020    2549 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607023    2549 flags.go:64] FLAG: --v="2"
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607026    2549 flags.go:64] FLAG: --version="false"
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607030    2549 flags.go:64] FLAG: --vmodule=""
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607034    2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.607037    2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607140    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607144    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607147    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607150    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607152    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607155    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607157    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607160    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607164    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607167    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607171    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607175    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607179    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607182    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 12:25:21.615893 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607187    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607190    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607192    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607195    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607198    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607200    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607203    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607206    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607208    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607212    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607215    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607217    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607220    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607222    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607225    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607228    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607230    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607233    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607235    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607238    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 12:25:21.616390 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607240    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607243    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607246    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607248    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607253    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607256    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607259    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607262    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607264    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607267    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607270    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607272    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607276    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607279    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607281    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607284    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607286    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607289    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607292    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 12:25:21.616892 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607295    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607297    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607302    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607304    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607307    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607310    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607312    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607315    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607317    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607320    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607322    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607325    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607327    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607330    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607332    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607335    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607337    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607340    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607342    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607345    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 12:25:21.617360 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607348    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607350    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607353    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607355    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607358    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607362    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607364    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607367    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607369    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607372    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607375    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607378    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607380    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607383    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607387    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607390    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607392    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607395    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607398    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607401    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 12:25:21.617859 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607403    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607406    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607408    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607411    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607413    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.607416    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.608428    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.614935    2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.614950    2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.615728    2549 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.615736    2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615790    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615795    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615799    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615802    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 12:25:21.618375 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615804    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615807    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615810    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615813    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615817    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615821    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615824    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615827    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615830    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615833    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615835    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615838    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615841    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615843    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615846    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615849    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615851    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615854    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615857    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 12:25:21.618825 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615860    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615864    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615867    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615870    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615873    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615875    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615879    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615882    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615885    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615887    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615890    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615893    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615895    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615898    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615901    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615903    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615906    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615909    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615912    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615914    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 12:25:21.619287 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615917    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615919    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615922    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615925    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615927    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615930    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615933    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615937    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615940    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615943    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615946    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615949    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615952    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615954    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615957    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615960    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615962    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615965    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615969    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615972    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 12:25:21.619823 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615975    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615977    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615980    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615982    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615985    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615987    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615990    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615992    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615995    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.615998    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616001    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616003    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616006    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616008    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616011    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616013    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616016    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616018    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616021    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 12:25:21.620321 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616023    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616025    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616028    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616031    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616033    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616036    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616038    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616040    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616043    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616045    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616048    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616051    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616053    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616057    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616060    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616062    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 12:25:21.620803 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616065    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.616070    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616175    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616180    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616182    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616185    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616187    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616190    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616192    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616195    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616197    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616200    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616202    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616205    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616207    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 12:25:21.621197 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616211    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616215    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616219    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616222    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616225    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616228    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616231    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616233    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616236    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616239    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616241    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616243    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616246    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616249    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616252    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616255    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616257    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616260    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616263    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 12:25:21.621569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616266    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616269    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616272    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616274    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616276    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616279    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616281    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616284    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616286    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616288    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616291    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616293    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616296    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616298    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616301    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616303    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616306    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616308    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616311    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616313    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 12:25:21.622033 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616316    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616318    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616320    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616323    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616325    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616328    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616331    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616333    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616335    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616338    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616341    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616343    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616346    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616348    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616351    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616353    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616356    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616358    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616361    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616363    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 12:25:21.622541 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616366    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616368    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616370    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616373    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616375    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616378    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616380    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616383    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616385    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616388    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616390    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616393    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616396    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616399    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616401    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616404    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616407    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616409    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616412    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 12:25:21.623138 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616414    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616417    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616420    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616423    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616425    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616427    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616430    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:21.616432    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.616437    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.616532    2549 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.618296    2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.619682    2549 server.go:1019] "Starting client certificate rotation"
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.619778    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 12:25:21.623620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.620743    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 12:25:21.624024 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.622159    2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 12:25:21.627092 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.627070    2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 12:25:21.640306 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.640290    2549 log.go:25] "Validated CRI v1 runtime API"
Jul 29 12:25:21.642253 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.642239    2549 log.go:25] "Validated CRI v1 image API"
Jul 29 12:25:21.643014 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.643000    2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 12:25:21.645663 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.645646    2549 fs.go:135] Filesystem UUIDs: map[098a8221-5bb0-4ad2-a968-90992ec93d90:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d830c154-175b-46ac-a107-c6e039412ff6:/dev/nvme0n1p3]
Jul 29 12:25:21.645701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.645663    2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 12:25:21.650108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.650088    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 12:25:21.650854 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.650755    2549 manager.go:216] Machine: {Timestamp:2026-07-29 12:25:21.649530312 +0000 UTC m=+0.349335098 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100676 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec292302047a9f7c5a7228062197917a SystemUUID:ec292302-047a-9f7c-5a72-28062197917a BootID:c49c4d2f-bc4b-492a-aa7e-ab07dc0018e5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:ca:02:0e:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:ca:02:0e:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:2a:7a:fe:5c:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 12:25:21.650854 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.650850    2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 12:25:21.650957 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.650924    2549 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 12:25:21.653905 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.653884    2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 12:25:21.654037 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.653910    2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 12:25:21.654659 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.654648    2549 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 12:25:21.654695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.654662    2549 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 12:25:21.654695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.654669    2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 12:25:21.655175 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.655165    2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 12:25:21.655925 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.655915    2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 12:25:21.658545 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.658534    2549 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 12:25:21.658707 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.658697    2549 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 12:25:21.658756 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.658727    2549 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 12:25:21.658756 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.658745    2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 12:25:21.658824 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.658759    2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 12:25:21.658824 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.658769    2549 kubelet.go:398] "Adding apiserver pod source"
Jul 29 12:25:21.658824 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.658782    2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 12:25:21.659117 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.659106    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 12:25:21.659148 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.659124    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 12:25:21.661575 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.661538    2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 12:25:21.664587 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.664550    2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 12:25:21.664660 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.664602    2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 12:25:21.666745 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666723    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666753    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666763    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666772    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666781    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666786    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666794    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666798    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666805    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 12:25:21.666814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666811    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 12:25:21.667065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666827    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 12:25:21.667065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666833    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 12:25:21.667065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666857    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 12:25:21.667065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.666865    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 12:25:21.669329 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.669299    2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 12:25:21.669461 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.669439    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 12:25:21.669512 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.669439    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 12:25:21.670263 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.670249    2549 server.go:1268] "Started kubelet"
Jul 29 12:25:21.670392 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.670335    2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 12:25:21.670436 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.670399    2549 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 12:25:21.670659 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.670578    2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 12:25:21.671139 ip-10-0-142-162 systemd[1]: Started Kubernetes Kubelet.
Jul 29 12:25:21.671783 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.671746    2549 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 12:25:21.672239 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.672224    2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 12:25:21.675198 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.675176    2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 12:25:21.676338 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.675314    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-162.ec2.internal.18c6c24922bd5aa0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-162.ec2.internal,UID:ip-10-0-142-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-162.ec2.internal,},FirstTimestamp:2026-07-29 12:25:21.670216352 +0000 UTC m=+0.370021138,LastTimestamp:2026-07-29 12:25:21.670216352 +0000 UTC m=+0.370021138,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-162.ec2.internal,}"
Jul 29 12:25:21.678447 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.678428    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 12:25:21.678969 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.678950    2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 12:25:21.679118 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.679102    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:21.679639 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679619    2549 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 12:25:21.679728 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679651    2549 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 12:25:21.679728 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679619    2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 12:25:21.679827 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679783    2549 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 12:25:21.679827 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679797    2549 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 12:25:21.679827 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679822    2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 12:25:21.679937 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679832    2549 factory.go:55] Registering systemd factory
Jul 29 12:25:21.679937 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.679839    2549 factory.go:223] Registration of the systemd container factory successfully
Jul 29 12:25:21.680076 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.680062    2549 factory.go:153] Registering CRI-O factory
Jul 29 12:25:21.680113 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.680081    2549 factory.go:223] Registration of the crio container factory successfully
Jul 29 12:25:21.680113 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.680105    2549 factory.go:103] Registering Raw factory
Jul 29 12:25:21.680181 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.680118    2549 manager.go:1196] Started watching for new ooms in manager
Jul 29 12:25:21.680571 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.680538    2549 manager.go:349] Starting recovery of all containers
Jul 29 12:25:21.688500 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.688475    2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 12:25:21.688652 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.688633    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 12:25:21.694396 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.694378    2549 manager.go:354] Recovery completed
Jul 29 12:25:21.698277 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.698265    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:21.700379 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.700352    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:21.700473 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.700394    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:21.700473 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.700408    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:21.700971 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.700957    2549 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 12:25:21.700971 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.700966    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:21.701097 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.700969    2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 12:25:21.701097 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.701015    2549 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 12:25:21.701583 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.701566    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:21.701670 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.701592    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:21.701670 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.701604    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:21.703622 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.703609    2549 policy_none.go:49] "None policy: Start"
Jul 29 12:25:21.703699 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.703626    2549 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 12:25:21.703699 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.703639    2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 12:25:21.705591 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.705578    2549 policy_none.go:47] "Start"
Jul 29 12:25:21.709115 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.709041    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-162.ec2.internal.18c6c24924899877  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-162.ec2.internal,UID:ip-10-0-142-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-162.ec2.internal,},FirstTimestamp:2026-07-29 12:25:21.700378743 +0000 UTC m=+0.400183531,LastTimestamp:2026-07-29 12:25:21.700378743 +0000 UTC m=+0.400183531,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-162.ec2.internal,}"
Jul 29 12:25:21.712999 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.712983    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpdfv"
Jul 29 12:25:21.718264 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.718204    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-162.ec2.internal.18c6c2492489e917  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-162.ec2.internal,UID:ip-10-0-142-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-162.ec2.internal,},FirstTimestamp:2026-07-29 12:25:21.700399383 +0000 UTC m=+0.400204168,LastTimestamp:2026-07-29 12:25:21.700399383 +0000 UTC m=+0.400204168,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-162.ec2.internal,}"
Jul 29 12:25:21.721867 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.721719    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpdfv"
Jul 29 12:25:21.727676 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.727620    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-162.ec2.internal.18c6c249248a1bb9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-162.ec2.internal,UID:ip-10-0-142-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-162.ec2.internal,},FirstTimestamp:2026-07-29 12:25:21.700412345 +0000 UTC m=+0.400217131,LastTimestamp:2026-07-29 12:25:21.700412345 +0000 UTC m=+0.400217131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-162.ec2.internal,}"
Jul 29 12:25:21.742142 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.742124    2549 manager.go:337] "Starting Device Plugin manager"
Jul 29 12:25:21.742216 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.742157    2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 12:25:21.742216 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.742171    2549 server.go:87] "Starting device plugin registration server"
Jul 29 12:25:21.742395 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.742384    2549 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 12:25:21.742440 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.742401    2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 12:25:21.742581 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.742550    2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 12:25:21.742701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.742687    2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 12:25:21.742701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:21.742700    2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 12:25:21.743033 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.743007    2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 12:25:21.743122 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:21.743061    2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:23.688905 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.688878    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 12:25:23.690063 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.690045    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 12:25:23.690141 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.690076    2549 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 12:25:23.690141 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.690094    2549 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 12:25:23.690141 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:23.690122    2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 12:25:23.693089 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.693067    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 12:25:23.723167 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.723150    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:23.723856 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.723841    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:23.723908 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.723872    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:23.723908 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.723887    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:23.723970 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.723910    2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.734257 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.734205    2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.734257 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:23.734227    2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-162.ec2.internal\": node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:23.754851 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:23.754828    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:23.790343 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.790323    2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal"]
Jul 29 12:25:23.790400 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.790385    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:23.791092 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.791079    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:23.791145 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.791107    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:23.791145 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.791117    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:23.793648 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.793636    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:23.793771 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.793757    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.793804 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.793787    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:23.794334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.794300    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:23.794334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.794320    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:23.794481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.794360    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:23.794481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.794378    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:23.794481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.794337    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:23.794481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.794412    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:23.796530 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.796517    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.796604 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.796538    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:23.797753 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.797739    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:23.797832 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.797762    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:23.797832 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.797775    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:23.816836 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:23.816816    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-162.ec2.internal\" not found" node="ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.821035 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:23.821018    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-162.ec2.internal\" not found" node="ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.855521 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:23.855502    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:23.860785 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.860771    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d945be348fd36afce90ee681816b7a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"6d945be348fd36afce90ee681816b7a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.860852 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.860795    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d945be348fd36afce90ee681816b7a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"6d945be348fd36afce90ee681816b7a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.860852 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.860811    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ce42396a29d504fabed2a2525556f09-config\") pod \"kube-apiserver-proxy-ip-10-0-142-162.ec2.internal\" (UID: \"4ce42396a29d504fabed2a2525556f09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.955922 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:23.955902    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:23.961594 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.961575    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d945be348fd36afce90ee681816b7a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"6d945be348fd36afce90ee681816b7a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.961647 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.961600    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d945be348fd36afce90ee681816b7a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"6d945be348fd36afce90ee681816b7a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.961647 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.961616    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ce42396a29d504fabed2a2525556f09-config\") pod \"kube-apiserver-proxy-ip-10-0-142-162.ec2.internal\" (UID: \"4ce42396a29d504fabed2a2525556f09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.961714 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.961667    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ce42396a29d504fabed2a2525556f09-config\") pod \"kube-apiserver-proxy-ip-10-0-142-162.ec2.internal\" (UID: \"4ce42396a29d504fabed2a2525556f09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.961714 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.961689    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d945be348fd36afce90ee681816b7a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"6d945be348fd36afce90ee681816b7a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:23.961714 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:23.961671    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d945be348fd36afce90ee681816b7a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"6d945be348fd36afce90ee681816b7a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:24.056154 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.056107    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.119653 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.119628    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:24.124684 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.124261    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:24.157077 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.157054    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.257611 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.257588    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.358100 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.358047    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.458549 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.458522    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.498916 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.498894    2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 12:25:24.499336 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.499052    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 12:25:24.558924 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.558898    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.606890 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.606837    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 12:20:23 +0000 UTC" deadline="2028-03-03 00:30:11.60959932 +0000 UTC"
Jul 29 12:25:24.606890 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.606888    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13980h4m47.002715699s"
Jul 29 12:25:24.659271 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.659207    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.688146 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:24.688102    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d945be348fd36afce90ee681816b7a1.slice/crio-00bd43ea8106f267552700b36ad59720413ad1c146ce16b47c5e8e47a9f8a001 WatchSource:0}: Error finding container 00bd43ea8106f267552700b36ad59720413ad1c146ce16b47c5e8e47a9f8a001: Status 404 returned error can't find the container with id 00bd43ea8106f267552700b36ad59720413ad1c146ce16b47c5e8e47a9f8a001
Jul 29 12:25:24.693413 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.693397    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 12:25:24.740267 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:24.740248    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce42396a29d504fabed2a2525556f09.slice/crio-b5097c6adb2ab42d3164991e1092031bd03cd6e7fe105ad59b3bf1ab0e093de4 WatchSource:0}: Error finding container b5097c6adb2ab42d3164991e1092031bd03cd6e7fe105ad59b3bf1ab0e093de4: Status 404 returned error can't find the container with id b5097c6adb2ab42d3164991e1092031bd03cd6e7fe105ad59b3bf1ab0e093de4
Jul 29 12:25:24.758957 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.758934    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 12:25:24.759356 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:24.759337    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found"
Jul 29 12:25:24.759933 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.759919    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 12:25:24.759972 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.759945    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 12:25:24.759972 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.759954    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID"
Jul 29 12:25:24.783419 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.783399    2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 12:25:24.859439 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.859420    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:24.872657 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.872637    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 12:25:24.874689 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.874674    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"
Jul 29 12:25:24.889496 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.889478    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 12:25:24.901296 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.901275    2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 12:25:24.975411 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:24.975362    2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 12:25:25.539636 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.539607    2549 apiserver.go:52] "Watching apiserver"
Jul 29 12:25:25.549444 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.549420    2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 12:25:25.551247 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.551223    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-nq99x","kube-system/global-pull-secret-syncer-dxw26","kube-system/konnectivity-agent-jvjsv","openshift-dns/node-resolver-fjzlq","openshift-image-registry/node-ca-g8r7n","openshift-multus/multus-additional-cni-plugins-72zgr","openshift-multus/network-metrics-daemon-lgm8z","kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp","openshift-cluster-node-tuning-operator/tuned-vd92h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal","openshift-multus/multus-28jlg","openshift-network-diagnostics/network-check-target-rdcjp","openshift-network-operator/iptables-alerter-wt5fm"]
Jul 29 12:25:25.553891 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.553872    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:25.553987 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.553953    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:25.556000 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.555980    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:25.556092 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.556067    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:25.558164 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.558127    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.559051 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.559033    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 12:25:25.560624 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.560299    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.560624 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.560484    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 12:25:25.561006 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.560988    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7snzf\""
Jul 29 12:25:25.561087 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.561068    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 12:25:25.562589 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.562541    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.563073 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.563050    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5mkfx\""
Jul 29 12:25:25.563461 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.563437    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 12:25:25.564112 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.564088    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 12:25:25.565349 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.565322    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fpkns\""
Jul 29 12:25:25.566083 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.565610    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 12:25:25.566083 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.565796    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 12:25:25.566083 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.566011    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 12:25:25.567623 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.567433    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.569432 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569407    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp96q\" (UniqueName: \"kubernetes.io/projected/cdc6a98e-ba32-4e69-a42e-a7384d0608be-kube-api-access-kp96q\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.569531 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569445    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv5pf\" (UniqueName: \"kubernetes.io/projected/d25b149c-939a-47cc-a11e-1622459b8051-kube-api-access-fv5pf\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:25.569531 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569469    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:25.569531 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569503    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f-agent-certs\") pod \"konnectivity-agent-jvjsv\" (UID: \"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f\") " pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.569701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569595    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f-konnectivity-ca\") pod \"konnectivity-agent-jvjsv\" (UID: \"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f\") " pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.569701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569628    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cdc6a98e-ba32-4e69-a42e-a7384d0608be-hosts-file\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.569701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569649    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.569701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569672    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdc6a98e-ba32-4e69-a42e-a7384d0608be-tmp-dir\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.569701 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569700    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:25.569950 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569858    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 12:25:25.569950 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.569883    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 12:25:25.570388 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.570202    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 12:25:25.570388 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.570214    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 12:25:25.570388 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.570213    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 12:25:25.570598 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.570497    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 12:25:25.570737 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.570719    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kw8fz\""
Jul 29 12:25:25.571681 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.571479    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 12:25:25.572097 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.572075    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.572813 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.572793    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 12:25:25.572970 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.572954    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7b4rm\""
Jul 29 12:25:25.573064 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.573047    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 12:25:25.574273 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.574253    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pc2w9\""
Jul 29 12:25:25.574841 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.574616    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 12:25:25.574931 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.574909    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 12:25:25.575022 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.575002    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 12:25:25.575100 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.575077    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 12:25:25.575155 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.575006    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 12:25:25.575302 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.575232    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.575383 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.575301    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:25.575543 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.575525    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 12:25:25.577407 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.577072    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.579418 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.579395    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 12:25:25.579496 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.579428    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 12:25:25.579671 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.579652    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m9b7r\""
Jul 29 12:25:25.579749 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.579675    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.581646 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.581624    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.581863 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.581845    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 12:25:25.581979 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.581962    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l9k6k\""
Jul 29 12:25:25.582070 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.582052    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 12:25:25.582198 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.582183    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 12:25:25.584213 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.583854    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 12:25:25.584272 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.584253    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xkk2l\""
Jul 29 12:25:25.593656 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.593638    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wjj8p"
Jul 29 12:25:25.602122 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.602098    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wjj8p"
Jul 29 12:25:25.660797 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.660776    2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 12:25:25.669857 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.669831    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-conf-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.669964 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.669866    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-multus-certs\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.669964 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.669893    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-systemd-units\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.669964 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.669917    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-system-cni-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.670108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.669966    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-cni-bin\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.670108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.669994    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-kubelet\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.670108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670015    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-socket-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.670108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670051    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-sys-fs\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.670108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670093    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmkp\" (UniqueName: \"kubernetes.io/projected/8623462d-559c-44f5-b5e0-5e8bcc34a524-kube-api-access-xwmkp\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.670366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670119    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f-agent-certs\") pod \"konnectivity-agent-jvjsv\" (UID: \"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f\") " pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.670366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670134    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-host\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.670366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670152    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.670366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670261    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdfkd\" (UniqueName: \"kubernetes.io/projected/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-kube-api-access-pdfkd\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.670366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670301    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdc6a98e-ba32-4e69-a42e-a7384d0608be-tmp-dir\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.670366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670343    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-cni-netd\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670368    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-k8s-cni-cncf-io\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670403    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-etc-kubernetes\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670422    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670448    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f-konnectivity-ca\") pod \"konnectivity-agent-jvjsv\" (UID: \"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f\") " pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670475    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a0b1de9-3f31-4d44-93da-67c53dea462d-kubelet-config\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670508    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670536    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysctl-d\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670543    2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670563    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a0cc2e-2228-4b4f-8d52-596334f087fc-tmp\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670627    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-kubelet\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.670644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670629    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdc6a98e-ba32-4e69-a42e-a7384d0608be-tmp-dir\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670650    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-var-lib-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670674    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-modprobe-d\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670695    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-hostroot\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670718    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8623462d-559c-44f5-b5e0-5e8bcc34a524-iptables-alerter-script\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670756    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b2bv\" (UniqueName: \"kubernetes.io/projected/38bd4376-7d36-4d25-974d-6fbc3fd5b574-kube-api-access-4b2bv\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670779    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztr7v\" (UniqueName: \"kubernetes.io/projected/d2a0cc2e-2228-4b4f-8d52-596334f087fc-kube-api-access-ztr7v\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670845    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-netns\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670939    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-etc-selinux\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.670971    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-kubernetes\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671001    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stqmx\" (UniqueName: \"kubernetes.io/projected/37ed631f-96d3-47ae-a9c2-bb78aca48e33-kube-api-access-stqmx\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671004    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f-konnectivity-ca\") pod \"konnectivity-agent-jvjsv\" (UID: \"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f\") " pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671027    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-system-cni-dir\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671051    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38bd4376-7d36-4d25-974d-6fbc3fd5b574-serviceca\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671073    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovnkube-config\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671095    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-env-overrides\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.671132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671117    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysconfig\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671138    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-systemd\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671160    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-cnibin\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671183    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-daemon-config\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671223    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671256    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp96q\" (UniqueName: \"kubernetes.io/projected/cdc6a98e-ba32-4e69-a42e-a7384d0608be-kube-api-access-kp96q\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671280    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv5pf\" (UniqueName: \"kubernetes.io/projected/d25b149c-939a-47cc-a11e-1622459b8051-kube-api-access-fv5pf\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671302    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-node-log\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671341    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37ed631f-96d3-47ae-a9c2-bb78aca48e33-cni-binary-copy\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671365    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-os-release\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671405    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq2lh\" (UniqueName: \"kubernetes.io/projected/3f4acd0e-0c89-4836-94a7-f15287c1ab38-kube-api-access-dq2lh\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671451    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671475    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-log-socket\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671498    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovn-node-metrics-cert\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671540    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-var-lib-kubelet\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671564    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.671929 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671586    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-registration-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671612    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-device-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671644    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-cni-bin\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671685    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-etc-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671713    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-ovn\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671736    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-sys\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671773    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-socket-dir-parent\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671805    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cnibin\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671834    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671864    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cdc6a98e-ba32-4e69-a42e-a7384d0608be-hosts-file\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671889    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671911    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38bd4376-7d36-4d25-974d-6fbc3fd5b574-host\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671952    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671979    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.671998    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672007    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a0b1de9-3f31-4d44-93da-67c53dea462d-dbus\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672031    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-tuned\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.672768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672053    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-cni-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.671971    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cdc6a98e-ba32-4e69-a42e-a7384d0608be-hosts-file\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.672088    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs podName:d25b149c-939a-47cc-a11e-1622459b8051 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:26.172058581 +0000 UTC m=+2.992109364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs") pod "network-metrics-daemon-lgm8z" (UID: "d25b149c-939a-47cc-a11e-1622459b8051") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672135    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-run-netns\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672160    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-systemd\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672231    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovnkube-script-lib\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672271    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-cni-multus\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672300    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-run\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672354    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-os-release\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672377    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8623462d-559c-44f5-b5e0-5e8bcc34a524-host-slash\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672413    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672435    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-slash\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672458    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclzm\" (UniqueName: \"kubernetes.io/projected/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-kube-api-access-nclzm\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672480    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysctl-conf\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.673544 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.672512    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-lib-modules\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.674818 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.674798    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f-agent-certs\") pod \"konnectivity-agent-jvjsv\" (UID: \"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f\") " pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.682239 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.682218    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv5pf\" (UniqueName: \"kubernetes.io/projected/d25b149c-939a-47cc-a11e-1622459b8051-kube-api-access-fv5pf\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:25.682750 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.682731    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 12:25:25.682835 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.682757    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 12:25:25.682835 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.682773    2549 projected.go:196] Error preparing data for projected volume kube-api-access-n7ndm for pod openshift-network-diagnostics/network-check-target-rdcjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:25.682835 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.682830    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm podName:87800128-905c-4403-90b6-a01fa417c18e nodeName:}" failed. No retries permitted until 2026-07-29 12:25:26.182814773 +0000 UTC m=+3.002865544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n7ndm" (UniqueName: "kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm") pod "network-check-target-rdcjp" (UID: "87800128-905c-4403-90b6-a01fa417c18e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:25.685038 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.685016    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp96q\" (UniqueName: \"kubernetes.io/projected/cdc6a98e-ba32-4e69-a42e-a7384d0608be-kube-api-access-kp96q\") pod \"node-resolver-fjzlq\" (UID: \"cdc6a98e-ba32-4e69-a42e-a7384d0608be\") " pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.694195 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.694149    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" event={"ID":"4ce42396a29d504fabed2a2525556f09","Type":"ContainerStarted","Data":"b5097c6adb2ab42d3164991e1092031bd03cd6e7fe105ad59b3bf1ab0e093de4"}
Jul 29 12:25:25.695411 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.695389    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" event={"ID":"6d945be348fd36afce90ee681816b7a1","Type":"ContainerStarted","Data":"00bd43ea8106f267552700b36ad59720413ad1c146ce16b47c5e8e47a9f8a001"}
Jul 29 12:25:25.773461 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773425    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-cni-multus\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773606 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773463    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-run\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.773606 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773494    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-os-release\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773606 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773517    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8623462d-559c-44f5-b5e0-5e8bcc34a524-host-slash\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.773606 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773553    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-slash\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.773606 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773576    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nclzm\" (UniqueName: \"kubernetes.io/projected/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-kube-api-access-nclzm\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.773606 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773597    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysctl-conf\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773618    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-lib-modules\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773639    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-conf-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773662    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-multus-certs\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773676    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-os-release\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773682    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-systemd-units\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773718    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-systemd-units\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773725    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-system-cni-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773752    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-cni-bin\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773756    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8623462d-559c-44f5-b5e0-5e8bcc34a524-host-slash\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773777    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-kubelet\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773793    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-slash\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773812    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-socket-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773834    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-sys-fs\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773856    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmkp\" (UniqueName: \"kubernetes.io/projected/8623462d-559c-44f5-b5e0-5e8bcc34a524-kube-api-access-xwmkp\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773878    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-host\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.773917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773900    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773926    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdfkd\" (UniqueName: \"kubernetes.io/projected/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-kube-api-access-pdfkd\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773952    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-cni-netd\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773975    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-k8s-cni-cncf-io\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.773997    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-etc-kubernetes\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774029    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774052    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a0b1de9-3f31-4d44-93da-67c53dea462d-kubelet-config\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774073    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774095    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysctl-d\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774117    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysctl-conf\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774117    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a0cc2e-2228-4b4f-8d52-596334f087fc-tmp\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774157    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-kubelet\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774180    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-var-lib-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774216    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-modprobe-d\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774238    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-hostroot\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774263    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8623462d-559c-44f5-b5e0-5e8bcc34a524-iptables-alerter-script\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774287    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b2bv\" (UniqueName: \"kubernetes.io/projected/38bd4376-7d36-4d25-974d-6fbc3fd5b574-kube-api-access-4b2bv\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.774685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774327    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztr7v\" (UniqueName: \"kubernetes.io/projected/d2a0cc2e-2228-4b4f-8d52-596334f087fc-kube-api-access-ztr7v\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774353    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-netns\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774383    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-etc-selinux\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774409    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-kubernetes\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774453    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stqmx\" (UniqueName: \"kubernetes.io/projected/37ed631f-96d3-47ae-a9c2-bb78aca48e33-kube-api-access-stqmx\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774476    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-system-cni-dir\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774498    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38bd4376-7d36-4d25-974d-6fbc3fd5b574-serviceca\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774519    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-host\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774521    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovnkube-config\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774589    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-env-overrides\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774628    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysconfig\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774651    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-systemd\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774675    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-cnibin\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774702    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-daemon-config\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774727    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774756    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-node-log\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774783    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37ed631f-96d3-47ae-a9c2-bb78aca48e33-cni-binary-copy\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.775532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774815    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-os-release\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774840    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2lh\" (UniqueName: \"kubernetes.io/projected/3f4acd0e-0c89-4836-94a7-f15287c1ab38-kube-api-access-dq2lh\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774864    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774889    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-log-socket\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774915    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovn-node-metrics-cert\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774940    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-var-lib-kubelet\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774964    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.774990    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-registration-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775021    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-device-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775043    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovnkube-config\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775046    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-cni-bin\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775087    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-cni-bin\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775091    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-etc-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775129    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-cni-multus\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775132    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-etc-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775155    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-ovn\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775177    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-sys\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.776334 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775220    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-socket-dir-parent\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775239    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-lib-modules\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775246    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cnibin\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775272    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775290    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-multus-certs\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775332    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38bd4376-7d36-4d25-974d-6fbc3fd5b574-host\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775471    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-var-lib-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775521    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-kubelet\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775559    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-netns\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775653    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-modprobe-d\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775682    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775710    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775739    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a0b1de9-3f31-4d44-93da-67c53dea462d-dbus\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775763    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-tuned\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775788    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-cni-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775812    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-run-netns\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775839    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-systemd\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.775865    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovnkube-script-lib\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776377    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a0b1de9-3f31-4d44-93da-67c53dea462d-dbus\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776430    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-hostroot\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776433    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovnkube-script-lib\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776468    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38bd4376-7d36-4d25-974d-6fbc3fd5b574-host\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776509    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-run\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776747    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-run-netns\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776810    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-cni-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776848    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776888    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-systemd\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.776926    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.777103    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8623462d-559c-44f5-b5e0-5e8bcc34a524-iptables-alerter-script\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.777228    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-cni-bin\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.777276    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-var-lib-kubelet\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.777457    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-system-cni-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.777546    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-sys-fs\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.777815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.777566    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-socket-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.778577 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778069    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysconfig\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.778577 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778127    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-systemd\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.778577 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778170    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-etc-kubernetes\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.778577 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778178    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-env-overrides\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.778577 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778201    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-cnibin\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.778577 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778336    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a0cc2e-2228-4b4f-8d52-596334f087fc-tmp\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.778879 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778584    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-host-cni-netd\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.778879 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778614    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.778879 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778662    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-node-log\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.778879 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778688    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-host-run-k8s-cni-cncf-io\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.779069 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778884    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-daemon-config\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.779069 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.778972    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.779069 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.779010    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37ed631f-96d3-47ae-a9c2-bb78aca48e33-cni-binary-copy\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.780136 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.779411    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-etc-selinux\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.780136 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.779495    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-os-release\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.780136 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.779715    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-kubernetes\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.780136 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.779780    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-openvswitch\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.780136 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.779838    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-log-socket\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.780136 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.779894    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-sys\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.780487 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.780360    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-socket-dir-parent\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.780487 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.780424    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-var-lib-kubelet\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.780487 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.780476    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cnibin\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.780636 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.780521    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37ed631f-96d3-47ae-a9c2-bb78aca48e33-multus-conf-dir\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.780681 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.780669    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.781236 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781068    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-registration-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.781236 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781144    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-device-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.781236 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781203    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a0b1de9-3f31-4d44-93da-67c53dea462d-kubelet-config\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:25.781236 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781223    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-run-ovn\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.781497 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781287    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f4acd0e-0c89-4836-94a7-f15287c1ab38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.781497 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781344    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-system-cni-dir\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.781588 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781094    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.782948 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781704    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38bd4376-7d36-4d25-974d-6fbc3fd5b574-serviceca\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.782948 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.781719    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:25.782948 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:25.781785    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret podName:6a0b1de9-3f31-4d44-93da-67c53dea462d nodeName:}" failed. No retries permitted until 2026-07-29 12:25:26.281761908 +0000 UTC m=+3.101812666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret") pod "global-pull-secret-syncer-dxw26" (UID: "6a0b1de9-3f31-4d44-93da-67c53dea462d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:25.782948 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.781969    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-sysctl-d\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.783391 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.783347    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclzm\" (UniqueName: \"kubernetes.io/projected/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-kube-api-access-nclzm\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.784048 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.784025    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2a0cc2e-2228-4b4f-8d52-596334f087fc-etc-tuned\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.785291 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.785045    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9af8fcd6-a294-4c89-ad11-6d36b32a0a52-ovn-node-metrics-cert\") pod \"ovnkube-node-nq99x\" (UID: \"9af8fcd6-a294-4c89-ad11-6d36b32a0a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.787083 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.787058    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b2bv\" (UniqueName: \"kubernetes.io/projected/38bd4376-7d36-4d25-974d-6fbc3fd5b574-kube-api-access-4b2bv\") pod \"node-ca-g8r7n\" (UID: \"38bd4376-7d36-4d25-974d-6fbc3fd5b574\") " pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.787207 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.787183    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztr7v\" (UniqueName: \"kubernetes.io/projected/d2a0cc2e-2228-4b4f-8d52-596334f087fc-kube-api-access-ztr7v\") pod \"tuned-vd92h\" (UID: \"d2a0cc2e-2228-4b4f-8d52-596334f087fc\") " pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.788720 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.788268    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmkp\" (UniqueName: \"kubernetes.io/projected/8623462d-559c-44f5-b5e0-5e8bcc34a524-kube-api-access-xwmkp\") pod \"iptables-alerter-wt5fm\" (UID: \"8623462d-559c-44f5-b5e0-5e8bcc34a524\") " pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.788720 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.788662    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdfkd\" (UniqueName: \"kubernetes.io/projected/71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1-kube-api-access-pdfkd\") pod \"multus-additional-cni-plugins-72zgr\" (UID: \"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1\") " pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.789109 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.789085    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq2lh\" (UniqueName: \"kubernetes.io/projected/3f4acd0e-0c89-4836-94a7-f15287c1ab38-kube-api-access-dq2lh\") pod \"aws-ebs-csi-driver-node-5mldp\" (UID: \"3f4acd0e-0c89-4836-94a7-f15287c1ab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.789217 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.789203    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stqmx\" (UniqueName: \"kubernetes.io/projected/37ed631f-96d3-47ae-a9c2-bb78aca48e33-kube-api-access-stqmx\") pod \"multus-28jlg\" (UID: \"37ed631f-96d3-47ae-a9c2-bb78aca48e33\") " pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.872519 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.872432    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:25.880080 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.880052    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fjzlq"
Jul 29 12:25:25.889683 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.889660    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8r7n"
Jul 29 12:25:25.895481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.895458    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-72zgr"
Jul 29 12:25:25.903178 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.903161    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp"
Jul 29 12:25:25.911744 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.911723    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:25.919546 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.919526    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vd92h"
Jul 29 12:25:25.927050 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.927029    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wt5fm"
Jul 29 12:25:25.933580 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.933562    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-28jlg"
Jul 29 12:25:25.972114 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:25.972086    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 12:25:26.179328 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.179237    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:26.179475 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.179368    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:26.179475 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.179435    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs podName:d25b149c-939a-47cc-a11e-1622459b8051 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:27.17941563 +0000 UTC m=+3.999466390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs") pod "network-metrics-daemon-lgm8z" (UID: "d25b149c-939a-47cc-a11e-1622459b8051") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:26.279644 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.279612    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:26.279808 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.279783    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 12:25:26.279808 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.279805    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 12:25:26.279921 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.279817    2549 projected.go:196] Error preparing data for projected volume kube-api-access-n7ndm for pod openshift-network-diagnostics/network-check-target-rdcjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:26.279921 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.279890    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm podName:87800128-905c-4403-90b6-a01fa417c18e nodeName:}" failed. No retries permitted until 2026-07-29 12:25:27.279870963 +0000 UTC m=+4.099921732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7ndm" (UniqueName: "kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm") pod "network-check-target-rdcjp" (UID: "87800128-905c-4403-90b6-a01fa417c18e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:26.380987 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.380956    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:26.381162 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.381090    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:26.381162 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.381150    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret podName:6a0b1de9-3f31-4d44-93da-67c53dea462d nodeName:}" failed. No retries permitted until 2026-07-29 12:25:27.381132526 +0000 UTC m=+4.201183298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret") pod "global-pull-secret-syncer-dxw26" (UID: "6a0b1de9-3f31-4d44-93da-67c53dea462d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:26.574581 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:26.574131    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ed631f_96d3_47ae_a9c2_bb78aca48e33.slice/crio-95400fd15975ae102fd077da5831454acd57085d74120cc47f33dc2ed2d0b1f0 WatchSource:0}: Error finding container 95400fd15975ae102fd077da5831454acd57085d74120cc47f33dc2ed2d0b1f0: Status 404 returned error can't find the container with id 95400fd15975ae102fd077da5831454acd57085d74120cc47f33dc2ed2d0b1f0
Jul 29 12:25:26.575647 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:26.575622    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f9ca64_4026_4c01_a62e_cf4e3a8fc7b1.slice/crio-d5d67bb77c71084831a87a6b458c8d88c9c8fdd29f57d8437a87679b66469293 WatchSource:0}: Error finding container d5d67bb77c71084831a87a6b458c8d88c9c8fdd29f57d8437a87679b66469293: Status 404 returned error can't find the container with id d5d67bb77c71084831a87a6b458c8d88c9c8fdd29f57d8437a87679b66469293
Jul 29 12:25:26.576639 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:26.576522    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a0cc2e_2228_4b4f_8d52_596334f087fc.slice/crio-575f1ee197c280be9847e5e817ec787070a6697f4cee2308bc26550217353dae WatchSource:0}: Error finding container 575f1ee197c280be9847e5e817ec787070a6697f4cee2308bc26550217353dae: Status 404 returned error can't find the container with id 575f1ee197c280be9847e5e817ec787070a6697f4cee2308bc26550217353dae
Jul 29 12:25:26.579714 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:26.579687    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b2f0a9_981b_4c82_a9d1_11ed3d05b40f.slice/crio-25efd3d2cfd441124c5b3f8d91e710c04e023130b27eb10c1f2d30f7439fe9be WatchSource:0}: Error finding container 25efd3d2cfd441124c5b3f8d91e710c04e023130b27eb10c1f2d30f7439fe9be: Status 404 returned error can't find the container with id 25efd3d2cfd441124c5b3f8d91e710c04e023130b27eb10c1f2d30f7439fe9be
Jul 29 12:25:26.583005 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:26.582757    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8623462d_559c_44f5_b5e0_5e8bcc34a524.slice/crio-e01e92e007fb473646b09dd3252686e02834df76a128fa9e1557483e4e2ff0db WatchSource:0}: Error finding container e01e92e007fb473646b09dd3252686e02834df76a128fa9e1557483e4e2ff0db: Status 404 returned error can't find the container with id e01e92e007fb473646b09dd3252686e02834df76a128fa9e1557483e4e2ff0db
Jul 29 12:25:26.587451 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:26.587386    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bd4376_7d36_4d25_974d_6fbc3fd5b574.slice/crio-2fef31b791e92f73cd561991983f740b61da21455275c05f22a36c829f95a2cc WatchSource:0}: Error finding container 2fef31b791e92f73cd561991983f740b61da21455275c05f22a36c829f95a2cc: Status 404 returned error can't find the container with id 2fef31b791e92f73cd561991983f740b61da21455275c05f22a36c829f95a2cc
Jul 29 12:25:26.587703 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:26.587600    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af8fcd6_a294_4c89_ad11_6d36b32a0a52.slice/crio-2498aad9cc47aaa508231e9bc96fd1bd5e30ed1a73f737eba3cd5b442e85274b WatchSource:0}: Error finding container 2498aad9cc47aaa508231e9bc96fd1bd5e30ed1a73f737eba3cd5b442e85274b: Status 404 returned error can't find the container with id 2498aad9cc47aaa508231e9bc96fd1bd5e30ed1a73f737eba3cd5b442e85274b
Jul 29 12:25:26.605674 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.605637    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 12:20:25 +0000 UTC" deadline="2028-02-11 12:58:48.346919342 +0000 UTC"
Jul 29 12:25:26.605674 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.605673    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13488h33m21.741248272s"
Jul 29 12:25:26.690797 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.690675    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:26.690912 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:26.690887    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:26.700124 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.700103    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerStarted","Data":"d5d67bb77c71084831a87a6b458c8d88c9c8fdd29f57d8437a87679b66469293"}
Jul 29 12:25:26.703810 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.703787    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-28jlg" event={"ID":"37ed631f-96d3-47ae-a9c2-bb78aca48e33","Type":"ContainerStarted","Data":"95400fd15975ae102fd077da5831454acd57085d74120cc47f33dc2ed2d0b1f0"}
Jul 29 12:25:26.706096 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.706073    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" event={"ID":"4ce42396a29d504fabed2a2525556f09","Type":"ContainerStarted","Data":"046215df5d9d15395af1134b24f79aa8214b43e6f225f3f2c7376cf07249f92e"}
Jul 29 12:25:26.708633 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.708610    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp" event={"ID":"3f4acd0e-0c89-4836-94a7-f15287c1ab38","Type":"ContainerStarted","Data":"279441c872fd95e800d550af411def97d4baf88d46aa9c129f3d42e44d50e19f"}
Jul 29 12:25:26.709590 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.709562    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvjsv" event={"ID":"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f","Type":"ContainerStarted","Data":"25efd3d2cfd441124c5b3f8d91e710c04e023130b27eb10c1f2d30f7439fe9be"}
Jul 29 12:25:26.710710 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.710681    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vd92h" event={"ID":"d2a0cc2e-2228-4b4f-8d52-596334f087fc","Type":"ContainerStarted","Data":"575f1ee197c280be9847e5e817ec787070a6697f4cee2308bc26550217353dae"}
Jul 29 12:25:26.711845 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.711825    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"2498aad9cc47aaa508231e9bc96fd1bd5e30ed1a73f737eba3cd5b442e85274b"}
Jul 29 12:25:26.712865 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.712844    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8r7n" event={"ID":"38bd4376-7d36-4d25-974d-6fbc3fd5b574","Type":"ContainerStarted","Data":"2fef31b791e92f73cd561991983f740b61da21455275c05f22a36c829f95a2cc"}
Jul 29 12:25:26.715081 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.715063    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fjzlq" event={"ID":"cdc6a98e-ba32-4e69-a42e-a7384d0608be","Type":"ContainerStarted","Data":"cd45174b182ddbd6dbf9ff1c9a6e0b7a4b8c6740c2e28d92446aa995810a0b83"}
Jul 29 12:25:26.716653 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.716633    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wt5fm" event={"ID":"8623462d-559c-44f5-b5e0-5e8bcc34a524","Type":"ContainerStarted","Data":"e01e92e007fb473646b09dd3252686e02834df76a128fa9e1557483e4e2ff0db"}
Jul 29 12:25:26.723357 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:26.723300    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" podStartSLOduration=2.723290008 podStartE2EDuration="2.723290008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:26.723061911 +0000 UTC m=+3.543112688" watchObservedRunningTime="2026-07-29 12:25:26.723290008 +0000 UTC m=+3.543340784"
Jul 29 12:25:27.187747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.187711    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:27.187939 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.187901    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:27.188004 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.187961    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs podName:d25b149c-939a-47cc-a11e-1622459b8051 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:29.18794389 +0000 UTC m=+6.007994664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs") pod "network-metrics-daemon-lgm8z" (UID: "d25b149c-939a-47cc-a11e-1622459b8051") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:27.288540 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.288503    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:27.288731 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.288711    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 12:25:27.288804 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.288738    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 12:25:27.288804 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.288751    2549 projected.go:196] Error preparing data for projected volume kube-api-access-n7ndm for pod openshift-network-diagnostics/network-check-target-rdcjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:27.288920 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.288807    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm podName:87800128-905c-4403-90b6-a01fa417c18e nodeName:}" failed. No retries permitted until 2026-07-29 12:25:29.288789013 +0000 UTC m=+6.108839771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7ndm" (UniqueName: "kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm") pod "network-check-target-rdcjp" (UID: "87800128-905c-4403-90b6-a01fa417c18e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:27.388882 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.388838    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:27.389064 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.389046    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:27.389131 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.389120    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret podName:6a0b1de9-3f31-4d44-93da-67c53dea462d nodeName:}" failed. No retries permitted until 2026-07-29 12:25:29.389102263 +0000 UTC m=+6.209153032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret") pod "global-pull-secret-syncer-dxw26" (UID: "6a0b1de9-3f31-4d44-93da-67c53dea462d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:27.606195 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.606153    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 12:20:25 +0000 UTC" deadline="2028-04-23 05:28:43.565176844 +0000 UTC"
Jul 29 12:25:27.606657 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.606205    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15209h3m15.95898826s"
Jul 29 12:25:27.702502 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.702440    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:27.702665 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.702588    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:27.703118 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.703096    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:27.703252 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:27.703231    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:27.733082 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.733013    2549 generic.go:356] "Generic (PLEG): container finished" podID="6d945be348fd36afce90ee681816b7a1" containerID="3831dfa300751fc4bd4cb7fb88a7915b58275bbec4ba280be869955a190ba023" exitCode=0
Jul 29 12:25:27.733574 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:27.733519    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" event={"ID":"6d945be348fd36afce90ee681816b7a1","Type":"ContainerDied","Data":"3831dfa300751fc4bd4cb7fb88a7915b58275bbec4ba280be869955a190ba023"}
Jul 29 12:25:28.691038 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:28.690579    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:28.691038 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:28.690698    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:28.759983 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:28.759230    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" event={"ID":"6d945be348fd36afce90ee681816b7a1","Type":"ContainerStarted","Data":"98a2a13a903a14cdc6ff279aba1aeeda8ae995ccb66052379bbaaba394a82fe9"}
Jul 29 12:25:29.218519 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:29.218481    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:29.218754 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.218707    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:29.218837 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.218775    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs podName:d25b149c-939a-47cc-a11e-1622459b8051 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:33.218755323 +0000 UTC m=+10.038806080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs") pod "network-metrics-daemon-lgm8z" (UID: "d25b149c-939a-47cc-a11e-1622459b8051") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:29.319683 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:29.319641    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:29.319847 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.319815    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 12:25:29.319847 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.319835    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 12:25:29.319966 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.319849    2549 projected.go:196] Error preparing data for projected volume kube-api-access-n7ndm for pod openshift-network-diagnostics/network-check-target-rdcjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:29.319966 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.319910    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm podName:87800128-905c-4403-90b6-a01fa417c18e nodeName:}" failed. No retries permitted until 2026-07-29 12:25:33.319890802 +0000 UTC m=+10.139941560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7ndm" (UniqueName: "kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm") pod "network-check-target-rdcjp" (UID: "87800128-905c-4403-90b6-a01fa417c18e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:29.420352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:29.420303    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:29.420513 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.420465    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:29.420583 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.420524    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret podName:6a0b1de9-3f31-4d44-93da-67c53dea462d nodeName:}" failed. No retries permitted until 2026-07-29 12:25:33.420506652 +0000 UTC m=+10.240557413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret") pod "global-pull-secret-syncer-dxw26" (UID: "6a0b1de9-3f31-4d44-93da-67c53dea462d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:29.690907 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:29.690875    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:29.691101 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:29.690919    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:29.691101 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.691028    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:29.691550 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:29.691119    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:30.691558 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:30.691086    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:30.691558 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:30.691208    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:31.692808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:31.690689    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:31.692808 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:31.690828    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:31.692808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:31.690904    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:31.692808 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:31.691013    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:32.690413 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:32.690370    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:32.690598 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:32.690513    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:33.256108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:33.255541    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:33.256108 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.255713    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:33.256108 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.255775    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs podName:d25b149c-939a-47cc-a11e-1622459b8051 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:41.255756486 +0000 UTC m=+18.075807258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs") pod "network-metrics-daemon-lgm8z" (UID: "d25b149c-939a-47cc-a11e-1622459b8051") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:33.356395 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:33.356361    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:33.356570 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.356536    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 12:25:33.356570 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.356561    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 12:25:33.356682 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.356573    2549 projected.go:196] Error preparing data for projected volume kube-api-access-n7ndm for pod openshift-network-diagnostics/network-check-target-rdcjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:33.356682 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.356630    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm podName:87800128-905c-4403-90b6-a01fa417c18e nodeName:}" failed. No retries permitted until 2026-07-29 12:25:41.356611227 +0000 UTC m=+18.176661986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7ndm" (UniqueName: "kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm") pod "network-check-target-rdcjp" (UID: "87800128-905c-4403-90b6-a01fa417c18e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:33.457481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:33.457445    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:33.457647 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.457586    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:33.457699 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.457647    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret podName:6a0b1de9-3f31-4d44-93da-67c53dea462d nodeName:}" failed. No retries permitted until 2026-07-29 12:25:41.457629074 +0000 UTC m=+18.277679852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret") pod "global-pull-secret-syncer-dxw26" (UID: "6a0b1de9-3f31-4d44-93da-67c53dea462d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:33.690534 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:33.690467    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:33.690725 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.690606    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:33.691862 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:33.691733    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:33.691862 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:33.691818    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:34.690903 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:34.690411    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:34.690903 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:34.690557    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:35.691068 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:35.691038    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:35.691486 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:35.691176    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:35.691486 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:35.691365    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:35.691486 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:35.691450    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:36.691103 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:36.691072    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:36.691604 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:36.691167    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:37.691293 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:37.691254    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:37.691758 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:37.691295    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:37.691758 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:37.691415    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:37.691758 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:37.691546    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:38.690271 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:38.690235    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:38.690452 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:38.690357    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:39.690778 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:39.690742    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:39.690778 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:39.690761    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:39.691271 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:39.690873    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:39.691271 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:39.690960    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:40.690485 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:40.690451    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:40.690706 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:40.690590    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:41.319299 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:41.319267    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:41.319658 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.319387    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:41.319658 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.319437    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs podName:d25b149c-939a-47cc-a11e-1622459b8051 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:57.319423491 +0000 UTC m=+34.139474246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs") pod "network-metrics-daemon-lgm8z" (UID: "d25b149c-939a-47cc-a11e-1622459b8051") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:41.420167 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:41.420145    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:41.420299 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.420279    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 12:25:41.420433 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.420304    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 12:25:41.420433 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.420333    2549 projected.go:196] Error preparing data for projected volume kube-api-access-n7ndm for pod openshift-network-diagnostics/network-check-target-rdcjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:41.420433 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.420397    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm podName:87800128-905c-4403-90b6-a01fa417c18e nodeName:}" failed. No retries permitted until 2026-07-29 12:25:57.420378075 +0000 UTC m=+34.240428843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7ndm" (UniqueName: "kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm") pod "network-check-target-rdcjp" (UID: "87800128-905c-4403-90b6-a01fa417c18e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:41.521304 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:41.521270    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:41.521480 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.521433    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:41.521539 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.521517    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret podName:6a0b1de9-3f31-4d44-93da-67c53dea462d nodeName:}" failed. No retries permitted until 2026-07-29 12:25:57.521496817 +0000 UTC m=+34.341547579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret") pod "global-pull-secret-syncer-dxw26" (UID: "6a0b1de9-3f31-4d44-93da-67c53dea462d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:41.691235 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:41.691142    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:41.691428 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.691291    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:41.691428 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:41.691355    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:41.691533 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:41.691471    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:42.690422 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:42.690387    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:42.690844 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:42.690497    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:43.691663 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:43.691633    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:43.692070 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:43.691732    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:43.692070 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:43.691814    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:43.692070 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:43.691912    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:44.690800 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:44.690766    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:44.690983 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:44.690897    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:45.690673 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.690520    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:45.691208 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.690564    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:45.691208 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:45.690759    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:45.691208 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:45.690818    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:45.792133 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.792108    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"0cfbd9a6c84d1b6c25fb80de3e0418bbcee69992c54b95460bffd4723a507334"}
Jul 29 12:25:45.792220 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.792197    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"d0db7f9dbf1b6e55866c8eccf648900abb12c7f216e093394861f2f68dde105d"}
Jul 29 12:25:45.793456 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.793430    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8r7n" event={"ID":"38bd4376-7d36-4d25-974d-6fbc3fd5b574","Type":"ContainerStarted","Data":"f52d05f14bb0f042298863a4f0cec9919aed0765dbee5db20654ad1530dd5991"}
Jul 29 12:25:45.794686 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.794664    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fjzlq" event={"ID":"cdc6a98e-ba32-4e69-a42e-a7384d0608be","Type":"ContainerStarted","Data":"e9d3a20b240e793ab88db4cd35135121b2257bcf91fdc99e0d4f6ce8c5e1c137"}
Jul 29 12:25:45.795918 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.795899    2549 generic.go:356] "Generic (PLEG): container finished" podID="71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1" containerID="377eef8d8e7a8601cec3900f54cced4f90e09f9c642a28f45a1ef85b78accf80" exitCode=0
Jul 29 12:25:45.795992 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.795960    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerDied","Data":"377eef8d8e7a8601cec3900f54cced4f90e09f9c642a28f45a1ef85b78accf80"}
Jul 29 12:25:45.797524 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.797490    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-28jlg" event={"ID":"37ed631f-96d3-47ae-a9c2-bb78aca48e33","Type":"ContainerStarted","Data":"c7ef529f3877c56c8bdc3440ae5da3c5e4066639fdd18bdb941d5b1e3539684a"}
Jul 29 12:25:45.801079 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.801055    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp" event={"ID":"3f4acd0e-0c89-4836-94a7-f15287c1ab38","Type":"ContainerStarted","Data":"60cd480ba93898817fcfe76041a42ae28724d23f30238132cd3b3deb6bcec736"}
Jul 29 12:25:45.802295 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.802267    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvjsv" event={"ID":"f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f","Type":"ContainerStarted","Data":"cb405460f11dbe3a9680e80f6d7b5bea5636ce315b0f0b78aa8dae24b51a600b"}
Jul 29 12:25:45.803590 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.803569    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vd92h" event={"ID":"d2a0cc2e-2228-4b4f-8d52-596334f087fc","Type":"ContainerStarted","Data":"b72a8813f424c9bdbec9835827a8f5ad5195b00f4793b63a07642d2df76b5e46"}
Jul 29 12:25:45.808522 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.808487    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" podStartSLOduration=21.808477032 podStartE2EDuration="21.808477032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:28.7786361 +0000 UTC m=+5.598686878" watchObservedRunningTime="2026-07-29 12:25:45.808477032 +0000 UTC m=+22.628527816"
Jul 29 12:25:45.808978 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.808943    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g8r7n" podStartSLOduration=4.341375235 podStartE2EDuration="22.808932436s" totalImagesPullingTime="18.467557201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:45.808234395 +0000 UTC m=+22.628285184" watchObservedRunningTime="2026-07-29 12:25:45.808932436 +0000 UTC m=+22.628983222"
Jul 29 12:25:45.847984 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.847951    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-28jlg" podStartSLOduration=4.045829194 podStartE2EDuration="22.847938242s" totalImagesPullingTime="18.802109048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:45.847712963 +0000 UTC m=+22.667763751" watchObservedRunningTime="2026-07-29 12:25:45.847938242 +0000 UTC m=+22.667989018"
Jul 29 12:25:45.863879 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.863838    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fjzlq" podStartSLOduration=4.318774981 podStartE2EDuration="22.863826859s" totalImagesPullingTime="18.545051878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:45.863821076 +0000 UTC m=+22.683871855" watchObservedRunningTime="2026-07-29 12:25:45.863826859 +0000 UTC m=+22.683877635"
Jul 29 12:25:45.900781 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.900661    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jvjsv" podStartSLOduration=4.426521243 podStartE2EDuration="22.900647069s" totalImagesPullingTime="18.474125826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:45.882275875 +0000 UTC m=+22.702326653" watchObservedRunningTime="2026-07-29 12:25:45.900647069 +0000 UTC m=+22.720697845"
Jul 29 12:25:45.901103 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:45.901064    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vd92h" podStartSLOduration=4.353216922 podStartE2EDuration="22.901054326s" totalImagesPullingTime="18.547837404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:45.900548469 +0000 UTC m=+22.720599247" watchObservedRunningTime="2026-07-29 12:25:45.901054326 +0000 UTC m=+22.721105103"
Jul 29 12:25:46.521680 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.521605    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:46.522449 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.522398    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:46.616777 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.616748    2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 12:25:46.635437 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.635353    2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T12:25:46.616772396Z","UUID":"d218631d-77bc-45a0-89c4-e83ba0c76dbc","Handler":null,"Name":"","Endpoint":""}
Jul 29 12:25:46.637138 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.637116    2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 12:25:46.637241 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.637159    2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 12:25:46.690822 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.690786    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:46.691539 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:46.690904    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:46.809688 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.809658    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:25:46.810059 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.810037    2549 generic.go:356] "Generic (PLEG): container finished" podID="9af8fcd6-a294-4c89-ad11-6d36b32a0a52" containerID="0cfbd9a6c84d1b6c25fb80de3e0418bbcee69992c54b95460bffd4723a507334" exitCode=1
Jul 29 12:25:46.810169 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.810118    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerDied","Data":"0cfbd9a6c84d1b6c25fb80de3e0418bbcee69992c54b95460bffd4723a507334"}
Jul 29 12:25:46.810227 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.810213    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"5b88662e8be5c8c6dde7a8e73b4f0c4aac35799431daa5b99ed0d4112e8656fc"}
Jul 29 12:25:46.810281 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.810267    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"1ecc38f686b6fed6f21f3972d029f7105c8a998471c9303fd7c6dc1b03063398"}
Jul 29 12:25:46.810350 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.810335    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"f484b6bccff7d3fcdf57b5205beb2f8502bca3980a8d3da60bde507778a9a3fe"}
Jul 29 12:25:46.810416 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.810394    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"ebe7e018bb8ed59a830a685ad839a70332ecf14839b17f018ccd8b8a2cd9e39b"}
Jul 29 12:25:46.811697 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.811666    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wt5fm" event={"ID":"8623462d-559c-44f5-b5e0-5e8bcc34a524","Type":"ContainerStarted","Data":"358e6d25d58832adc1738dbd9c5ab70615443b50da0a76702fbab223a64b347c"}
Jul 29 12:25:46.813684 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.813659    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp" event={"ID":"3f4acd0e-0c89-4836-94a7-f15287c1ab38","Type":"ContainerStarted","Data":"d809a1ecab164a9de5eb078b2103f205aab52b36448c81e29a606847fbd4f13e"}
Jul 29 12:25:46.814158 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.813915    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:46.814277 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.814252    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jvjsv"
Jul 29 12:25:46.826883 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:46.826837    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wt5fm" podStartSLOduration=5.286551664 podStartE2EDuration="23.8268249s" totalImagesPullingTime="18.540273236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:46.82648299 +0000 UTC m=+23.646533766" watchObservedRunningTime="2026-07-29 12:25:46.8268249 +0000 UTC m=+23.646875676"
Jul 29 12:25:47.691373 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:47.691341    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:47.691373 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:47.691372    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:47.691934 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:47.691485    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:47.691934 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:47.691624    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:48.690800 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:48.690590    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:48.690944 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:48.690884    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:48.820205 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:48.820167    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp" event={"ID":"3f4acd0e-0c89-4836-94a7-f15287c1ab38","Type":"ContainerStarted","Data":"6b36d222b5403f70fc7be053f0291c2b44156347788b1852204427474c08248d"}
Jul 29 12:25:48.840940 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:48.840897    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5mldp" podStartSLOduration=5.024325135 podStartE2EDuration="25.840883522s" totalImagesPullingTime="20.816558387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:48.84078289 +0000 UTC m=+25.660833684" watchObservedRunningTime="2026-07-29 12:25:48.840883522 +0000 UTC m=+25.660934298"
Jul 29 12:25:49.690784 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:49.690746    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:49.690994 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:49.690746    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:49.690994 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:49.690873    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:49.690994 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:49.690951    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:50.690474 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:50.690450    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:50.691031 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:50.690541    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:50.826543 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:50.826519    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:25:50.826883 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:50.826862    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"fc2f2655ff1e9a19336f56d5d11656bccb15d787bffe9439467c90da8510d848"}
Jul 29 12:25:50.828358 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:50.828333    2549 generic.go:356] "Generic (PLEG): container finished" podID="71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1" containerID="eebf7b5e04647691d1d2c700fa9888f2a269d1724a93c2108c00f857c1caa121" exitCode=0
Jul 29 12:25:50.828443 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:50.828373    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerDied","Data":"eebf7b5e04647691d1d2c700fa9888f2a269d1724a93c2108c00f857c1caa121"}
Jul 29 12:25:51.691249 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:51.691210    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:51.691715 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:51.691330    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:51.691715 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:51.691369    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:51.691715 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:51.691461    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:52.690718 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.690549    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:52.690901 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:52.690796    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:52.838655 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.838629    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:25:52.839214 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.839015    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"e4ab15fe512bced5b282a6ff56eefbc21c718e150a1954afb2b51fee0dd1f0d5"}
Jul 29 12:25:52.839335 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.839298    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:52.839447 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.839381    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:52.839502 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.839484    2549 scope.go:117] "RemoveContainer" containerID="0cfbd9a6c84d1b6c25fb80de3e0418bbcee69992c54b95460bffd4723a507334"
Jul 29 12:25:52.841245 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.841221    2549 generic.go:356] "Generic (PLEG): container finished" podID="71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1" containerID="c4323f6ea227baecb629f17ca21e15c3ee8e0d573100a4feba6a5c398541045c" exitCode=0
Jul 29 12:25:52.841360 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.841252    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerDied","Data":"c4323f6ea227baecb629f17ca21e15c3ee8e0d573100a4feba6a5c398541045c"}
Jul 29 12:25:52.854945 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:52.854927    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:53.691179 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.691156    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:53.691289 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:53.691263    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:53.691373 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.691332    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:53.691461 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:53.691439    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:53.850909 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.850840    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:25:53.851345 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.851200    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" event={"ID":"9af8fcd6-a294-4c89-ad11-6d36b32a0a52","Type":"ContainerStarted","Data":"2da4fa8c113c95864aacd6a0b3576b5d1c9a6000b3bd817f071ee7db5c4807d5"}
Jul 29 12:25:53.851424 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.851406    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:53.853803 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.853776    2549 generic.go:356] "Generic (PLEG): container finished" podID="71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1" containerID="efaea23e317b10116ef5b82009ed24922c9cf3581fbfb91c39d9ea3de03a4b8a" exitCode=0
Jul 29 12:25:53.853908 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.853818    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerDied","Data":"efaea23e317b10116ef5b82009ed24922c9cf3581fbfb91c39d9ea3de03a4b8a"}
Jul 29 12:25:53.866906 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.866888    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:25:53.882842 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:53.882805    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x" podStartSLOduration=11.90389298 podStartE2EDuration="30.882794325s" totalImagesPullingTime="18.978901345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:25:53.88170616 +0000 UTC m=+30.701756937" watchObservedRunningTime="2026-07-29 12:25:53.882794325 +0000 UTC m=+30.702845101"
Jul 29 12:25:54.176438 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:54.176127    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxw26"]
Jul 29 12:25:54.176602 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:54.176500    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:54.176665 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:54.176615    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:54.180434 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:54.180409    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdcjp"]
Jul 29 12:25:54.180557 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:54.180513    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:54.180624 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:54.180602    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:54.181749 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:54.181726    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lgm8z"]
Jul 29 12:25:54.181864 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:54.181828    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:54.181968 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:54.181941    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:55.691227 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:55.691177    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:55.691759 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:55.691243    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:55.691759 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:55.691192    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:55.691759 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:55.691433    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgm8z" podUID="d25b149c-939a-47cc-a11e-1622459b8051"
Jul 29 12:25:55.691759 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:55.691566    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdcjp" podUID="87800128-905c-4403-90b6-a01fa417c18e"
Jul 29 12:25:55.691759 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:55.691665    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxw26" podUID="6a0b1de9-3f31-4d44-93da-67c53dea462d"
Jul 29 12:25:56.981448 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:56.981421    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeReady"
Jul 29 12:25:56.981998 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:56.981569    2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 12:25:57.034593 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.034514    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9j7j9"]
Jul 29 12:25:57.039665 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.039645    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sb5c9"]
Jul 29 12:25:57.039769 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.039746    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.042659 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.042638    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 12:25:57.042930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.042886    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 12:25:57.043095 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.043071    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.043338 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.043226    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zrh5t\""
Jul 29 12:25:57.045150 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.045134    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 12:25:57.045430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.045407    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 12:25:57.045648 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.045633    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 12:25:57.045720 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.045684    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2fqhh\""
Jul 29 12:25:57.049822 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.049807    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9j7j9"]
Jul 29 12:25:57.053883 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.053864    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sb5c9"]
Jul 29 12:25:57.144608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.144574    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f6429a-1594-466d-b5ba-5313e55d8eab-tmp-dir\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.144769 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.144668    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09f20c1e-764a-425d-a975-99e9fb8fa8d6-cert\") pod \"ingress-canary-sb5c9\" (UID: \"09f20c1e-764a-425d-a975-99e9fb8fa8d6\") " pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.144769 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.144715    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.144769 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.144751    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqcw6\" (UniqueName: \"kubernetes.io/projected/09f20c1e-764a-425d-a975-99e9fb8fa8d6-kube-api-access-nqcw6\") pod \"ingress-canary-sb5c9\" (UID: \"09f20c1e-764a-425d-a975-99e9fb8fa8d6\") " pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.144892 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.144779    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5f6429a-1594-466d-b5ba-5313e55d8eab-config-volume\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.144892 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.144817    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnjz\" (UniqueName: \"kubernetes.io/projected/a5f6429a-1594-466d-b5ba-5313e55d8eab-kube-api-access-7gnjz\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.245918 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.245888    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f6429a-1594-466d-b5ba-5313e55d8eab-tmp-dir\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.246111 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.245951    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09f20c1e-764a-425d-a975-99e9fb8fa8d6-cert\") pod \"ingress-canary-sb5c9\" (UID: \"09f20c1e-764a-425d-a975-99e9fb8fa8d6\") " pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.246111 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.246004    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.246111 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.246028    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqcw6\" (UniqueName: \"kubernetes.io/projected/09f20c1e-764a-425d-a975-99e9fb8fa8d6-kube-api-access-nqcw6\") pod \"ingress-canary-sb5c9\" (UID: \"09f20c1e-764a-425d-a975-99e9fb8fa8d6\") " pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.246111 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.246063    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5f6429a-1594-466d-b5ba-5313e55d8eab-config-volume\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.246111 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.246080    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnjz\" (UniqueName: \"kubernetes.io/projected/a5f6429a-1594-466d-b5ba-5313e55d8eab-kube-api-access-7gnjz\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.246402 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.246138    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 12:25:57.246402 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.246208    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls podName:a5f6429a-1594-466d-b5ba-5313e55d8eab nodeName:}" failed. No retries permitted until 2026-07-29 12:25:57.74618612 +0000 UTC m=+34.566236894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls") pod "dns-default-9j7j9" (UID: "a5f6429a-1594-466d-b5ba-5313e55d8eab") : secret "dns-default-metrics-tls" not found
Jul 29 12:25:57.246601 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.246581    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f6429a-1594-466d-b5ba-5313e55d8eab-tmp-dir\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.246824 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.246806    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5f6429a-1594-466d-b5ba-5313e55d8eab-config-volume\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.250628 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.250604    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09f20c1e-764a-425d-a975-99e9fb8fa8d6-cert\") pod \"ingress-canary-sb5c9\" (UID: \"09f20c1e-764a-425d-a975-99e9fb8fa8d6\") " pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.256065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.256046    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqcw6\" (UniqueName: \"kubernetes.io/projected/09f20c1e-764a-425d-a975-99e9fb8fa8d6-kube-api-access-nqcw6\") pod \"ingress-canary-sb5c9\" (UID: \"09f20c1e-764a-425d-a975-99e9fb8fa8d6\") " pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.256273 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.256254    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnjz\" (UniqueName: \"kubernetes.io/projected/a5f6429a-1594-466d-b5ba-5313e55d8eab-kube-api-access-7gnjz\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.300520 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.300433    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"]
Jul 29 12:25:57.305223 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.305205    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rwhd5"]
Jul 29 12:25:57.305366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.305348    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"
Jul 29 12:25:57.307602 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.307585    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-69hgt\""
Jul 29 12:25:57.307602 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.307593    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 12:25:57.307876 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.307862    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 12:25:57.308451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.308434    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"]
Jul 29 12:25:57.308586 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.308567    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.311616 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.311599    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:57.312387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.312369    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 12:25:57.312623 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.312604    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 12:25:57.312716 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.312604    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-j57k2\""
Jul 29 12:25:57.312716 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.312676    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 12:25:57.315839 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.314060    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 12:25:57.315839 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.315104    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x4kfg\""
Jul 29 12:25:57.315839 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.315758    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"]
Jul 29 12:25:57.316014 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.315892    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 12:25:57.316170 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.316065    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 12:25:57.316265 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.316247    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 12:25:57.324132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.321876    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rwhd5"]
Jul 29 12:25:57.324132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.322851    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"]
Jul 29 12:25:57.325841 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.325815    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 12:25:57.346811 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.346781    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:57.346941 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.346922    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:57.346997 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.346987    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs podName:d25b149c-939a-47cc-a11e-1622459b8051 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:29.346970649 +0000 UTC m=+66.167021403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs") pod "network-metrics-daemon-lgm8z" (UID: "d25b149c-939a-47cc-a11e-1622459b8051") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 12:25:57.358835 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.358811    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sb5c9"
Jul 29 12:25:57.406807 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.406762    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-4x8mj"]
Jul 29 12:25:57.410795 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.410142    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.410795 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.410626    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c6999b477-zzhch"]
Jul 29 12:25:57.412820 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.412799    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 12:25:57.412911 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.412866    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 12:25:57.413095 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.413076    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 12:25:57.413161 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.413107    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 12:25:57.413212 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.413083    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rjz46\""
Jul 29 12:25:57.413708 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.413691    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.416601 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.416580    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 12:25:57.416601 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.416596    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 12:25:57.416736 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.416655    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 12:25:57.416904 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.416886    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 12:25:57.417071 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.417050    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 12:25:57.417142 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.417082    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9drwn\""
Jul 29 12:25:57.417409 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.417385    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 12:25:57.418630 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.418614    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 12:25:57.421728 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.421710    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-4x8mj"]
Jul 29 12:25:57.427891 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.427871    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c6999b477-zzhch"]
Jul 29 12:25:57.447291 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447265    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69de03dc-f10f-4862-99d2-dace592aa3d1-config\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.447408 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447305    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lzfc\" (UniqueName: \"kubernetes.io/projected/1a263c2b-6636-42fe-8da8-4fb2bfcc80e7-kube-api-access-7lzfc\") pod \"volume-data-source-validator-549c6d54cf-wdqht\" (UID: \"1a263c2b-6636-42fe-8da8-4fb2bfcc80e7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"
Jul 29 12:25:57.447408 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447349    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjqqg\" (UniqueName: \"kubernetes.io/projected/69de03dc-f10f-4862-99d2-dace592aa3d1-kube-api-access-kjqqg\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.447524 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447438    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6m6n\" (UniqueName: \"kubernetes.io/projected/2da745e9-f759-4841-b326-2da3f1e9eb71-kube-api-access-s6m6n\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:57.447524 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447461    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:57.447524 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447475    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69de03dc-f10f-4862-99d2-dace592aa3d1-trusted-ca\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.447524 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447503    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:57.447718 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.447582    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69de03dc-f10f-4862-99d2-dace592aa3d1-serving-cert\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.447718 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.447610    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 12:25:57.447718 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.447631    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 12:25:57.447718 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.447642    2549 projected.go:196] Error preparing data for projected volume kube-api-access-n7ndm for pod openshift-network-diagnostics/network-check-target-rdcjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:57.447718 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.447705    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm podName:87800128-905c-4403-90b6-a01fa417c18e nodeName:}" failed. No retries permitted until 2026-07-29 12:26:29.447692303 +0000 UTC m=+66.267743057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7ndm" (UniqueName: "kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm") pod "network-check-target-rdcjp" (UID: "87800128-905c-4403-90b6-a01fa417c18e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 12:25:57.498592 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.498564    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7576c6554-btgqv"]
Jul 29 12:25:57.501825 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.501805    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.507596 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.507569    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 12:25:57.507596 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.507581    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 12:25:57.507841 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.507822    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bggs6\""
Jul 29 12:25:57.508134 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.508115    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 12:25:57.514802 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.514786    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 12:25:57.529608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.529449    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7576c6554-btgqv"]
Jul 29 12:25:57.548139 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.548115    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-snapshots\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.548234 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.548150    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrqg\" (UniqueName: \"kubernetes.io/projected/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-kube-api-access-zzrqg\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.548234 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.548214    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6m6n\" (UniqueName: \"kubernetes.io/projected/2da745e9-f759-4841-b326-2da3f1e9eb71-kube-api-access-s6m6n\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:57.548332 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.548242    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-stats-auth\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.548332 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.548271    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:57.548332 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.548297    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69de03dc-f10f-4862-99d2-dace592aa3d1-trusted-ca\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.548481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.548369    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.549838    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69de03dc-f10f-4862-99d2-dace592aa3d1-trusted-ca\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.549906    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.549992    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69de03dc-f10f-4862-99d2-dace592aa3d1-serving-cert\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550026    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-default-certificate\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550050    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-service-ca-bundle\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550087    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550121    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69de03dc-f10f-4862-99d2-dace592aa3d1-config\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550150    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-tmp\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550182    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550217    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lzfc\" (UniqueName: \"kubernetes.io/projected/1a263c2b-6636-42fe-8da8-4fb2bfcc80e7-kube-api-access-7lzfc\") pod \"volume-data-source-validator-549c6d54cf-wdqht\" (UID: \"1a263c2b-6636-42fe-8da8-4fb2bfcc80e7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550242    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-serving-cert\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550280    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fjlp\" (UniqueName: \"kubernetes.io/projected/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-kube-api-access-8fjlp\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.550335    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjqqg\" (UniqueName: \"kubernetes.io/projected/69de03dc-f10f-4862-99d2-dace592aa3d1-kube-api-access-kjqqg\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.551783    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.551850    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret podName:6a0b1de9-3f31-4d44-93da-67c53dea462d nodeName:}" failed. No retries permitted until 2026-07-29 12:26:29.551827246 +0000 UTC m=+66.371878013 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret") pod "global-pull-secret-syncer-dxw26" (UID: "6a0b1de9-3f31-4d44-93da-67c53dea462d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 12:25:57.551930 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.551862    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 12:25:57.552693 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.551947    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls podName:2da745e9-f759-4841-b326-2da3f1e9eb71 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:58.05192187 +0000 UTC m=+34.871972646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls") pod "cluster-samples-operator-6748489656-zbzrp" (UID: "2da745e9-f759-4841-b326-2da3f1e9eb71") : secret "samples-operator-tls" not found
Jul 29 12:25:57.552693 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.552521    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69de03dc-f10f-4862-99d2-dace592aa3d1-config\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.553815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.553789    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69de03dc-f10f-4862-99d2-dace592aa3d1-serving-cert\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.570093 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.570070    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6m6n\" (UniqueName: \"kubernetes.io/projected/2da745e9-f759-4841-b326-2da3f1e9eb71-kube-api-access-s6m6n\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:57.576620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.576601    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjqqg\" (UniqueName: \"kubernetes.io/projected/69de03dc-f10f-4862-99d2-dace592aa3d1-kube-api-access-kjqqg\") pod \"console-operator-584dcb6b54-rwhd5\" (UID: \"69de03dc-f10f-4862-99d2-dace592aa3d1\") " pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.584802 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.584775    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lzfc\" (UniqueName: \"kubernetes.io/projected/1a263c2b-6636-42fe-8da8-4fb2bfcc80e7-kube-api-access-7lzfc\") pod \"volume-data-source-validator-549c6d54cf-wdqht\" (UID: \"1a263c2b-6636-42fe-8da8-4fb2bfcc80e7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"
Jul 29 12:25:57.622235 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.622217    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"
Jul 29 12:25:57.630738 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.630701    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:25:57.651108 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651089    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-snapshots\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.651209 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651118    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrqg\" (UniqueName: \"kubernetes.io/projected/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-kube-api-access-zzrqg\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.651209 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651169    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-stats-auth\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.651209 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651195    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.651387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651218    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-default-certificate\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.651387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651244    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-service-ca-bundle\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.651387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651269    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-serving-cert\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.651387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651292    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-image-registry-private-configuration\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651331    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c149ff4-c128-4f3e-b5bb-df97f594d037-ca-trust-extracted\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651351    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-installation-pull-secrets\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651387 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651385    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651409    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651432    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-trusted-ca\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651477    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv28w\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-kube-api-access-gv28w\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651505    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-tmp\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651524    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651553    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fjlp\" (UniqueName: \"kubernetes.io/projected/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-kube-api-access-8fjlp\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.651585    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651600    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-certificates\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651636    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-bound-sa-token\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.651755 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.651650    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:25:58.151630382 +0000 UTC m=+34.971681157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : secret "router-metrics-certs-default" not found
Jul 29 12:25:57.652225 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.651774    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:25:58.151759995 +0000 UTC m=+34.971810773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : configmap references non-existent config key: service-ca.crt
Jul 29 12:25:57.652225 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651790    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-snapshots\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.652225 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.651882    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-tmp\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.652792 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.652770    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-service-ca-bundle\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.652863 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.652810    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.653969 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.653947    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-serving-cert\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.654086 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.654067    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-stats-auth\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.654667 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.654645    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-default-certificate\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.666571 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.666552    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrqg\" (UniqueName: \"kubernetes.io/projected/2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778-kube-api-access-zzrqg\") pod \"insights-operator-5885fdb759-4x8mj\" (UID: \"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778\") " pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.668101 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.668081    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fjlp\" (UniqueName: \"kubernetes.io/projected/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-kube-api-access-8fjlp\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:57.690440 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.690419    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:25:57.690538 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.690439    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:25:57.690538 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.690441    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:25:57.697658 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.697640    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 12:25:57.698697 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.698227    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4f75\""
Jul 29 12:25:57.698697 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.698262    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 12:25:57.698697 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.698290    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 12:25:57.698697 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.698549    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hdxp9\""
Jul 29 12:25:57.699206 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.699190    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 12:25:57.722917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.722900    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-4x8mj"
Jul 29 12:25:57.752359 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752333    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-image-registry-private-configuration\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752466 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752375    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c149ff4-c128-4f3e-b5bb-df97f594d037-ca-trust-extracted\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752466 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752405    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-installation-pull-secrets\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752466 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752456    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752632 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752479    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-trusted-ca\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752632 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752523    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv28w\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-kube-api-access-gv28w\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752632 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752556    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-certificates\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752632 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.752568    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 12:25:57.752632 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752580    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-bound-sa-token\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752632 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.752588    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7576c6554-btgqv: secret "image-registry-tls" not found
Jul 29 12:25:57.752893 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.752659    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls podName:9c149ff4-c128-4f3e-b5bb-df97f594d037 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:58.252639974 +0000 UTC m=+35.072690738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls") pod "image-registry-7576c6554-btgqv" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037") : secret "image-registry-tls" not found
Jul 29 12:25:57.752893 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752689    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:57.752893 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.752741    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c149ff4-c128-4f3e-b5bb-df97f594d037-ca-trust-extracted\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.752893 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.752799    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 12:25:57.752893 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:57.752854    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls podName:a5f6429a-1594-466d-b5ba-5313e55d8eab nodeName:}" failed. No retries permitted until 2026-07-29 12:25:58.752840338 +0000 UTC m=+35.572891092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls") pod "dns-default-9j7j9" (UID: "a5f6429a-1594-466d-b5ba-5313e55d8eab") : secret "dns-default-metrics-tls" not found
Jul 29 12:25:57.753378 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.753356    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-certificates\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.753591 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.753570    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-trusted-ca\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.754982 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.754959    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-installation-pull-secrets\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.755388 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.755370    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-image-registry-private-configuration\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.767118 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.767094    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-bound-sa-token\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:57.767759 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:57.767738    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv28w\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-kube-api-access-gv28w\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:58.055177 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.055139    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:58.055849 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.055292    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 12:25:58.055849 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.055385    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls podName:2da745e9-f759-4841-b326-2da3f1e9eb71 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:59.05536561 +0000 UTC m=+35.875416585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls") pod "cluster-samples-operator-6748489656-zbzrp" (UID: "2da745e9-f759-4841-b326-2da3f1e9eb71") : secret "samples-operator-tls" not found
Jul 29 12:25:58.156057 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.156019    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:58.156232 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.156113    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:58.156232 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.156213    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:25:59.156190359 +0000 UTC m=+35.976241133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : configmap references non-existent config key: service-ca.crt
Jul 29 12:25:58.156232 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.156232    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 12:25:58.156451 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.156294    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:25:59.15628167 +0000 UTC m=+35.976332425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : secret "router-metrics-certs-default" not found
Jul 29 12:25:58.261457 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.261217    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:58.261845 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.261624    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 12:25:58.261845 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.261643    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7576c6554-btgqv: secret "image-registry-tls" not found
Jul 29 12:25:58.261845 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.261695    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls podName:9c149ff4-c128-4f3e-b5bb-df97f594d037 nodeName:}" failed. No retries permitted until 2026-07-29 12:25:59.261677425 +0000 UTC m=+36.081728196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls") pod "image-registry-7576c6554-btgqv" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037") : secret "image-registry-tls" not found
Jul 29 12:25:58.326620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.326594    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sb5c9"]
Jul 29 12:25:58.330935 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:58.330905    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f20c1e_764a_425d_a975_99e9fb8fa8d6.slice/crio-b53938cf27d3e73588e2ac95342f600ba54bcb55dfcd7b1097ef5e4c33b5a453 WatchSource:0}: Error finding container b53938cf27d3e73588e2ac95342f600ba54bcb55dfcd7b1097ef5e4c33b5a453: Status 404 returned error can't find the container with id b53938cf27d3e73588e2ac95342f600ba54bcb55dfcd7b1097ef5e4c33b5a453
Jul 29 12:25:58.335112 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.335090    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht"]
Jul 29 12:25:58.338451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.338425    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rwhd5"]
Jul 29 12:25:58.339180 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.339160    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-4x8mj"]
Jul 29 12:25:58.340029 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:58.339890    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a263c2b_6636_42fe_8da8_4fb2bfcc80e7.slice/crio-b7d147061561e72577ddf3bef30533e0ae87582f3a9d3b6fe4c0b6890d9508d6 WatchSource:0}: Error finding container b7d147061561e72577ddf3bef30533e0ae87582f3a9d3b6fe4c0b6890d9508d6: Status 404 returned error can't find the container with id b7d147061561e72577ddf3bef30533e0ae87582f3a9d3b6fe4c0b6890d9508d6
Jul 29 12:25:58.342452 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:58.342082    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69de03dc_f10f_4862_99d2_dace592aa3d1.slice/crio-25148e62492426fd0a231ab794efbcb1986c3e1ddb0321f7dfe540b140f8ec14 WatchSource:0}: Error finding container 25148e62492426fd0a231ab794efbcb1986c3e1ddb0321f7dfe540b140f8ec14: Status 404 returned error can't find the container with id 25148e62492426fd0a231ab794efbcb1986c3e1ddb0321f7dfe540b140f8ec14
Jul 29 12:25:58.343719 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:25:58.343697    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2ccb9b_6c4e_49cb_84e6_f9e47fea9778.slice/crio-4b972ad1c599f8f35a28308fccb753a35ffce351f709c154f6496b0618df60a5 WatchSource:0}: Error finding container 4b972ad1c599f8f35a28308fccb753a35ffce351f709c154f6496b0618df60a5: Status 404 returned error can't find the container with id 4b972ad1c599f8f35a28308fccb753a35ffce351f709c154f6496b0618df60a5
Jul 29 12:25:58.764917 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.764830    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:25:58.765087 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.764970    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 12:25:58.765087 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:58.765034    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls podName:a5f6429a-1594-466d-b5ba-5313e55d8eab nodeName:}" failed. No retries permitted until 2026-07-29 12:26:00.765016926 +0000 UTC m=+37.585067697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls") pod "dns-default-9j7j9" (UID: "a5f6429a-1594-466d-b5ba-5313e55d8eab") : secret "dns-default-metrics-tls" not found
Jul 29 12:25:58.870534 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.870499    2549 generic.go:356] "Generic (PLEG): container finished" podID="71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1" containerID="7591b5e0f9d8def8f33db11585390f4d9a99c044eefbba5f4fc61d9a2a245269" exitCode=0
Jul 29 12:25:58.870704 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.870587    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerDied","Data":"7591b5e0f9d8def8f33db11585390f4d9a99c044eefbba5f4fc61d9a2a245269"}
Jul 29 12:25:58.871912 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.871887    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sb5c9" event={"ID":"09f20c1e-764a-425d-a975-99e9fb8fa8d6","Type":"ContainerStarted","Data":"b53938cf27d3e73588e2ac95342f600ba54bcb55dfcd7b1097ef5e4c33b5a453"}
Jul 29 12:25:58.873044 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.873023    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4x8mj" event={"ID":"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778","Type":"ContainerStarted","Data":"4b972ad1c599f8f35a28308fccb753a35ffce351f709c154f6496b0618df60a5"}
Jul 29 12:25:58.874613 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.874577    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht" event={"ID":"1a263c2b-6636-42fe-8da8-4fb2bfcc80e7","Type":"ContainerStarted","Data":"b7d147061561e72577ddf3bef30533e0ae87582f3a9d3b6fe4c0b6890d9508d6"}
Jul 29 12:25:58.876716 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:58.876692    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" event={"ID":"69de03dc-f10f-4862-99d2-dace592aa3d1","Type":"ContainerStarted","Data":"25148e62492426fd0a231ab794efbcb1986c3e1ddb0321f7dfe540b140f8ec14"}
Jul 29 12:25:59.068927 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:59.068405    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:25:59.068927 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.068622    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 12:25:59.068927 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.068706    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls podName:2da745e9-f759-4841-b326-2da3f1e9eb71 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:01.068683443 +0000 UTC m=+37.888734221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls") pod "cluster-samples-operator-6748489656-zbzrp" (UID: "2da745e9-f759-4841-b326-2da3f1e9eb71") : secret "samples-operator-tls" not found
Jul 29 12:25:59.169165 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:59.169131    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:59.169347 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:59.169224    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:25:59.169425 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.169348    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 12:25:59.169425 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.169409    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:01.169389959 +0000 UTC m=+37.989440723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : secret "router-metrics-certs-default" not found
Jul 29 12:25:59.169580 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.169565    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:01.169557306 +0000 UTC m=+37.989608061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : configmap references non-existent config key: service-ca.crt
Jul 29 12:25:59.270610 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:59.270575    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:25:59.270779 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.270742    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 12:25:59.270779 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.270757    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7576c6554-btgqv: secret "image-registry-tls" not found
Jul 29 12:25:59.270891 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:25:59.270823    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls podName:9c149ff4-c128-4f3e-b5bb-df97f594d037 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:01.270796596 +0000 UTC m=+38.090847364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls") pod "image-registry-7576c6554-btgqv" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037") : secret "image-registry-tls" not found
Jul 29 12:25:59.883505 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:59.883463    2549 generic.go:356] "Generic (PLEG): container finished" podID="71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1" containerID="553594cf2d5019522aeaf44f8a74e5f8429d0b63fb7bacc138713532b83ddb34" exitCode=0
Jul 29 12:25:59.883686 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:25:59.883544    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerDied","Data":"553594cf2d5019522aeaf44f8a74e5f8429d0b63fb7bacc138713532b83ddb34"}
Jul 29 12:26:00.783902 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:00.783856    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:00.784400 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:00.784027    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 12:26:00.784400 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:00.784107    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls podName:a5f6429a-1594-466d-b5ba-5313e55d8eab nodeName:}" failed. No retries permitted until 2026-07-29 12:26:04.784086108 +0000 UTC m=+41.604136882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls") pod "dns-default-9j7j9" (UID: "a5f6429a-1594-466d-b5ba-5313e55d8eab") : secret "dns-default-metrics-tls" not found
Jul 29 12:26:00.890527 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:00.890497    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72zgr" event={"ID":"71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1","Type":"ContainerStarted","Data":"308725d19c3af275938506ff0fe7e97a8af9fd5486c15fd88194e7625f61984a"}
Jul 29 12:26:00.919955 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:00.919893    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-72zgr" podStartSLOduration=8.634015334 podStartE2EDuration="37.919872197s" totalImagesPullingTime="29.285856863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:00.918451115 +0000 UTC m=+37.738501896" watchObservedRunningTime="2026-07-29 12:26:00.919872197 +0000 UTC m=+37.739922970"
Jul 29 12:26:01.086738 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:01.086486    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:26:01.086875 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.086630    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 12:26:01.086875 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.086828    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls podName:2da745e9-f759-4841-b326-2da3f1e9eb71 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:05.086809125 +0000 UTC m=+41.906859895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls") pod "cluster-samples-operator-6748489656-zbzrp" (UID: "2da745e9-f759-4841-b326-2da3f1e9eb71") : secret "samples-operator-tls" not found
Jul 29 12:26:01.188065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:01.188025    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:01.188253 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:01.188139    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:01.188253 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.188210    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:05.188187424 +0000 UTC m=+42.008238179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : configmap references non-existent config key: service-ca.crt
Jul 29 12:26:01.188413 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.188281    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 12:26:01.188413 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.188357    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:05.188340835 +0000 UTC m=+42.008391589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : secret "router-metrics-certs-default" not found
Jul 29 12:26:01.289410 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:01.289359    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:01.289561 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.289516    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 12:26:01.289561 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.289538    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7576c6554-btgqv: secret "image-registry-tls" not found
Jul 29 12:26:01.289653 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:01.289605    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls podName:9c149ff4-c128-4f3e-b5bb-df97f594d037 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:05.289584356 +0000 UTC m=+42.109635131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls") pod "image-registry-7576c6554-btgqv" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037") : secret "image-registry-tls" not found
Jul 29 12:26:02.896783 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.896755    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/0.log"
Jul 29 12:26:02.897554 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.896794    2549 generic.go:356] "Generic (PLEG): container finished" podID="69de03dc-f10f-4862-99d2-dace592aa3d1" containerID="24ceb2456ec4065694834bb795adcc8b9744a84c0439c687ae56c73f36ea7ea5" exitCode=255
Jul 29 12:26:02.897554 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.896826    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" event={"ID":"69de03dc-f10f-4862-99d2-dace592aa3d1","Type":"ContainerDied","Data":"24ceb2456ec4065694834bb795adcc8b9744a84c0439c687ae56c73f36ea7ea5"}
Jul 29 12:26:02.897554 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.897095    2549 scope.go:117] "RemoveContainer" containerID="24ceb2456ec4065694834bb795adcc8b9744a84c0439c687ae56c73f36ea7ea5"
Jul 29 12:26:02.898456 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.898429    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sb5c9" event={"ID":"09f20c1e-764a-425d-a975-99e9fb8fa8d6","Type":"ContainerStarted","Data":"df255cf72a0faafee727eb9821f8c1c53a3f56158c78873b996110ca84630735"}
Jul 29 12:26:02.899988 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.899958    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4x8mj" event={"ID":"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778","Type":"ContainerStarted","Data":"9fff817b33804f9afda365c9849e819a9023ef2b539ff0055715b28c4b58012a"}
Jul 29 12:26:02.901575 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.901557    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht" event={"ID":"1a263c2b-6636-42fe-8da8-4fb2bfcc80e7","Type":"ContainerStarted","Data":"ca25b2f09b1bcd0d41888b6e125b43a312ae4ad10e651cea91ed123e9f8dbe67"}
Jul 29 12:26:02.934026 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.933725    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wdqht" podStartSLOduration=1.778353117 podStartE2EDuration="5.933709463s" totalImagesPullingTime="4.155356346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:02.933324986 +0000 UTC m=+39.753375755" watchObservedRunningTime="2026-07-29 12:26:02.933709463 +0000 UTC m=+39.753760219"
Jul 29 12:26:02.950501 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.950446    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-4x8mj" podStartSLOduration=1.7902341179999999 podStartE2EDuration="5.950425223s" totalImagesPullingTime="4.160191105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:02.950286829 +0000 UTC m=+39.770337605" watchObservedRunningTime="2026-07-29 12:26:02.950425223 +0000 UTC m=+39.770476002"
Jul 29 12:26:02.970710 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:02.970654    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sb5c9" podStartSLOduration=1.8046224789999998 podStartE2EDuration="5.970640199s" totalImagesPullingTime="4.16601772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:02.969757228 +0000 UTC m=+39.789808017" watchObservedRunningTime="2026-07-29 12:26:02.970640199 +0000 UTC m=+39.790690975"
Jul 29 12:26:03.906144 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:03.906115    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:26:03.906612 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:03.906597    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/0.log"
Jul 29 12:26:03.906672 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:03.906631    2549 generic.go:356] "Generic (PLEG): container finished" podID="69de03dc-f10f-4862-99d2-dace592aa3d1" containerID="cd8e3baef46e50d55a44465de6532f92577bf2171a99372a3d00eb1ca4708b33" exitCode=255
Jul 29 12:26:03.906764 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:03.906742    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" event={"ID":"69de03dc-f10f-4862-99d2-dace592aa3d1","Type":"ContainerDied","Data":"cd8e3baef46e50d55a44465de6532f92577bf2171a99372a3d00eb1ca4708b33"}
Jul 29 12:26:03.906833 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:03.906822    2549 scope.go:117] "RemoveContainer" containerID="24ceb2456ec4065694834bb795adcc8b9744a84c0439c687ae56c73f36ea7ea5"
Jul 29 12:26:03.907071 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:03.907041    2549 scope.go:117] "RemoveContainer" containerID="cd8e3baef46e50d55a44465de6532f92577bf2171a99372a3d00eb1ca4708b33"
Jul 29 12:26:03.907247 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:03.907222    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rwhd5_openshift-console-operator(69de03dc-f10f-4862-99d2-dace592aa3d1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" podUID="69de03dc-f10f-4862-99d2-dace592aa3d1"
Jul 29 12:26:04.064329 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.064282    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5nctz"]
Jul 29 12:26:04.092704 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.092669    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nctz"]
Jul 29 12:26:04.095908 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.093060    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.097194 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.097168    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lp4bb\""
Jul 29 12:26:04.097358 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.097169    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 12:26:04.097479 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.097463    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 12:26:04.113626 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.113604    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.113711 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.113638    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7692m\" (UniqueName: \"kubernetes.io/projected/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-api-access-7692m\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.113752 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.113714    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.113752 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.113735    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-data-volume\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.113816 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.113757    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-crio-socket\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.214463 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.214362    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-crio-socket\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.214608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.214482    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.214608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.214512    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7692m\" (UniqueName: \"kubernetes.io/projected/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-api-access-7692m\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.214608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.214580    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.214608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.214597    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-data-volume\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.214765 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.214611    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-crio-socket\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.214765 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.214644    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:04.214765 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.214690    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 12:26:04.214765 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.214725    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:04.714704804 +0000 UTC m=+41.534755577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:04.214765 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.214742    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:04.71473489 +0000 UTC m=+41.534785645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : configmap "kube-rbac-proxy" not found
Jul 29 12:26:04.214935 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.214871    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-data-volume\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.226950 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.226930    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7692m\" (UniqueName: \"kubernetes.io/projected/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-api-access-7692m\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.719404 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.719373    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.719564 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.719449    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:04.719564 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.719484    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 12:26:04.719564 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.719541    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:04.719667 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.719542    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:05.719527166 +0000 UTC m=+42.539577920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : configmap "kube-rbac-proxy" not found
Jul 29 12:26:04.719667 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.719586    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:05.719574376 +0000 UTC m=+42.539625132 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:04.820322 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.820278    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:04.820480 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.820419    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 12:26:04.820559 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.820485    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls podName:a5f6429a-1594-466d-b5ba-5313e55d8eab nodeName:}" failed. No retries permitted until 2026-07-29 12:26:12.82046525 +0000 UTC m=+49.640516019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls") pod "dns-default-9j7j9" (UID: "a5f6429a-1594-466d-b5ba-5313e55d8eab") : secret "dns-default-metrics-tls" not found
Jul 29 12:26:04.911169 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.911141    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:26:04.911622 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:04.911458    2549 scope.go:117] "RemoveContainer" containerID="cd8e3baef46e50d55a44465de6532f92577bf2171a99372a3d00eb1ca4708b33"
Jul 29 12:26:04.911622 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:04.911594    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rwhd5_openshift-console-operator(69de03dc-f10f-4862-99d2-dace592aa3d1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" podUID="69de03dc-f10f-4862-99d2-dace592aa3d1"
Jul 29 12:26:05.123046 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:05.123011    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:26:05.123195 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.123157    2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 12:26:05.123232 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.123217    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls podName:2da745e9-f759-4841-b326-2da3f1e9eb71 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:13.123202495 +0000 UTC m=+49.943253249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls") pod "cluster-samples-operator-6748489656-zbzrp" (UID: "2da745e9-f759-4841-b326-2da3f1e9eb71") : secret "samples-operator-tls" not found
Jul 29 12:26:05.223901 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:05.223864    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:05.224023 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:05.223965    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:05.224079 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.224033    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:13.224014401 +0000 UTC m=+50.044065177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : configmap references non-existent config key: service-ca.crt
Jul 29 12:26:05.224130 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.224083    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 12:26:05.224130 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.224125    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:13.224113758 +0000 UTC m=+50.044164528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : secret "router-metrics-certs-default" not found
Jul 29 12:26:05.324608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:05.324576    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:05.324745 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.324684    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 12:26:05.324745 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.324694    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7576c6554-btgqv: secret "image-registry-tls" not found
Jul 29 12:26:05.324745 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.324740    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls podName:9c149ff4-c128-4f3e-b5bb-df97f594d037 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:13.324727519 +0000 UTC m=+50.144778275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls") pod "image-registry-7576c6554-btgqv" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037") : secret "image-registry-tls" not found
Jul 29 12:26:05.728617 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:05.728587    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:05.728816 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:05.728717    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:05.728816 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.728756    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:05.728816 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.728797    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 12:26:05.728964 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.728831    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:07.728812388 +0000 UTC m=+44.548863146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:05.728964 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:05.728853    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:07.728843216 +0000 UTC m=+44.548893971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : configmap "kube-rbac-proxy" not found
Jul 29 12:26:06.011920 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:06.011851    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjzlq_cdc6a98e-ba32-4e69-a42e-a7384d0608be/dns-node-resolver/0.log"
Jul 29 12:26:07.211958 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.211930    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8r7n_38bd4376-7d36-4d25-974d-6fbc3fd5b574/node-ca/0.log"
Jul 29 12:26:07.631251 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.631218    2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:26:07.631424 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.631269    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:26:07.631592 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.631579    2549 scope.go:117] "RemoveContainer" containerID="cd8e3baef46e50d55a44465de6532f92577bf2171a99372a3d00eb1ca4708b33"
Jul 29 12:26:07.631732 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:07.631715    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rwhd5_openshift-console-operator(69de03dc-f10f-4862-99d2-dace592aa3d1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" podUID="69de03dc-f10f-4862-99d2-dace592aa3d1"
Jul 29 12:26:07.745944 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.745912    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:07.746108 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:07.746035    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:07.746108 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:07.746099    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:11.74607625 +0000 UTC m=+48.566127018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:07.746267 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.746246    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:07.746687 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.746670    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:07.810408 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:07.810385    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sb5c9_09f20c1e-764a-425d-a975-99e9fb8fa8d6/serve-healthcheck-canary/0.log"
Jul 29 12:26:11.774733 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:11.774699    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:11.775113 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:11.774806    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:11.775113 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:11.774859    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls podName:fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca nodeName:}" failed. No retries permitted until 2026-07-29 12:26:19.774845588 +0000 UTC m=+56.594896342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nctz" (UID: "fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca") : secret "insights-runtime-extractor-tls" not found
Jul 29 12:26:12.884693 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:12.884654    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:12.885090 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:12.884798    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 12:26:12.885090 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:12.884861    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls podName:a5f6429a-1594-466d-b5ba-5313e55d8eab nodeName:}" failed. No retries permitted until 2026-07-29 12:26:28.884845632 +0000 UTC m=+65.704896387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls") pod "dns-default-9j7j9" (UID: "a5f6429a-1594-466d-b5ba-5313e55d8eab") : secret "dns-default-metrics-tls" not found
Jul 29 12:26:13.187189 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.187092    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:26:13.189476 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.189448    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2da745e9-f759-4841-b326-2da3f1e9eb71-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-zbzrp\" (UID: \"2da745e9-f759-4841-b326-2da3f1e9eb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:26:13.236377 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.236341    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"
Jul 29 12:26:13.288123 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.288091    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:13.288278 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.288257    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:13.288350 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:13.288273    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:29.288256309 +0000 UTC m=+66.108307081 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : configmap references non-existent config key: service-ca.crt
Jul 29 12:26:13.288350 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:13.288342    2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 12:26:13.288461 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:13.288392    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs podName:a8a6840f-d7d1-47b6-951f-a8f9b222e3db nodeName:}" failed. No retries permitted until 2026-07-29 12:26:29.288377335 +0000 UTC m=+66.108428104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs") pod "router-default-c6999b477-zzhch" (UID: "a8a6840f-d7d1-47b6-951f-a8f9b222e3db") : secret "router-metrics-certs-default" not found
Jul 29 12:26:13.368907 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.368878    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp"]
Jul 29 12:26:13.389265 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.389236    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:13.389435 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:13.389415    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 12:26:13.389513 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:13.389439    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7576c6554-btgqv: secret "image-registry-tls" not found
Jul 29 12:26:13.389569 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:13.389512    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls podName:9c149ff4-c128-4f3e-b5bb-df97f594d037 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:29.389489797 +0000 UTC m=+66.209540574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls") pod "image-registry-7576c6554-btgqv" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037") : secret "image-registry-tls" not found
Jul 29 12:26:13.934736 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:13.934696    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp" event={"ID":"2da745e9-f759-4841-b326-2da3f1e9eb71","Type":"ContainerStarted","Data":"498b1c14d2d574dcf988fcb1ae4ccac1889f7a4e0811b8e2ebc253f1acecb330"}
Jul 29 12:26:16.944798 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:16.944763    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp" event={"ID":"2da745e9-f759-4841-b326-2da3f1e9eb71","Type":"ContainerStarted","Data":"f5c30a067f3b68248b253a6e87f9a392efbf99a9b4afe7e990a9aef5b9ae1014"}
Jul 29 12:26:16.945294 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:16.944822    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp" event={"ID":"2da745e9-f759-4841-b326-2da3f1e9eb71","Type":"ContainerStarted","Data":"4dd482fd1720157138b87fe576d4449fa660433d7ca5dbe5048d166f7ce13ab0"}
Jul 29 12:26:16.965982 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:16.965932    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-zbzrp" podStartSLOduration=17.299312187 podStartE2EDuration="19.96591759s" totalImagesPullingTime="2.666605403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:16.964550466 +0000 UTC m=+53.784601243" watchObservedRunningTime="2026-07-29 12:26:16.96591759 +0000 UTC m=+53.785968367"
Jul 29 12:26:19.846610 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:19.846558    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:19.848805 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:19.848780    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nctz\" (UID: \"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca\") " pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:20.004859 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:20.004829    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nctz"
Jul 29 12:26:20.142853 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:20.142768    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nctz"]
Jul 29 12:26:20.146671 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:20.146647    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd30cfc1_17ab_4fc9_96d4_07c74c98a9ca.slice/crio-eb334764d1fa153b76ced9615d57bb89f815593c0a666d40891b69dd13644ab3 WatchSource:0}: Error finding container eb334764d1fa153b76ced9615d57bb89f815593c0a666d40891b69dd13644ab3: Status 404 returned error can't find the container with id eb334764d1fa153b76ced9615d57bb89f815593c0a666d40891b69dd13644ab3
Jul 29 12:26:20.960762 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:20.960724    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nctz" event={"ID":"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca","Type":"ContainerStarted","Data":"eb334764d1fa153b76ced9615d57bb89f815593c0a666d40891b69dd13644ab3"}
Jul 29 12:26:22.691358 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:22.691326    2549 scope.go:117] "RemoveContainer" containerID="cd8e3baef46e50d55a44465de6532f92577bf2171a99372a3d00eb1ca4708b33"
Jul 29 12:26:25.872328 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:25.872282    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq99x"
Jul 29 12:26:25.979554 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:25.979515    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:26:25.979728 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:25.979647    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" event={"ID":"69de03dc-f10f-4862-99d2-dace592aa3d1","Type":"ContainerStarted","Data":"fa75bc400a24ea76ca782581d6ce765e2e11ab51b8b7e0ec291ecaf0fe125193"}
Jul 29 12:26:25.979999 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:25.979980    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:26:25.981995 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:25.981970    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nctz" event={"ID":"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca","Type":"ContainerStarted","Data":"93d9246f9500c3419644a2491580f93cbc96d18cac895a3338f5dc13912b97d0"}
Jul 29 12:26:25.986186 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:25.986149    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5"
Jul 29 12:26:26.003709 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:26.003665    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-rwhd5" podStartSLOduration=24.849395473 podStartE2EDuration="29.003651998s" totalImagesPullingTime="4.154256525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:26.002857326 +0000 UTC m=+62.822908104" watchObservedRunningTime="2026-07-29 12:26:26.003651998 +0000 UTC m=+62.823702774"
Jul 29 12:26:28.929194 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:28.929150    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:28.931583 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:28.931557    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5f6429a-1594-466d-b5ba-5313e55d8eab-metrics-tls\") pod \"dns-default-9j7j9\" (UID: \"a5f6429a-1594-466d-b5ba-5313e55d8eab\") " pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:29.048396 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.048364    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7576c6554-btgqv"]
Jul 29 12:26:29.048586 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:29.048566    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7576c6554-btgqv" podUID="9c149ff4-c128-4f3e-b5bb-df97f594d037"
Jul 29 12:26:29.154257 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.154225    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zrh5t\""
Jul 29 12:26:29.162801 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.162779    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:29.191659 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.191605    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57656bb7cb-xfmz9"]
Jul 29 12:26:29.213464 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.213446    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.220132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.219710    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57656bb7cb-xfmz9"]
Jul 29 12:26:29.332571 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332545    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:29.332735 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332595    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa5a823-e7bf-4e95-9714-6dcb00498307-trusted-ca\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.332735 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332633    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa5a823-e7bf-4e95-9714-6dcb00498307-registry-certificates\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.332735 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332677    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa5a823-e7bf-4e95-9714-6dcb00498307-ca-trust-extracted\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.332897 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332742    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:29.332897 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332800    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccn9n\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-kube-api-access-ccn9n\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.332897 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332848    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-registry-tls\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.332897 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332881    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa5a823-e7bf-4e95-9714-6dcb00498307-image-registry-private-configuration\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.333065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332909    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa5a823-e7bf-4e95-9714-6dcb00498307-installation-pull-secrets\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.333065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.332940    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-bound-sa-token\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.333222 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.333205    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-service-ca-bundle\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:29.335020 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.334999    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8a6840f-d7d1-47b6-951f-a8f9b222e3db-metrics-certs\") pod \"router-default-c6999b477-zzhch\" (UID: \"a8a6840f-d7d1-47b6-951f-a8f9b222e3db\") " pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:29.433622 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433599    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa5a823-e7bf-4e95-9714-6dcb00498307-registry-certificates\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.433739 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433654    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:26:29.433739 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433682    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa5a823-e7bf-4e95-9714-6dcb00498307-ca-trust-extracted\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.433739 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433721    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccn9n\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-kube-api-access-ccn9n\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.433896 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433758    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-registry-tls\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.433896 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433790    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa5a823-e7bf-4e95-9714-6dcb00498307-image-registry-private-configuration\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.433896 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433817    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa5a823-e7bf-4e95-9714-6dcb00498307-installation-pull-secrets\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.433896 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433846    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-bound-sa-token\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.434084 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433899    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:29.434084 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.433966    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa5a823-e7bf-4e95-9714-6dcb00498307-trusted-ca\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.435205 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.434745    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa5a823-e7bf-4e95-9714-6dcb00498307-ca-trust-extracted\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.435205 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.434900    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa5a823-e7bf-4e95-9714-6dcb00498307-trusted-ca\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.435205 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.435127    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa5a823-e7bf-4e95-9714-6dcb00498307-registry-certificates\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.437169 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.437115    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-registry-tls\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.437169 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.437161    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa5a823-e7bf-4e95-9714-6dcb00498307-installation-pull-secrets\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.437415 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.437365    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"image-registry-7576c6554-btgqv\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") " pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:29.438360 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.438278    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa5a823-e7bf-4e95-9714-6dcb00498307-image-registry-private-configuration\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.441430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.441363    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 12:26:29.445062 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.445012    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-bound-sa-token\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.446584 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.446562    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25b149c-939a-47cc-a11e-1622459b8051-metrics-certs\") pod \"network-metrics-daemon-lgm8z\" (UID: \"d25b149c-939a-47cc-a11e-1622459b8051\") " pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:26:29.447472 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.447453    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccn9n\" (UniqueName: \"kubernetes.io/projected/5fa5a823-e7bf-4e95-9714-6dcb00498307-kube-api-access-ccn9n\") pod \"image-registry-57656bb7cb-xfmz9\" (UID: \"5fa5a823-e7bf-4e95-9714-6dcb00498307\") " pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.479482 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.479460    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9j7j9"]
Jul 29 12:26:29.482449 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:29.482428    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f6429a_1594_466d_b5ba_5313e55d8eab.slice/crio-d5d92ce8e71903a413dd0ed626055a9b69a3c8a95a9154adb2950a971ec7d992 WatchSource:0}: Error finding container d5d92ce8e71903a413dd0ed626055a9b69a3c8a95a9154adb2950a971ec7d992: Status 404 returned error can't find the container with id d5d92ce8e71903a413dd0ed626055a9b69a3c8a95a9154adb2950a971ec7d992
Jul 29 12:26:29.512173 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.512153    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4f75\""
Jul 29 12:26:29.521036 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.521015    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgm8z"
Jul 29 12:26:29.524264 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.524245    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bggs6\""
Jul 29 12:26:29.532256 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.532240    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:29.532465 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.532451    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9drwn\""
Jul 29 12:26:29.534441 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.534419    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:26:29.536677 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.536659    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 12:26:29.540498 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.540482    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:29.547516 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.547501    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 12:26:29.558141 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.558114    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7ndm\" (UniqueName: \"kubernetes.io/projected/87800128-905c-4403-90b6-a01fa417c18e-kube-api-access-n7ndm\") pod \"network-check-target-rdcjp\" (UID: \"87800128-905c-4403-90b6-a01fa417c18e\") " pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:26:29.636071 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.635746    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:26:29.638786 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.638765    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 12:26:29.648631 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.648576    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a0b1de9-3f31-4d44-93da-67c53dea462d-original-pull-secret\") pod \"global-pull-secret-syncer-dxw26\" (UID: \"6a0b1de9-3f31-4d44-93da-67c53dea462d\") " pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:26:29.665304 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.665281    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lgm8z"]
Jul 29 12:26:29.669069 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:29.669045    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25b149c_939a_47cc_a11e_1622459b8051.slice/crio-3e59e1bc43ad032c1c64e63e4a24865ffc0e30cfc93f12dcd4b0e7c2a7917180 WatchSource:0}: Error finding container 3e59e1bc43ad032c1c64e63e4a24865ffc0e30cfc93f12dcd4b0e7c2a7917180: Status 404 returned error can't find the container with id 3e59e1bc43ad032c1c64e63e4a24865ffc0e30cfc93f12dcd4b0e7c2a7917180
Jul 29 12:26:29.683966 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.683940    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57656bb7cb-xfmz9"]
Jul 29 12:26:29.688125 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:29.688104    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa5a823_e7bf_4e95_9714_6dcb00498307.slice/crio-0cbf7569d2bca78de1f5b894380e0b9ff59763e9acb426e947e2dc016f2f7f2b WatchSource:0}: Error finding container 0cbf7569d2bca78de1f5b894380e0b9ff59763e9acb426e947e2dc016f2f7f2b: Status 404 returned error can't find the container with id 0cbf7569d2bca78de1f5b894380e0b9ff59763e9acb426e947e2dc016f2f7f2b
Jul 29 12:26:29.702428 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.702406    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c6999b477-zzhch"]
Jul 29 12:26:29.703844 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:29.703823    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a6840f_d7d1_47b6_951f_a8f9b222e3db.slice/crio-c2eabd765afe2723819d86e614abca932649bb2384f787829d3c3c599467c3ca WatchSource:0}: Error finding container c2eabd765afe2723819d86e614abca932649bb2384f787829d3c3c599467c3ca: Status 404 returned error can't find the container with id c2eabd765afe2723819d86e614abca932649bb2384f787829d3c3c599467c3ca
Jul 29 12:26:29.805648 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.805613    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hdxp9\""
Jul 29 12:26:29.812672 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.812637    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:26:29.815536 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.815515    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxw26"
Jul 29 12:26:29.970931 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.970864    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdcjp"]
Jul 29 12:26:29.975556 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:29.975524    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87800128_905c_4403_90b6_a01fa417c18e.slice/crio-9ff3f0e11b716fa8195702d1c132ecce8323e13dbebc58fdb722c9fa076760d4 WatchSource:0}: Error finding container 9ff3f0e11b716fa8195702d1c132ecce8323e13dbebc58fdb722c9fa076760d4: Status 404 returned error can't find the container with id 9ff3f0e11b716fa8195702d1c132ecce8323e13dbebc58fdb722c9fa076760d4
Jul 29 12:26:29.983071 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:29.983043    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxw26"]
Jul 29 12:26:29.988235 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:29.988208    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0b1de9_3f31_4d44_93da_67c53dea462d.slice/crio-d1e9b98481f163cafcd3762bc4c0b81ba6932935c638e30ebddd2a373bbaff4d WatchSource:0}: Error finding container d1e9b98481f163cafcd3762bc4c0b81ba6932935c638e30ebddd2a373bbaff4d: Status 404 returned error can't find the container with id d1e9b98481f163cafcd3762bc4c0b81ba6932935c638e30ebddd2a373bbaff4d
Jul 29 12:26:30.008026 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.007996    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nctz" event={"ID":"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca","Type":"ContainerStarted","Data":"761693c6573bdfa506814de49a3f4c23073ff38d379338f6d522bf9133e6d0f8"}
Jul 29 12:26:30.009438 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.009409    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxw26" event={"ID":"6a0b1de9-3f31-4d44-93da-67c53dea462d","Type":"ContainerStarted","Data":"d1e9b98481f163cafcd3762bc4c0b81ba6932935c638e30ebddd2a373bbaff4d"}
Jul 29 12:26:30.011335 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.011265    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdcjp" event={"ID":"87800128-905c-4403-90b6-a01fa417c18e","Type":"ContainerStarted","Data":"9ff3f0e11b716fa8195702d1c132ecce8323e13dbebc58fdb722c9fa076760d4"}
Jul 29 12:26:30.013470 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.013444    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c6999b477-zzhch" event={"ID":"a8a6840f-d7d1-47b6-951f-a8f9b222e3db","Type":"ContainerStarted","Data":"156754715c5120f66277d52735311727906abac6d215537b6974dbab0fe4c221"}
Jul 29 12:26:30.013563 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.013490    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c6999b477-zzhch" event={"ID":"a8a6840f-d7d1-47b6-951f-a8f9b222e3db","Type":"ContainerStarted","Data":"c2eabd765afe2723819d86e614abca932649bb2384f787829d3c3c599467c3ca"}
Jul 29 12:26:30.015609 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.015583    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lgm8z" event={"ID":"d25b149c-939a-47cc-a11e-1622459b8051","Type":"ContainerStarted","Data":"3e59e1bc43ad032c1c64e63e4a24865ffc0e30cfc93f12dcd4b0e7c2a7917180"}
Jul 29 12:26:30.017541 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.017516    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9" event={"ID":"5fa5a823-e7bf-4e95-9714-6dcb00498307","Type":"ContainerStarted","Data":"dfdbe59f3a1730fba20978d493cdd93a2fde2dcdb09b46fbccfa21748947ae52"}
Jul 29 12:26:30.017635 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.017559    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9" event={"ID":"5fa5a823-e7bf-4e95-9714-6dcb00498307","Type":"ContainerStarted","Data":"0cbf7569d2bca78de1f5b894380e0b9ff59763e9acb426e947e2dc016f2f7f2b"}
Jul 29 12:26:30.017703 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.017672    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:30.019570 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.019548    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:30.019660 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.019551    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9j7j9" event={"ID":"a5f6429a-1594-466d-b5ba-5313e55d8eab","Type":"ContainerStarted","Data":"d5d92ce8e71903a413dd0ed626055a9b69a3c8a95a9154adb2950a971ec7d992"}
Jul 29 12:26:30.027239 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.027221    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:30.037810 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.037573    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c6999b477-zzhch" podStartSLOduration=33.037555912 podStartE2EDuration="33.037555912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:30.036294269 +0000 UTC m=+66.856345047" watchObservedRunningTime="2026-07-29 12:26:30.037555912 +0000 UTC m=+66.857606670"
Jul 29 12:26:30.065409 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.064184    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9" podStartSLOduration=1.064168193 podStartE2EDuration="1.064168193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:30.062720938 +0000 UTC m=+66.882771715" watchObservedRunningTime="2026-07-29 12:26:30.064168193 +0000 UTC m=+66.884218972"
Jul 29 12:26:30.140205 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140160    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c149ff4-c128-4f3e-b5bb-df97f594d037-ca-trust-extracted\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140205 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140214    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140241    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-certificates\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140283    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-image-registry-private-configuration\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140334    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv28w\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-kube-api-access-gv28w\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140364    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-bound-sa-token\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140392    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-trusted-ca\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140424    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-installation-pull-secrets\") pod \"9c149ff4-c128-4f3e-b5bb-df97f594d037\" (UID: \"9c149ff4-c128-4f3e-b5bb-df97f594d037\") "
Jul 29 12:26:30.140506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140483    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c149ff4-c128-4f3e-b5bb-df97f594d037-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 12:26:30.140916 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.140856    2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c149ff4-c128-4f3e-b5bb-df97f594d037-ca-trust-extracted\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.142301 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.142008    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:26:30.143549 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.143515    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:26:30.146083 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.146043    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:26:30.146151 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.146080    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-kube-api-access-gv28w" (OuterVolumeSpecName: "kube-api-access-gv28w") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "kube-api-access-gv28w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:26:30.146718 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.146676    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 12:26:30.146921 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.146892    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:26:30.148006 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.147973    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9c149ff4-c128-4f3e-b5bb-df97f594d037" (UID: "9c149ff4-c128-4f3e-b5bb-df97f594d037"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 12:26:30.241747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.241565    2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-tls\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.241747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.241598    2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-registry-certificates\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.241747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.241617    2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-image-registry-private-configuration\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.241747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.241631    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv28w\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-kube-api-access-gv28w\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.241747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.241646    2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c149ff4-c128-4f3e-b5bb-df97f594d037-bound-sa-token\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.241747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.241659    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c149ff4-c128-4f3e-b5bb-df97f594d037-trusted-ca\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.241747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.241671    2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c149ff4-c128-4f3e-b5bb-df97f594d037-installation-pull-secrets\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:26:30.541907 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.541877    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:30.545350 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:30.545130    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:31.027494 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:31.026084    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7576c6554-btgqv"
Jul 29 12:26:31.027494 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:31.027139    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:31.028758 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:31.028666    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c6999b477-zzhch"
Jul 29 12:26:31.124806 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:31.124734    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7576c6554-btgqv"]
Jul 29 12:26:31.139224 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:31.139169    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7576c6554-btgqv"]
Jul 29 12:26:31.698234 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:31.697985    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c149ff4-c128-4f3e-b5bb-df97f594d037" path="/var/lib/kubelet/pods/9c149ff4-c128-4f3e-b5bb-df97f594d037/volumes"
Jul 29 12:26:32.031943 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:32.031908    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lgm8z" event={"ID":"d25b149c-939a-47cc-a11e-1622459b8051","Type":"ContainerStarted","Data":"9e7859c5380dc7d7a58d9b7f0f10b5c9faf92079a6894eefb205f26b8a95270f"}
Jul 29 12:26:32.043065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:32.042982    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9j7j9" event={"ID":"a5f6429a-1594-466d-b5ba-5313e55d8eab","Type":"ContainerStarted","Data":"0fa9c8342c626c799ae2fe688ba8fdabf1c7daf1dd450d05068313ed0c98108e"}
Jul 29 12:26:33.051703 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.051192    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lgm8z" event={"ID":"d25b149c-939a-47cc-a11e-1622459b8051","Type":"ContainerStarted","Data":"aa6906656d0a715e34c00b115f1a7ab0c6abb7b431403a289bf6d3205bb83751"}
Jul 29 12:26:33.053390 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.053330    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9j7j9" event={"ID":"a5f6429a-1594-466d-b5ba-5313e55d8eab","Type":"ContainerStarted","Data":"421bb5b770e588b0855c1bd4f525e7704e16effb28517e6313a4bdf6ba7f338e"}
Jul 29 12:26:33.077348 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.076661    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lgm8z" podStartSLOduration=67.88795816 podStartE2EDuration="1m10.076641678s" totalImagesPullingTime="2.188683518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:33.074814979 +0000 UTC m=+69.894865755" watchObservedRunningTime="2026-07-29 12:26:33.076641678 +0000 UTC m=+69.896692456"
Jul 29 12:26:33.100423 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.100341    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9j7j9" podStartSLOduration=33.718180659 podStartE2EDuration="36.100321623s" totalImagesPullingTime="2.382140964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:33.098665251 +0000 UTC m=+69.918716029" watchObservedRunningTime="2026-07-29 12:26:33.100321623 +0000 UTC m=+69.920372396"
Jul 29 12:26:33.830592 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.830555    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c9c694f89-p4rlh"]
Jul 29 12:26:33.846293 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.846267    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:33.849585 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.849549    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 12:26:33.849585 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.849559    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 12:26:33.849810 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.849791    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 12:26:33.850348 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.850323    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9c694f89-p4rlh"]
Jul 29 12:26:33.850473 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.850357    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 12:26:33.850473 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.850443    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 12:26:33.850473 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.850453    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gwdkx\""
Jul 29 12:26:33.850706 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.850443    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 12:26:33.850706 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.850520    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 12:26:33.975058 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.975023    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mpjd\" (UniqueName: \"kubernetes.io/projected/b7bce965-8d54-427d-a5d5-b3731b410897-kube-api-access-7mpjd\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:33.975203 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.975068    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-serving-cert\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:33.975203 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.975091    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-service-ca\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:33.975203 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.975153    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-oauth-serving-cert\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:33.975345 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.975216    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-console-config\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:33.975345 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:33.975263    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-oauth-config\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.057241 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.057209    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:34.076061 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.076031    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-serving-cert\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.076222 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.076067    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-service-ca\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.076222 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.076099    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-oauth-serving-cert\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.076222 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.076137    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-console-config\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.076222 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.076174    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-oauth-config\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.076476 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.076324    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mpjd\" (UniqueName: \"kubernetes.io/projected/b7bce965-8d54-427d-a5d5-b3731b410897-kube-api-access-7mpjd\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.076858 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.076835    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-service-ca\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.077278 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.077246    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-console-config\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.077278 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.077267    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-oauth-serving-cert\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.079052 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.079029    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-serving-cert\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.079148 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.079056    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-oauth-config\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.085623 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.085559    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mpjd\" (UniqueName: \"kubernetes.io/projected/b7bce965-8d54-427d-a5d5-b3731b410897-kube-api-access-7mpjd\") pod \"console-7c9c694f89-p4rlh\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") " pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:34.158942 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:34.158904    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:37.208067 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:37.208041    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9c694f89-p4rlh"]
Jul 29 12:26:37.212450 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:37.212423    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7bce965_8d54_427d_a5d5_b3731b410897.slice/crio-d13e84f5e8dc5481aabaaa01c3438d4106916d41253e93b5e42e0f691c9c4e82 WatchSource:0}: Error finding container d13e84f5e8dc5481aabaaa01c3438d4106916d41253e93b5e42e0f691c9c4e82: Status 404 returned error can't find the container with id d13e84f5e8dc5481aabaaa01c3438d4106916d41253e93b5e42e0f691c9c4e82
Jul 29 12:26:38.077626 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.077584    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nctz" event={"ID":"fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca","Type":"ContainerStarted","Data":"ad45f939275a5790cf7c99ac40c90b64d79e2ffaeb6f220ae9c6e0c8af7071f3"}
Jul 29 12:26:38.079648 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.079620    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxw26" event={"ID":"6a0b1de9-3f31-4d44-93da-67c53dea462d","Type":"ContainerStarted","Data":"01ec6fe875b00f1b928485c07a54dc795e61d6ab4fb2cd534a287e8c659f2d03"}
Jul 29 12:26:38.082342 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.082257    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdcjp" event={"ID":"87800128-905c-4403-90b6-a01fa417c18e","Type":"ContainerStarted","Data":"1e1b5f06a1951f7b99c2efbc2e03341b279a1df07b942295d1d0ab266d0328dd"}
Jul 29 12:26:38.082462 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.082345    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:26:38.083967 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.083938    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c694f89-p4rlh" event={"ID":"b7bce965-8d54-427d-a5d5-b3731b410897","Type":"ContainerStarted","Data":"d13e84f5e8dc5481aabaaa01c3438d4106916d41253e93b5e42e0f691c9c4e82"}
Jul 29 12:26:38.123988 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.123935    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dxw26" podStartSLOduration=68.044183464 podStartE2EDuration="1m15.12391669s" totalImagesPullingTime="7.079733226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:38.12361012 +0000 UTC m=+74.943660896" watchObservedRunningTime="2026-07-29 12:26:38.12391669 +0000 UTC m=+74.943967469"
Jul 29 12:26:38.124214 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.124192    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5nctz" podStartSLOduration=17.336672288 podStartE2EDuration="34.12418728s" totalImagesPullingTime="16.787514992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:26:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:38.099276208 +0000 UTC m=+74.919326986" watchObservedRunningTime="2026-07-29 12:26:38.12418728 +0000 UTC m=+74.944238058"
Jul 29 12:26:38.142040 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:38.141993    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rdcjp" podStartSLOduration=68.06591095 podStartE2EDuration="1m15.14197766s" totalImagesPullingTime="7.07606671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:38.141405499 +0000 UTC m=+74.961456276" watchObservedRunningTime="2026-07-29 12:26:38.14197766 +0000 UTC m=+74.962028437"
Jul 29 12:26:41.097163 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:41.097127    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c694f89-p4rlh" event={"ID":"b7bce965-8d54-427d-a5d5-b3731b410897","Type":"ContainerStarted","Data":"c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a"}
Jul 29 12:26:41.116605 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:41.116556    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c9c694f89-p4rlh" podStartSLOduration=5.083250291 podStartE2EDuration="8.116538757s" totalImagesPullingTime="3.033288466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:41.114880463 +0000 UTC m=+77.934931253" watchObservedRunningTime="2026-07-29 12:26:41.116538757 +0000 UTC m=+77.936589533"
Jul 29 12:26:44.062699 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.062665    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9j7j9"
Jul 29 12:26:44.148130 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.148094    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-24zvl"]
Jul 29 12:26:44.151180 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.151157    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.154964 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.154946    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 12:26:44.155288 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.155272    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 12:26:44.155376 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.155281    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 12:26:44.155807 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.155789    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 12:26:44.155807 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.155805    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 12:26:44.155909 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.155832    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5q7bl\""
Jul 29 12:26:44.159367 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.159342    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:44.159457 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.159391    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:44.163905 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.163886    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:44.175759 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.175738    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-24zvl"]
Jul 29 12:26:44.257543 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.257511    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd4ef8ae-287e-435c-96a1-48156c9d4679-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.257740 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.257606    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r88n\" (UniqueName: \"kubernetes.io/projected/cd4ef8ae-287e-435c-96a1-48156c9d4679-kube-api-access-2r88n\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.257740 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.257676    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd4ef8ae-287e-435c-96a1-48156c9d4679-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.257843 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.257789    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4ef8ae-287e-435c-96a1-48156c9d4679-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.358215 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.358136    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4ef8ae-287e-435c-96a1-48156c9d4679-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.358215 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.358179    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd4ef8ae-287e-435c-96a1-48156c9d4679-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.358451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.358302    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r88n\" (UniqueName: \"kubernetes.io/projected/cd4ef8ae-287e-435c-96a1-48156c9d4679-kube-api-access-2r88n\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.358451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.358405    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd4ef8ae-287e-435c-96a1-48156c9d4679-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.359029 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.359008    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd4ef8ae-287e-435c-96a1-48156c9d4679-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.360549 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.360522    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd4ef8ae-287e-435c-96a1-48156c9d4679-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.360649 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.360628    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4ef8ae-287e-435c-96a1-48156c9d4679-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.369114 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.369096    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r88n\" (UniqueName: \"kubernetes.io/projected/cd4ef8ae-287e-435c-96a1-48156c9d4679-kube-api-access-2r88n\") pod \"prometheus-operator-84d69f794d-24zvl\" (UID: \"cd4ef8ae-287e-435c-96a1-48156c9d4679\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.460305 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.460279    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl"
Jul 29 12:26:44.581861 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:44.581716    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-24zvl"]
Jul 29 12:26:44.584371 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:44.584346    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4ef8ae_287e_435c_96a1_48156c9d4679.slice/crio-e861914e05f61e83623d0760cc58781b046da4d2f674af33ea1fb1a5d7cad090 WatchSource:0}: Error finding container e861914e05f61e83623d0760cc58781b046da4d2f674af33ea1fb1a5d7cad090: Status 404 returned error can't find the container with id e861914e05f61e83623d0760cc58781b046da4d2f674af33ea1fb1a5d7cad090
Jul 29 12:26:45.112450 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:45.112335    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl" event={"ID":"cd4ef8ae-287e-435c-96a1-48156c9d4679","Type":"ContainerStarted","Data":"e861914e05f61e83623d0760cc58781b046da4d2f674af33ea1fb1a5d7cad090"}
Jul 29 12:26:45.116397 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:45.116374    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:26:46.117765 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:46.117728    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl" event={"ID":"cd4ef8ae-287e-435c-96a1-48156c9d4679","Type":"ContainerStarted","Data":"9d5af990b9fcdf55984a37bab22e5d14b657e6baa1d8537c9e54638a7398421f"}
Jul 29 12:26:47.122486 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:47.122448    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl" event={"ID":"cd4ef8ae-287e-435c-96a1-48156c9d4679","Type":"ContainerStarted","Data":"057ff201ed6aaf322826691f1a671593bf47a073b80e7e5c1dd3da135639faa4"}
Jul 29 12:26:47.143435 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:47.143385    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-24zvl" podStartSLOduration=1.706283067 podStartE2EDuration="3.143367942s" totalImagesPullingTime="1.437084875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:47.142121623 +0000 UTC m=+83.962172400" watchObservedRunningTime="2026-07-29 12:26:47.143367942 +0000 UTC m=+83.963418719"
Jul 29 12:26:49.422846 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.422811    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9c694f89-p4rlh"]
Jul 29 12:26:49.635238 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.635204    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"]
Jul 29 12:26:49.639751 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.639732    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.642202 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.642182    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q4d2h\""
Jul 29 12:26:49.642463 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.642439    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 12:26:49.643976 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.643962    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 12:26:49.655930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.655907    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"]
Jul 29 12:26:49.673861 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.673784    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"]
Jul 29 12:26:49.677072 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.677055    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.679423 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.679399    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 12:26:49.679791 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.679776    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 12:26:49.681092 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.681076    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 12:26:49.681751 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.681729    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4xtb4\""
Jul 29 12:26:49.683053 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.683034    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lj84r"]
Jul 29 12:26:49.686425 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.686401    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.689834 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.689815    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 12:26:49.690815 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.690592    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wzq9d\""
Jul 29 12:26:49.696590 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.696568    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 12:26:49.696936 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.696918    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 12:26:49.699401 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.699264    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"]
Jul 29 12:26:49.802225 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802192    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73a85260-8109-40da-9219-406a7c03291a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.802430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802248    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9v5\" (UniqueName: \"kubernetes.io/projected/73a85260-8109-40da-9219-406a7c03291a-kube-api-access-qq9v5\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.802430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802281    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-tls\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802303    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvgpd\" (UniqueName: \"kubernetes.io/projected/499165fc-ef99-47ea-8457-9b1b2c424d53-kube-api-access-mvgpd\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802378    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba9bc6ab-3df0-44b4-8f33-a471410b307d-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.802430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802408    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802612 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802453    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.802612 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802496    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a85260-8109-40da-9219-406a7c03291a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.802612 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802516    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-accelerators-collector-config\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802612 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802539    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-wtmp\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802612 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802561    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.802612 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802579    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-textfile\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802615    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-sys\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802635    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-root\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802653    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba9bc6ab-3df0-44b4-8f33-a471410b307d-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.802808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802669    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbz5\" (UniqueName: \"kubernetes.io/projected/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-api-access-kjbz5\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.802808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802706    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499165fc-ef99-47ea-8457-9b1b2c424d53-metrics-client-ca\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.802808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802729    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.802808 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.802757    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73a85260-8109-40da-9219-406a7c03291a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.904101 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904053    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a85260-8109-40da-9219-406a7c03291a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.904101 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904103    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-accelerators-collector-config\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904126    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-wtmp\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904147    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904166    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-textfile\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904188    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-sys\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904210    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-root\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904235    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba9bc6ab-3df0-44b4-8f33-a471410b307d-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904259    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbz5\" (UniqueName: \"kubernetes.io/projected/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-api-access-kjbz5\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904285    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499165fc-ef99-47ea-8457-9b1b2c424d53-metrics-client-ca\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904292    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-wtmp\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904342    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.904352 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904350    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-root\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904354    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499165fc-ef99-47ea-8457-9b1b2c424d53-sys\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904394    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73a85260-8109-40da-9219-406a7c03291a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904428    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73a85260-8109-40da-9219-406a7c03291a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904487    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9v5\" (UniqueName: \"kubernetes.io/projected/73a85260-8109-40da-9219-406a7c03291a-kube-api-access-qq9v5\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904523    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-tls\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904547    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvgpd\" (UniqueName: \"kubernetes.io/projected/499165fc-ef99-47ea-8457-9b1b2c424d53-kube-api-access-mvgpd\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904579    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba9bc6ab-3df0-44b4-8f33-a471410b307d-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904606    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904630    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.904874 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904795    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-accelerators-collector-config\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.905392 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:49.904899    2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 12:26:49.905392 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904950    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499165fc-ef99-47ea-8457-9b1b2c424d53-metrics-client-ca\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.905392 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904954    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba9bc6ab-3df0-44b4-8f33-a471410b307d-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.905392 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:26:49.904961    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-tls podName:499165fc-ef99-47ea-8457-9b1b2c424d53 nodeName:}" failed. No retries permitted until 2026-07-29 12:26:50.404940875 +0000 UTC m=+87.224991642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-tls") pod "node-exporter-lj84r" (UID: "499165fc-ef99-47ea-8457-9b1b2c424d53") : secret "node-exporter-tls" not found
Jul 29 12:26:49.905392 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.904981    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a85260-8109-40da-9219-406a7c03291a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.905392 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.905060    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.905697 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.905520    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-textfile\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.905882 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.905859    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba9bc6ab-3df0-44b4-8f33-a471410b307d-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.906882 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.906855    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.907451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.907422    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.907536 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.907450    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73a85260-8109-40da-9219-406a7c03291a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.907536 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.907465    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73a85260-8109-40da-9219-406a7c03291a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.907638 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.907620    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.917575 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.917555    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbz5\" (UniqueName: \"kubernetes.io/projected/ba9bc6ab-3df0-44b4-8f33-a471410b307d-kube-api-access-kjbz5\") pod \"kube-state-metrics-56d9f944b4-8lh2x\" (UID: \"ba9bc6ab-3df0-44b4-8f33-a471410b307d\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:49.917974 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.917954    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvgpd\" (UniqueName: \"kubernetes.io/projected/499165fc-ef99-47ea-8457-9b1b2c424d53-kube-api-access-mvgpd\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:49.918841 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.918813    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9v5\" (UniqueName: \"kubernetes.io/projected/73a85260-8109-40da-9219-406a7c03291a-kube-api-access-qq9v5\") pod \"openshift-state-metrics-b8f49f5c6-qnpcc\" (UID: \"73a85260-8109-40da-9219-406a7c03291a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.949748 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.949672    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"
Jul 29 12:26:49.986133 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:49.986090    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"
Jul 29 12:26:50.112492 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:50.112460    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc"]
Jul 29 12:26:50.114932 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:50.114908    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a85260_8109_40da_9219_406a7c03291a.slice/crio-e60647198fb7274b79fef39e0cd842216f3f73d54cd0f9df700e4a3522e19e26 WatchSource:0}: Error finding container e60647198fb7274b79fef39e0cd842216f3f73d54cd0f9df700e4a3522e19e26: Status 404 returned error can't find the container with id e60647198fb7274b79fef39e0cd842216f3f73d54cd0f9df700e4a3522e19e26
Jul 29 12:26:50.135636 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:50.135612    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc" event={"ID":"73a85260-8109-40da-9219-406a7c03291a","Type":"ContainerStarted","Data":"e60647198fb7274b79fef39e0cd842216f3f73d54cd0f9df700e4a3522e19e26"}
Jul 29 12:26:50.136601 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:50.136571    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x"]
Jul 29 12:26:50.142275 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:50.142253    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9bc6ab_3df0_44b4_8f33_a471410b307d.slice/crio-6a5a73296c906724ab37f434d4477784ccbc8f14cbd76ca77bcd362a473c2494 WatchSource:0}: Error finding container 6a5a73296c906724ab37f434d4477784ccbc8f14cbd76ca77bcd362a473c2494: Status 404 returned error can't find the container with id 6a5a73296c906724ab37f434d4477784ccbc8f14cbd76ca77bcd362a473c2494
Jul 29 12:26:50.408277 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:50.408243    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-tls\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:50.410533 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:50.410505    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/499165fc-ef99-47ea-8457-9b1b2c424d53-node-exporter-tls\") pod \"node-exporter-lj84r\" (UID: \"499165fc-ef99-47ea-8457-9b1b2c424d53\") " pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:50.595848 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:50.595814    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lj84r"
Jul 29 12:26:50.606662 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:50.606632    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499165fc_ef99_47ea_8457_9b1b2c424d53.slice/crio-cad7e4f093c757ac56cebbb8f64aa997b0649960308252788e6c6f1d8cef472c WatchSource:0}: Error finding container cad7e4f093c757ac56cebbb8f64aa997b0649960308252788e6c6f1d8cef472c: Status 404 returned error can't find the container with id cad7e4f093c757ac56cebbb8f64aa997b0649960308252788e6c6f1d8cef472c
Jul 29 12:26:51.031591 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:51.031564    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57656bb7cb-xfmz9"
Jul 29 12:26:51.142755 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:51.142680    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x" event={"ID":"ba9bc6ab-3df0-44b4-8f33-a471410b307d","Type":"ContainerStarted","Data":"6a5a73296c906724ab37f434d4477784ccbc8f14cbd76ca77bcd362a473c2494"}
Jul 29 12:26:51.145465 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:51.145441    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc" event={"ID":"73a85260-8109-40da-9219-406a7c03291a","Type":"ContainerStarted","Data":"5e1d548d8e63ba9cebe03a26de4ada099fcb515311fef8d2bf899f66f3adb734"}
Jul 29 12:26:51.145608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:51.145498    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc" event={"ID":"73a85260-8109-40da-9219-406a7c03291a","Type":"ContainerStarted","Data":"01d754e16f8cda8fc66441550e9cf3508f6f2138af1c7730a94d214ef21c94df"}
Jul 29 12:26:51.146875 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:51.146822    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj84r" event={"ID":"499165fc-ef99-47ea-8457-9b1b2c424d53","Type":"ContainerStarted","Data":"cad7e4f093c757ac56cebbb8f64aa997b0649960308252788e6c6f1d8cef472c"}
Jul 29 12:26:52.153822 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.153789    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x" event={"ID":"ba9bc6ab-3df0-44b4-8f33-a471410b307d","Type":"ContainerStarted","Data":"35dbe640acc2000391dfd89f7e118d6b40baa79dcdbeae22dae4202836177b94"}
Jul 29 12:26:52.157579 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.157551    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc" event={"ID":"73a85260-8109-40da-9219-406a7c03291a","Type":"ContainerStarted","Data":"946f9f92d0e72f1eb8ab6432ed4a0f8d7c338b884c4d774a11ed4169c6c7e669"}
Jul 29 12:26:52.159635 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.159609    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj84r" event={"ID":"499165fc-ef99-47ea-8457-9b1b2c424d53","Type":"ContainerStarted","Data":"2ef8b58822a189d7ce85efc560fe11b519949ccd04ef6020960d25ebfe3e72ba"}
Jul 29 12:26:52.196231 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.196162    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qnpcc" podStartSLOduration=2.101153237 podStartE2EDuration="3.196139665s" totalImagesPullingTime="1.094986428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:52.194665816 +0000 UTC m=+89.014716595" watchObservedRunningTime="2026-07-29 12:26:52.196139665 +0000 UTC m=+89.016190443"
Jul 29 12:26:52.693995 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.693959    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5596f46cc-x4s2f"]
Jul 29 12:26:52.697632 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.697614    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.703800 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.703775    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 12:26:52.703800 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.703777    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-84qw6\""
Jul 29 12:26:52.704005 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.703818    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bd875lb6op21v\""
Jul 29 12:26:52.704082 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.704057    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 12:26:52.704451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.704183    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 12:26:52.704451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.704287    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 12:26:52.704596 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.704578    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 12:26:52.715811 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.715792    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5596f46cc-x4s2f"]
Jul 29 12:26:52.726403 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726373    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.726504 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726413    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9qxp\" (UniqueName: \"kubernetes.io/projected/246e61c7-0c14-473b-b64b-9123effc47a7-kube-api-access-q9qxp\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.726504 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726436    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.726504 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726458    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/246e61c7-0c14-473b-b64b-9123effc47a7-metrics-client-ca\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.726504 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726482    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-tls\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.726504 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726498    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.726677 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726618    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.726711 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.726677    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-grpc-tls\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.827891 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.827861    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828036 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.827905    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-grpc-tls\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828036 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.827936    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828036 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.827958    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9qxp\" (UniqueName: \"kubernetes.io/projected/246e61c7-0c14-473b-b64b-9123effc47a7-kube-api-access-q9qxp\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828036 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.827978    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828036 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.827999    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/246e61c7-0c14-473b-b64b-9123effc47a7-metrics-client-ca\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828036 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.828022    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-tls\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828277 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.828043    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.828847 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.828799    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/246e61c7-0c14-473b-b64b-9123effc47a7-metrics-client-ca\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.830581 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.830535    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.830720 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.830694    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-grpc-tls\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.830813 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.830753    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.830881 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.830864    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.831011 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.830993    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.831045 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.831015    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/246e61c7-0c14-473b-b64b-9123effc47a7-secret-thanos-querier-tls\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:52.838638 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:52.838620    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9qxp\" (UniqueName: \"kubernetes.io/projected/246e61c7-0c14-473b-b64b-9123effc47a7-kube-api-access-q9qxp\") pod \"thanos-querier-5596f46cc-x4s2f\" (UID: \"246e61c7-0c14-473b-b64b-9123effc47a7\") " pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:53.007158 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.007065    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:53.139169 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.139148    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5596f46cc-x4s2f"]
Jul 29 12:26:53.141347 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:26:53.141288    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246e61c7_0c14_473b_b64b_9123effc47a7.slice/crio-398ff3d65a51c8c7d3f371682885aeb030d3d6d3aafa17b5ed2bd76b07324a0b WatchSource:0}: Error finding container 398ff3d65a51c8c7d3f371682885aeb030d3d6d3aafa17b5ed2bd76b07324a0b: Status 404 returned error can't find the container with id 398ff3d65a51c8c7d3f371682885aeb030d3d6d3aafa17b5ed2bd76b07324a0b
Jul 29 12:26:53.165467 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.165445    2549 generic.go:356] "Generic (PLEG): container finished" podID="499165fc-ef99-47ea-8457-9b1b2c424d53" containerID="2ef8b58822a189d7ce85efc560fe11b519949ccd04ef6020960d25ebfe3e72ba" exitCode=0
Jul 29 12:26:53.165802 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.165535    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj84r" event={"ID":"499165fc-ef99-47ea-8457-9b1b2c424d53","Type":"ContainerDied","Data":"2ef8b58822a189d7ce85efc560fe11b519949ccd04ef6020960d25ebfe3e72ba"}
Jul 29 12:26:53.165802 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.165593    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj84r" event={"ID":"499165fc-ef99-47ea-8457-9b1b2c424d53","Type":"ContainerStarted","Data":"122253a546ef34152b19f66bdabe74062aaed75215abc15741b88c1839d9b9e0"}
Jul 29 12:26:53.165802 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.165617    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj84r" event={"ID":"499165fc-ef99-47ea-8457-9b1b2c424d53","Type":"ContainerStarted","Data":"9eb793705b087cbc4e807fa6894b273b547bccd96b40e21c195f59d070fc862c"}
Jul 29 12:26:53.167568 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.167548    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x" event={"ID":"ba9bc6ab-3df0-44b4-8f33-a471410b307d","Type":"ContainerStarted","Data":"2786d0e2acf1ee972efdf484eff5652f04ca5b42716faa6c253fb47ef9324ef6"}
Jul 29 12:26:53.167652 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.167604    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x" event={"ID":"ba9bc6ab-3df0-44b4-8f33-a471410b307d","Type":"ContainerStarted","Data":"ea99d0ad155cd36d335052e56dea37f540d745d47bb108bb43a07a346d82a8ee"}
Jul 29 12:26:53.168742 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.168722    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" event={"ID":"246e61c7-0c14-473b-b64b-9123effc47a7","Type":"ContainerStarted","Data":"398ff3d65a51c8c7d3f371682885aeb030d3d6d3aafa17b5ed2bd76b07324a0b"}
Jul 29 12:26:53.184669 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.184629    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lj84r" podStartSLOduration=2.723714309 podStartE2EDuration="4.184616092s" totalImagesPullingTime="1.390685098s" totalInitContainerRuntime="70.216685ms" isStatefulPod=true podCreationTimestamp="2026-07-29 12:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:53.183258585 +0000 UTC m=+90.003309361" watchObservedRunningTime="2026-07-29 12:26:53.184616092 +0000 UTC m=+90.004666869"
Jul 29 12:26:53.201013 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:53.200977    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8lh2x" podStartSLOduration=2.304471228 podStartE2EDuration="4.200965186s" totalImagesPullingTime="1.896493958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:53.199797272 +0000 UTC m=+90.019848048" watchObservedRunningTime="2026-07-29 12:26:53.200965186 +0000 UTC m=+90.021015965"
Jul 29 12:26:56.187445 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:56.187351    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" event={"ID":"246e61c7-0c14-473b-b64b-9123effc47a7","Type":"ContainerStarted","Data":"dbe8f9e8db59d7960e4fda5ea2d438004641ca0ea6c979745fe16b03023b01c5"}
Jul 29 12:26:56.187445 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:56.187426    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" event={"ID":"246e61c7-0c14-473b-b64b-9123effc47a7","Type":"ContainerStarted","Data":"9e3448659aac9aae6b127ac82e9339f0967c9d46299d3ae6533f023bfdfdcff7"}
Jul 29 12:26:56.187816 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:56.187453    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" event={"ID":"246e61c7-0c14-473b-b64b-9123effc47a7","Type":"ContainerStarted","Data":"8cd69ee4da8f79d41ba0fffebea723c4a1576c652f4ab5c2e6ff8cbdb4f4dc0a"}
Jul 29 12:26:57.194611 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:57.194534    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" event={"ID":"246e61c7-0c14-473b-b64b-9123effc47a7","Type":"ContainerStarted","Data":"98367743c7bfbeff1901d4273b34189a64316dd60a167e5297c73e7a7c163359"}
Jul 29 12:26:57.194611 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:57.194604    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" event={"ID":"246e61c7-0c14-473b-b64b-9123effc47a7","Type":"ContainerStarted","Data":"0c333071110a9190773bad6d246ee734c818f2d3ec66e4d6c1510111dafee25d"}
Jul 29 12:26:57.194970 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:57.194631    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" event={"ID":"246e61c7-0c14-473b-b64b-9123effc47a7","Type":"ContainerStarted","Data":"29e4fb212e95533e8c02dece1260a4fea4aec9e1bf20f8f80ec1f30359ae74dd"}
Jul 29 12:26:57.194970 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:57.194680    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:26:57.217138 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:26:57.217088    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f" podStartSLOduration=1.690717402 podStartE2EDuration="5.217075648s" totalImagesPullingTime="3.526358246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:26:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:26:57.216350351 +0000 UTC m=+94.036401128" watchObservedRunningTime="2026-07-29 12:26:57.217075648 +0000 UTC m=+94.037126425"
Jul 29 12:27:03.203925 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:03.203895    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5596f46cc-x4s2f"
Jul 29 12:27:09.091137 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:09.091103    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rdcjp"
Jul 29 12:27:14.260044 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.259961    2549 generic.go:356] "Generic (PLEG): container finished" podID="2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778" containerID="9fff817b33804f9afda365c9849e819a9023ef2b539ff0055715b28c4b58012a" exitCode=0
Jul 29 12:27:14.260044 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.260034    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4x8mj" event={"ID":"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778","Type":"ContainerDied","Data":"9fff817b33804f9afda365c9849e819a9023ef2b539ff0055715b28c4b58012a"}
Jul 29 12:27:14.260529 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.260385    2549 scope.go:117] "RemoveContainer" containerID="9fff817b33804f9afda365c9849e819a9023ef2b539ff0055715b28c4b58012a"
Jul 29 12:27:14.446071 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.446029    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c9c694f89-p4rlh" podUID="b7bce965-8d54-427d-a5d5-b3731b410897" containerName="console" containerID="cri-o://c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a" gracePeriod=15
Jul 29 12:27:14.687060 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.687038    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:27:14.809552 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.809524    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-serving-cert\") pod \"b7bce965-8d54-427d-a5d5-b3731b410897\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") "
Jul 29 12:27:14.809695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.809560    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mpjd\" (UniqueName: \"kubernetes.io/projected/b7bce965-8d54-427d-a5d5-b3731b410897-kube-api-access-7mpjd\") pod \"b7bce965-8d54-427d-a5d5-b3731b410897\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") "
Jul 29 12:27:14.809695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.809580    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-console-config\") pod \"b7bce965-8d54-427d-a5d5-b3731b410897\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") "
Jul 29 12:27:14.809695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.809608    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-oauth-config\") pod \"b7bce965-8d54-427d-a5d5-b3731b410897\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") "
Jul 29 12:27:14.809695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.809640    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-oauth-serving-cert\") pod \"b7bce965-8d54-427d-a5d5-b3731b410897\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") "
Jul 29 12:27:14.809695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.809674    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-service-ca\") pod \"b7bce965-8d54-427d-a5d5-b3731b410897\" (UID: \"b7bce965-8d54-427d-a5d5-b3731b410897\") "
Jul 29 12:27:14.810004 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.809974    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-console-config" (OuterVolumeSpecName: "console-config") pod "b7bce965-8d54-427d-a5d5-b3731b410897" (UID: "b7bce965-8d54-427d-a5d5-b3731b410897"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:27:14.810122 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.810085    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b7bce965-8d54-427d-a5d5-b3731b410897" (UID: "b7bce965-8d54-427d-a5d5-b3731b410897"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:27:14.810247 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.810206    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-service-ca" (OuterVolumeSpecName: "service-ca") pod "b7bce965-8d54-427d-a5d5-b3731b410897" (UID: "b7bce965-8d54-427d-a5d5-b3731b410897"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:27:14.811945 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.811894    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b7bce965-8d54-427d-a5d5-b3731b410897" (UID: "b7bce965-8d54-427d-a5d5-b3731b410897"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 12:27:14.812060 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.811939    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7bce965-8d54-427d-a5d5-b3731b410897-kube-api-access-7mpjd" (OuterVolumeSpecName: "kube-api-access-7mpjd") pod "b7bce965-8d54-427d-a5d5-b3731b410897" (UID: "b7bce965-8d54-427d-a5d5-b3731b410897"). InnerVolumeSpecName "kube-api-access-7mpjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:27:14.812060 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.811957    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b7bce965-8d54-427d-a5d5-b3731b410897" (UID: "b7bce965-8d54-427d-a5d5-b3731b410897"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 12:27:14.910388 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.910359    2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-serving-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:27:14.910388 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.910385    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mpjd\" (UniqueName: \"kubernetes.io/projected/b7bce965-8d54-427d-a5d5-b3731b410897-kube-api-access-7mpjd\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:27:14.910550 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.910395    2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-console-config\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:27:14.910550 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.910403    2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bce965-8d54-427d-a5d5-b3731b410897-console-oauth-config\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:27:14.910550 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.910415    2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-oauth-serving-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:27:14.910550 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:14.910423    2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bce965-8d54-427d-a5d5-b3731b410897-service-ca\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:27:15.143491 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.143418    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6999b477-zzhch_a8a6840f-d7d1-47b6-951f-a8f9b222e3db/router/0.log"
Jul 29 12:27:15.155848 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.155830    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sb5c9_09f20c1e-764a-425d-a975-99e9fb8fa8d6/serve-healthcheck-canary/0.log"
Jul 29 12:27:15.265541 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.265512    2549 generic.go:356] "Generic (PLEG): container finished" podID="b7bce965-8d54-427d-a5d5-b3731b410897" containerID="c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a" exitCode=0
Jul 29 12:27:15.265950 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.265563    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c694f89-p4rlh"
Jul 29 12:27:15.265950 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.265602    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c694f89-p4rlh" event={"ID":"b7bce965-8d54-427d-a5d5-b3731b410897","Type":"ContainerDied","Data":"c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a"}
Jul 29 12:27:15.265950 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.265667    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c694f89-p4rlh" event={"ID":"b7bce965-8d54-427d-a5d5-b3731b410897","Type":"ContainerDied","Data":"d13e84f5e8dc5481aabaaa01c3438d4106916d41253e93b5e42e0f691c9c4e82"}
Jul 29 12:27:15.265950 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.265697    2549 scope.go:117] "RemoveContainer" containerID="c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a"
Jul 29 12:27:15.267573 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.267550    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-4x8mj" event={"ID":"2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778","Type":"ContainerStarted","Data":"d19137b02c3348bab704d54d51390d1b10abbf3190d57eb24fdb33b5270cfb4f"}
Jul 29 12:27:15.275924 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.275904    2549 scope.go:117] "RemoveContainer" containerID="c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a"
Jul 29 12:27:15.276355 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:27:15.276326    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a\": container with ID starting with c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a not found: ID does not exist" containerID="c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a"
Jul 29 12:27:15.276431 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.276367    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a"} err="failed to get container status \"c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a\": rpc error: code = NotFound desc = could not find container \"c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a\": container with ID starting with c9dcea416bf09c9e7ea9058d04a13edffbfcf5b146f3627544ed6a294785e95a not found: ID does not exist"
Jul 29 12:27:15.312613 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.312578    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9c694f89-p4rlh"]
Jul 29 12:27:15.316999 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.316981    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c9c694f89-p4rlh"]
Jul 29 12:27:15.695798 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:27:15.695765    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7bce965-8d54-427d-a5d5-b3731b410897" path="/var/lib/kubelet/pods/b7bce965-8d54-427d-a5d5-b3731b410897/volumes"
Jul 29 12:28:25.750018 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.749945    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75c9f9d5c7-sdkw2"]
Jul 29 12:28:25.750446 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.750218    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7bce965-8d54-427d-a5d5-b3731b410897" containerName="console"
Jul 29 12:28:25.750446 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.750228    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7bce965-8d54-427d-a5d5-b3731b410897" containerName="console"
Jul 29 12:28:25.750446 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.750300    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7bce965-8d54-427d-a5d5-b3731b410897" containerName="console"
Jul 29 12:28:25.752946 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.752930    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.755770 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.755729    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 12:28:25.755894 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.755828    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gwdkx\""
Jul 29 12:28:25.758075 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.758056    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 12:28:25.758423 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.758398    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 12:28:25.759120 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.759101    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 12:28:25.759363 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.759339    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 12:28:25.759798 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.759555    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 12:28:25.759798 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.759666    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 12:28:25.766542 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.766519    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 12:28:25.767921 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.767897    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75c9f9d5c7-sdkw2"]
Jul 29 12:28:25.857494 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.857461    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-oauth-serving-cert\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.857494 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.857496    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-serving-cert\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.857702 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.857520    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5bp\" (UniqueName: \"kubernetes.io/projected/6ab28548-4515-47e7-9c3f-2bb167f1132f-kube-api-access-bs5bp\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.857702 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.857537    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-config\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.857702 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.857556    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-oauth-config\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.857702 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.857667    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-trusted-ca-bundle\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.857702 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.857696    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-service-ca\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.958958 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.958921    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-oauth-serving-cert\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.958958 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.958957    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-serving-cert\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959193 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.958976    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5bp\" (UniqueName: \"kubernetes.io/projected/6ab28548-4515-47e7-9c3f-2bb167f1132f-kube-api-access-bs5bp\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959193 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.958996    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-config\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959193 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.959027    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-oauth-config\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959193 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.959095    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-trusted-ca-bundle\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959193 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.959123    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-service-ca\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959799 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.959778    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-oauth-serving-cert\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959887 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.959783    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-config\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.959887 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.959860    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-service-ca\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.960381 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.960354    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-trusted-ca-bundle\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.961546 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.961519    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-serving-cert\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.961795 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.961779    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-oauth-config\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:25.966916 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:25.966879    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5bp\" (UniqueName: \"kubernetes.io/projected/6ab28548-4515-47e7-9c3f-2bb167f1132f-kube-api-access-bs5bp\") pod \"console-75c9f9d5c7-sdkw2\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") " pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:26.062279 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:26.062249    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:26.188160 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:26.188135    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75c9f9d5c7-sdkw2"]
Jul 29 12:28:26.190452 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:28:26.190426    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab28548_4515_47e7_9c3f_2bb167f1132f.slice/crio-5806d451a97a534dbc16a8bf9a21845293974f88601d86daa7a05af933423e88 WatchSource:0}: Error finding container 5806d451a97a534dbc16a8bf9a21845293974f88601d86daa7a05af933423e88: Status 404 returned error can't find the container with id 5806d451a97a534dbc16a8bf9a21845293974f88601d86daa7a05af933423e88
Jul 29 12:28:26.537153 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:26.537122    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c9f9d5c7-sdkw2" event={"ID":"6ab28548-4515-47e7-9c3f-2bb167f1132f","Type":"ContainerStarted","Data":"0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04"}
Jul 29 12:28:26.537354 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:26.537171    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c9f9d5c7-sdkw2" event={"ID":"6ab28548-4515-47e7-9c3f-2bb167f1132f","Type":"ContainerStarted","Data":"5806d451a97a534dbc16a8bf9a21845293974f88601d86daa7a05af933423e88"}
Jul 29 12:28:26.556403 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:26.556356    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75c9f9d5c7-sdkw2" podStartSLOduration=1.556340667 podStartE2EDuration="1.556340667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:28:26.555511936 +0000 UTC m=+183.375562713" watchObservedRunningTime="2026-07-29 12:28:26.556340667 +0000 UTC m=+183.376391443"
Jul 29 12:28:36.063097 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:36.063062    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:36.063574 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:36.063119    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:36.067828 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:36.067804    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:28:36.578952 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:28:36.578927    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:30:23.571754 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:23.571726    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:30:23.574479 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:23.574451    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:30:23.575356 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:23.575332    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:30:23.578433 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:23.578412    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:30:23.581402 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:23.581384    2549 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 12:30:38.475025 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.474991    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hfjxt"]
Jul 29 12:30:38.478065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.478050    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.492448 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.492426    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 12:30:38.492549 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.492453    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 12:30:38.493336 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.493303    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jvhd5\""
Jul 29 12:30:38.498838 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.498813    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hfjxt"]
Jul 29 12:30:38.575696 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.575668    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wscm8\" (UniqueName: \"kubernetes.io/projected/583f6057-9564-4d4f-9a70-387f3a69e81c-kube-api-access-wscm8\") pod \"cert-manager-55b4d954d5-hfjxt\" (UID: \"583f6057-9564-4d4f-9a70-387f3a69e81c\") " pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.575823 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.575719    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/583f6057-9564-4d4f-9a70-387f3a69e81c-bound-sa-token\") pod \"cert-manager-55b4d954d5-hfjxt\" (UID: \"583f6057-9564-4d4f-9a70-387f3a69e81c\") " pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.677031 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.677001    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wscm8\" (UniqueName: \"kubernetes.io/projected/583f6057-9564-4d4f-9a70-387f3a69e81c-kube-api-access-wscm8\") pod \"cert-manager-55b4d954d5-hfjxt\" (UID: \"583f6057-9564-4d4f-9a70-387f3a69e81c\") " pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.677169 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.677056    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/583f6057-9564-4d4f-9a70-387f3a69e81c-bound-sa-token\") pod \"cert-manager-55b4d954d5-hfjxt\" (UID: \"583f6057-9564-4d4f-9a70-387f3a69e81c\") " pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.685367 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.685342    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/583f6057-9564-4d4f-9a70-387f3a69e81c-bound-sa-token\") pod \"cert-manager-55b4d954d5-hfjxt\" (UID: \"583f6057-9564-4d4f-9a70-387f3a69e81c\") " pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.685776 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.685756    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wscm8\" (UniqueName: \"kubernetes.io/projected/583f6057-9564-4d4f-9a70-387f3a69e81c-kube-api-access-wscm8\") pod \"cert-manager-55b4d954d5-hfjxt\" (UID: \"583f6057-9564-4d4f-9a70-387f3a69e81c\") " pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.799586 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.799557    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hfjxt"
Jul 29 12:30:38.929047 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.929017    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hfjxt"]
Jul 29 12:30:38.930362 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:30:38.930322    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod583f6057_9564_4d4f_9a70_387f3a69e81c.slice/crio-f5365b3f6a0f5c0ece877c6ea43e2681517855e20afb0ebeedf67afffb01cb20 WatchSource:0}: Error finding container f5365b3f6a0f5c0ece877c6ea43e2681517855e20afb0ebeedf67afffb01cb20: Status 404 returned error can't find the container with id f5365b3f6a0f5c0ece877c6ea43e2681517855e20afb0ebeedf67afffb01cb20
Jul 29 12:30:38.932195 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:38.932179    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 12:30:39.044839 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:39.044802    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hfjxt" event={"ID":"583f6057-9564-4d4f-9a70-387f3a69e81c","Type":"ContainerStarted","Data":"f5365b3f6a0f5c0ece877c6ea43e2681517855e20afb0ebeedf67afffb01cb20"}
Jul 29 12:30:43.068249 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:43.068213    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hfjxt" event={"ID":"583f6057-9564-4d4f-9a70-387f3a69e81c","Type":"ContainerStarted","Data":"8e93f18e9b7974e6f50608f20fee149613f91189222cb6d143379bb608b9b0f8"}
Jul 29 12:30:43.088604 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:43.088553    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hfjxt" podStartSLOduration=1.352033679 podStartE2EDuration="5.088537656s" totalImagesPullingTime="3.736503977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:30:43.086709856 +0000 UTC m=+319.906760635" watchObservedRunningTime="2026-07-29 12:30:43.088537656 +0000 UTC m=+319.908588432"
Jul 29 12:30:46.758540 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.758510    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"]
Jul 29 12:30:46.761476 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.761460    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.764467 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.764444    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 12:30:46.765255 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.765232    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 12:30:46.765255 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.765247    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 12:30:46.765439 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.765280    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 12:30:46.765439 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.765331    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hw5pt\""
Jul 29 12:30:46.765439 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.765368    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 12:30:46.776127 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.776109    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"]
Jul 29 12:30:46.853573 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.853544    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d61e964-4d9d-44e0-be23-e005f89e0aa9-cert\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.853693 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.853590    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d61e964-4d9d-44e0-be23-e005f89e0aa9-manager-config\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.853693 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.853626    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnb82\" (UniqueName: \"kubernetes.io/projected/9d61e964-4d9d-44e0-be23-e005f89e0aa9-kube-api-access-xnb82\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.853693 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.853653    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d61e964-4d9d-44e0-be23-e005f89e0aa9-metrics-cert\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.954783 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.954752    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d61e964-4d9d-44e0-be23-e005f89e0aa9-metrics-cert\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.954925 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.954816    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d61e964-4d9d-44e0-be23-e005f89e0aa9-cert\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.954925 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.954849    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d61e964-4d9d-44e0-be23-e005f89e0aa9-manager-config\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.954925 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.954885    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnb82\" (UniqueName: \"kubernetes.io/projected/9d61e964-4d9d-44e0-be23-e005f89e0aa9-kube-api-access-xnb82\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.955583 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.955561    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d61e964-4d9d-44e0-be23-e005f89e0aa9-manager-config\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.957124 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.957105    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d61e964-4d9d-44e0-be23-e005f89e0aa9-cert\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.957200 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.957185    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d61e964-4d9d-44e0-be23-e005f89e0aa9-metrics-cert\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:46.963162 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:46.963138    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnb82\" (UniqueName: \"kubernetes.io/projected/9d61e964-4d9d-44e0-be23-e005f89e0aa9-kube-api-access-xnb82\") pod \"lws-controller-manager-69d46b4769-nzh54\" (UID: \"9d61e964-4d9d-44e0-be23-e005f89e0aa9\") " pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:47.070621 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:47.070593    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:47.205029 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:47.204994    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"]
Jul 29 12:30:47.208328 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:30:47.208278    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d61e964_4d9d_44e0_be23_e005f89e0aa9.slice/crio-5569e03dfe6c5e3c211540c12f1e7b757b404b31cd80664aa52e347f46205054 WatchSource:0}: Error finding container 5569e03dfe6c5e3c211540c12f1e7b757b404b31cd80664aa52e347f46205054: Status 404 returned error can't find the container with id 5569e03dfe6c5e3c211540c12f1e7b757b404b31cd80664aa52e347f46205054
Jul 29 12:30:48.089696 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:48.089664    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54" event={"ID":"9d61e964-4d9d-44e0-be23-e005f89e0aa9","Type":"ContainerStarted","Data":"5569e03dfe6c5e3c211540c12f1e7b757b404b31cd80664aa52e347f46205054"}
Jul 29 12:30:51.103645 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:51.103609    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54" event={"ID":"9d61e964-4d9d-44e0-be23-e005f89e0aa9","Type":"ContainerStarted","Data":"b81ed50a1551387ee00de53047c5e33aa870b94d03ce86f20c93839b2561acf8"}
Jul 29 12:30:51.104065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:51.103806    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:30:51.129426 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:51.129369    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54" podStartSLOduration=2.068978658 podStartE2EDuration="5.129353092s" totalImagesPullingTime="3.060374434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:30:51.126824042 +0000 UTC m=+327.946874819" watchObservedRunningTime="2026-07-29 12:30:51.129353092 +0000 UTC m=+327.949403868"
Jul 29 12:30:52.236159 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.236121    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"]
Jul 29 12:30:52.239749 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.239720    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.249585 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.249562    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 12:30:52.250519 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.250496    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 12:30:52.251398 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.251376    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kbp6j\""
Jul 29 12:30:52.251623 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.251592    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 12:30:52.251710 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.251697    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 12:30:52.271680 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.271649    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"]
Jul 29 12:30:52.403412 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.403380    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ab25446-1663-4c1b-b280-96ddc45eb9d7-tmp\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.403620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.403430    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ab25446-1663-4c1b-b280-96ddc45eb9d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.403620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.403503    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ab25446-1663-4c1b-b280-96ddc45eb9d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.403620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.403555    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2thz\" (UniqueName: \"kubernetes.io/projected/8ab25446-1663-4c1b-b280-96ddc45eb9d7-kube-api-access-p2thz\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.403620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.403597    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ab25446-1663-4c1b-b280-96ddc45eb9d7-manifests\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.504344 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.504237    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ab25446-1663-4c1b-b280-96ddc45eb9d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.504344 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.504276    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2thz\" (UniqueName: \"kubernetes.io/projected/8ab25446-1663-4c1b-b280-96ddc45eb9d7-kube-api-access-p2thz\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.504344 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.504303    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ab25446-1663-4c1b-b280-96ddc45eb9d7-manifests\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.504590 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.504351    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ab25446-1663-4c1b-b280-96ddc45eb9d7-tmp\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.504590 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.504411    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ab25446-1663-4c1b-b280-96ddc45eb9d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.504824 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.504806    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ab25446-1663-4c1b-b280-96ddc45eb9d7-manifests\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.506516 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.506492    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ab25446-1663-4c1b-b280-96ddc45eb9d7-tmp\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.507236 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.507213    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ab25446-1663-4c1b-b280-96ddc45eb9d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.507366 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.507347    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ab25446-1663-4c1b-b280-96ddc45eb9d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.516611 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.516591    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2thz\" (UniqueName: \"kubernetes.io/projected/8ab25446-1663-4c1b-b280-96ddc45eb9d7-kube-api-access-p2thz\") pod \"opendatahub-operator-controller-manager-556f8bf875-z5plj\" (UID: \"8ab25446-1663-4c1b-b280-96ddc45eb9d7\") " pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.553793 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.553770    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:30:52.704427 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:52.704400    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"]
Jul 29 12:30:52.706569 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:30:52.706546    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab25446_1663_4c1b_b280_96ddc45eb9d7.slice/crio-e8a20b9bf2b6f89e5f34c808557fc4ecd63bf0c12d79f1df5aa44bcc94f225f2 WatchSource:0}: Error finding container e8a20b9bf2b6f89e5f34c808557fc4ecd63bf0c12d79f1df5aa44bcc94f225f2: Status 404 returned error can't find the container with id e8a20b9bf2b6f89e5f34c808557fc4ecd63bf0c12d79f1df5aa44bcc94f225f2
Jul 29 12:30:53.112633 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:53.112596    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj" event={"ID":"8ab25446-1663-4c1b-b280-96ddc45eb9d7","Type":"ContainerStarted","Data":"e8a20b9bf2b6f89e5f34c808557fc4ecd63bf0c12d79f1df5aa44bcc94f225f2"}
Jul 29 12:30:56.128868 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:56.128832    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj" event={"ID":"8ab25446-1663-4c1b-b280-96ddc45eb9d7","Type":"ContainerStarted","Data":"6e496f9b905dba5186554d77359c7167e4219c46f4a0ef49a3146058dd32c853"}
Jul 29 12:30:57.135121 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:57.135082    2549 generic.go:356] "Generic (PLEG): container finished" podID="8ab25446-1663-4c1b-b280-96ddc45eb9d7" containerID="6e496f9b905dba5186554d77359c7167e4219c46f4a0ef49a3146058dd32c853" exitCode=0
Jul 29 12:30:57.135516 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:57.135139    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj" event={"ID":"8ab25446-1663-4c1b-b280-96ddc45eb9d7","Type":"ContainerDied","Data":"6e496f9b905dba5186554d77359c7167e4219c46f4a0ef49a3146058dd32c853"}
Jul 29 12:30:58.141024 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:58.140979    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj" event={"ID":"8ab25446-1663-4c1b-b280-96ddc45eb9d7","Type":"ContainerStarted","Data":"8475b35946643a3b504aeb0400a27890576ed1d970d7779831cf1fab230e1f45"}
Jul 29 12:30:58.141414 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:30:58.141088    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:31:02.110538 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:02.110507    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69d46b4769-nzh54"
Jul 29 12:31:02.129151 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:02.129101    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj" podStartSLOduration=5.264219779 podStartE2EDuration="10.129084718s" totalImagesPullingTime="3.853969951s" totalInitContainerRuntime="1.010894988s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:30:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:30:58.177015154 +0000 UTC m=+334.997065933" watchObservedRunningTime="2026-07-29 12:31:02.129084718 +0000 UTC m=+338.949135496"
Jul 29 12:31:09.147449 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:09.147419    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-556f8bf875-z5plj"
Jul 29 12:31:22.521084 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.521045    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"]
Jul 29 12:31:22.524229 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.524208    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.531632 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.531612    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vl6v6\""
Jul 29 12:31:22.540457 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.540427    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 12:31:22.544639 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.544623    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 12:31:22.567525 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.567499    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"]
Jul 29 12:31:22.658976 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.658951    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/896a5175-d6b1-4e6d-96a4-01d8f255b98d-tmp\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.659127 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.658985    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2h6d\" (UniqueName: \"kubernetes.io/projected/896a5175-d6b1-4e6d-96a4-01d8f255b98d-kube-api-access-k2h6d\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.659127 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.659023    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896a5175-d6b1-4e6d-96a4-01d8f255b98d-tls-certs\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.759576 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.759547    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896a5175-d6b1-4e6d-96a4-01d8f255b98d-tls-certs\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.759729 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.759605    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/896a5175-d6b1-4e6d-96a4-01d8f255b98d-tmp\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.759729 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.759631    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2h6d\" (UniqueName: \"kubernetes.io/projected/896a5175-d6b1-4e6d-96a4-01d8f255b98d-kube-api-access-k2h6d\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.761813 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.761792    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/896a5175-d6b1-4e6d-96a4-01d8f255b98d-tmp\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.761934 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.761918    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896a5175-d6b1-4e6d-96a4-01d8f255b98d-tls-certs\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.772665 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.772616    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2h6d\" (UniqueName: \"kubernetes.io/projected/896a5175-d6b1-4e6d-96a4-01d8f255b98d-kube-api-access-k2h6d\") pod \"kube-auth-proxy-6bb9c5fc49-6h4sq\" (UID: \"896a5175-d6b1-4e6d-96a4-01d8f255b98d\") " pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.833925 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.833903    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"
Jul 29 12:31:22.976086 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:22.976062    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq"]
Jul 29 12:31:22.978389 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:31:22.978362    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896a5175_d6b1_4e6d_96a4_01d8f255b98d.slice/crio-14d62f545251cf6f66eab0649d075506205dae89a1aa39aca97491f04d143730 WatchSource:0}: Error finding container 14d62f545251cf6f66eab0649d075506205dae89a1aa39aca97491f04d143730: Status 404 returned error can't find the container with id 14d62f545251cf6f66eab0649d075506205dae89a1aa39aca97491f04d143730
Jul 29 12:31:23.248041 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:23.247962    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq" event={"ID":"896a5175-d6b1-4e6d-96a4-01d8f255b98d","Type":"ContainerStarted","Data":"14d62f545251cf6f66eab0649d075506205dae89a1aa39aca97491f04d143730"}
Jul 29 12:31:25.964819 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:25.964790    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 12:31:26.263138 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:26.263046    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq" event={"ID":"896a5175-d6b1-4e6d-96a4-01d8f255b98d","Type":"ContainerStarted","Data":"024a901d2b8eb12571ef7a04dd418c2e880bc62ade158dea5e6e28f93ccb22e1"}
Jul 29 12:31:26.287517 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:31:26.287470    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bb9c5fc49-6h4sq" podStartSLOduration=1.3053207279999999 podStartE2EDuration="4.287454666s" totalImagesPullingTime="2.982133938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:31:26.286613966 +0000 UTC m=+363.106664746" watchObservedRunningTime="2026-07-29 12:31:26.287454666 +0000 UTC m=+363.107505474"
Jul 29 12:33:06.010979 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.010905    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"]
Jul 29 12:33:06.014053 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.014033    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.016627 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.016603    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 12:33:06.016714 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.016658    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 12:33:06.017555 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.017537    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jw82m\""
Jul 29 12:33:06.017766 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.017753    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 12:33:06.018060 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.018047    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 12:33:06.023959 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.023939    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"]
Jul 29 12:33:06.118768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.118731    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.118937 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.118783    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4x7p\" (UniqueName: \"kubernetes.io/projected/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-kube-api-access-w4x7p\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.118937 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.118854    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.219576 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.219542    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4x7p\" (UniqueName: \"kubernetes.io/projected/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-kube-api-access-w4x7p\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.219747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.219628    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.219747 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.219656    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.220522 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.220485    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.222068 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.222049    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.232370 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.232348    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4x7p\" (UniqueName: \"kubernetes.io/projected/9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab-kube-api-access-w4x7p\") pod \"kuadrant-console-plugin-66b5774985-fn2cd\" (UID: \"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.324142 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.324112    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"
Jul 29 12:33:06.451073 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.451049    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd"]
Jul 29 12:33:06.453595 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:33:06.453569    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d2d7a8e_96fa_434f_ad5a_0ea0c7caccab.slice/crio-9c8c662a430dcf15a939fe96e9369beca4b00c0bf03bc6711e84608e08b2df92 WatchSource:0}: Error finding container 9c8c662a430dcf15a939fe96e9369beca4b00c0bf03bc6711e84608e08b2df92: Status 404 returned error can't find the container with id 9c8c662a430dcf15a939fe96e9369beca4b00c0bf03bc6711e84608e08b2df92
Jul 29 12:33:06.689117 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:06.689032    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd" event={"ID":"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab","Type":"ContainerStarted","Data":"9c8c662a430dcf15a939fe96e9369beca4b00c0bf03bc6711e84608e08b2df92"}
Jul 29 12:33:16.491161 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.491116    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"]
Jul 29 12:33:16.500179 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.500150    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:16.503013 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.502986    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9h9ms\""
Jul 29 12:33:16.514395 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.514371    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"]
Jul 29 12:33:16.618391 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.618359    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74955595-2b3f-4d6b-b079-84f4ecd9f245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ckzlq\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:16.618579 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.618423    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zpp\" (UniqueName: \"kubernetes.io/projected/74955595-2b3f-4d6b-b079-84f4ecd9f245-kube-api-access-d2zpp\") pod \"kuadrant-operator-controller-manager-55467d9f7-ckzlq\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:16.719113 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.719076    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74955595-2b3f-4d6b-b079-84f4ecd9f245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ckzlq\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:16.719293 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.719137    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zpp\" (UniqueName: \"kubernetes.io/projected/74955595-2b3f-4d6b-b079-84f4ecd9f245-kube-api-access-d2zpp\") pod \"kuadrant-operator-controller-manager-55467d9f7-ckzlq\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:16.719561 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.719538    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74955595-2b3f-4d6b-b079-84f4ecd9f245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ckzlq\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:16.753654 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.753587    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zpp\" (UniqueName: \"kubernetes.io/projected/74955595-2b3f-4d6b-b079-84f4ecd9f245-kube-api-access-d2zpp\") pod \"kuadrant-operator-controller-manager-55467d9f7-ckzlq\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:16.813494 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:16.813456    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:27.860926 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:27.860899    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"]
Jul 29 12:33:27.862106 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:33:27.862075    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74955595_2b3f_4d6b_b079_84f4ecd9f245.slice/crio-66bf192d3ca71bc39d1463a06389fa4c01afa7a40dd32fa26fac701a4747f100 WatchSource:0}: Error finding container 66bf192d3ca71bc39d1463a06389fa4c01afa7a40dd32fa26fac701a4747f100: Status 404 returned error can't find the container with id 66bf192d3ca71bc39d1463a06389fa4c01afa7a40dd32fa26fac701a4747f100
Jul 29 12:33:28.809470 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:28.809418    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq" event={"ID":"74955595-2b3f-4d6b-b079-84f4ecd9f245","Type":"ContainerStarted","Data":"66bf192d3ca71bc39d1463a06389fa4c01afa7a40dd32fa26fac701a4747f100"}
Jul 29 12:33:28.811024 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:28.810993    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd" event={"ID":"9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab","Type":"ContainerStarted","Data":"9d7794aced5765ff6cad3e88472c18562198edc50ecd7019a87e00e2fb78de60"}
Jul 29 12:33:28.835809 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:28.835758    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fn2cd" podStartSLOduration=2.476330824 podStartE2EDuration="23.83574065s" totalImagesPullingTime="21.359409826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:33:28.835253971 +0000 UTC m=+485.655304749" watchObservedRunningTime="2026-07-29 12:33:28.83574065 +0000 UTC m=+485.655791427"
Jul 29 12:33:32.834188 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:32.834151    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq" event={"ID":"74955595-2b3f-4d6b-b079-84f4ecd9f245","Type":"ContainerStarted","Data":"ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266"}
Jul 29 12:33:32.834680 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:32.834280    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:32.861209 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:32.861110    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq" podStartSLOduration=12.121304294 podStartE2EDuration="16.861092621s" totalImagesPullingTime="4.739788327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:33:32.858406358 +0000 UTC m=+489.678457134" watchObservedRunningTime="2026-07-29 12:33:32.861092621 +0000 UTC m=+489.681143399"
Jul 29 12:33:37.490676 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:37.490637    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75c9f9d5c7-sdkw2"]
Jul 29 12:33:43.841166 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:43.841132    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:56.623211 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:56.623181    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"]
Jul 29 12:33:56.623623 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:56.623406    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq" podUID="74955595-2b3f-4d6b-b079-84f4ecd9f245" containerName="manager" containerID="cri-o://ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266" gracePeriod=10
Jul 29 12:33:57.377846 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.377818    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:57.476945 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.476915    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2zpp\" (UniqueName: \"kubernetes.io/projected/74955595-2b3f-4d6b-b079-84f4ecd9f245-kube-api-access-d2zpp\") pod \"74955595-2b3f-4d6b-b079-84f4ecd9f245\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") "
Jul 29 12:33:57.477091 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.476967    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74955595-2b3f-4d6b-b079-84f4ecd9f245-extensions-socket-volume\") pod \"74955595-2b3f-4d6b-b079-84f4ecd9f245\" (UID: \"74955595-2b3f-4d6b-b079-84f4ecd9f245\") "
Jul 29 12:33:57.477505 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.477472    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74955595-2b3f-4d6b-b079-84f4ecd9f245-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "74955595-2b3f-4d6b-b079-84f4ecd9f245" (UID: "74955595-2b3f-4d6b-b079-84f4ecd9f245"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 12:33:57.478994 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.478969    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74955595-2b3f-4d6b-b079-84f4ecd9f245-kube-api-access-d2zpp" (OuterVolumeSpecName: "kube-api-access-d2zpp") pod "74955595-2b3f-4d6b-b079-84f4ecd9f245" (UID: "74955595-2b3f-4d6b-b079-84f4ecd9f245"). InnerVolumeSpecName "kube-api-access-d2zpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:33:57.577585 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.577505    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2zpp\" (UniqueName: \"kubernetes.io/projected/74955595-2b3f-4d6b-b079-84f4ecd9f245-kube-api-access-d2zpp\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:33:57.577585 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.577535    2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74955595-2b3f-4d6b-b079-84f4ecd9f245-extensions-socket-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:33:57.941363 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.941270    2549 generic.go:356] "Generic (PLEG): container finished" podID="74955595-2b3f-4d6b-b079-84f4ecd9f245" containerID="ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266" exitCode=0
Jul 29 12:33:57.941363 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.941327    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"
Jul 29 12:33:57.941363 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.941344    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq" event={"ID":"74955595-2b3f-4d6b-b079-84f4ecd9f245","Type":"ContainerDied","Data":"ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266"}
Jul 29 12:33:57.941853 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.941393    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq" event={"ID":"74955595-2b3f-4d6b-b079-84f4ecd9f245","Type":"ContainerDied","Data":"66bf192d3ca71bc39d1463a06389fa4c01afa7a40dd32fa26fac701a4747f100"}
Jul 29 12:33:57.941853 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.941414    2549 scope.go:117] "RemoveContainer" containerID="ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266"
Jul 29 12:33:57.950460 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.950431    2549 scope.go:117] "RemoveContainer" containerID="ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266"
Jul 29 12:33:57.950691 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:33:57.950673    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266\": container with ID starting with ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266 not found: ID does not exist" containerID="ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266"
Jul 29 12:33:57.950758 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.950704    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266"} err="failed to get container status \"ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266\": rpc error: code = NotFound desc = could not find container \"ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266\": container with ID starting with ab386777e7388d8ca88793ca50c2b0c6fb39834007831380188c9d731bb0e266 not found: ID does not exist"
Jul 29 12:33:57.963238 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.963194    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"]
Jul 29 12:33:57.965275 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:57.965254    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ckzlq"]
Jul 29 12:33:59.696832 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:33:59.696800    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74955595-2b3f-4d6b-b079-84f4ecd9f245" path="/var/lib/kubelet/pods/74955595-2b3f-4d6b-b079-84f4ecd9f245/volumes"
Jul 29 12:34:02.511716 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.511673    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75c9f9d5c7-sdkw2" podUID="6ab28548-4515-47e7-9c3f-2bb167f1132f" containerName="console" containerID="cri-o://0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04" gracePeriod=15
Jul 29 12:34:02.752890 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.752863    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:34:02.823055 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823021    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-serving-cert\") pod \"6ab28548-4515-47e7-9c3f-2bb167f1132f\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") "
Jul 29 12:34:02.823055 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823062    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-oauth-config\") pod \"6ab28548-4515-47e7-9c3f-2bb167f1132f\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") "
Jul 29 12:34:02.823268 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823083    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-service-ca\") pod \"6ab28548-4515-47e7-9c3f-2bb167f1132f\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") "
Jul 29 12:34:02.823268 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823172    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-oauth-serving-cert\") pod \"6ab28548-4515-47e7-9c3f-2bb167f1132f\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") "
Jul 29 12:34:02.823268 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823196    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-trusted-ca-bundle\") pod \"6ab28548-4515-47e7-9c3f-2bb167f1132f\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") "
Jul 29 12:34:02.823268 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823233    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-config\") pod \"6ab28548-4515-47e7-9c3f-2bb167f1132f\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") "
Jul 29 12:34:02.823506 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823301    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs5bp\" (UniqueName: \"kubernetes.io/projected/6ab28548-4515-47e7-9c3f-2bb167f1132f-kube-api-access-bs5bp\") pod \"6ab28548-4515-47e7-9c3f-2bb167f1132f\" (UID: \"6ab28548-4515-47e7-9c3f-2bb167f1132f\") "
Jul 29 12:34:02.823630 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823600    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-service-ca" (OuterVolumeSpecName: "service-ca") pod "6ab28548-4515-47e7-9c3f-2bb167f1132f" (UID: "6ab28548-4515-47e7-9c3f-2bb167f1132f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:34:02.823630 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823613    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6ab28548-4515-47e7-9c3f-2bb167f1132f" (UID: "6ab28548-4515-47e7-9c3f-2bb167f1132f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:34:02.823766 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823682    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6ab28548-4515-47e7-9c3f-2bb167f1132f" (UID: "6ab28548-4515-47e7-9c3f-2bb167f1132f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:34:02.823766 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.823717    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-config" (OuterVolumeSpecName: "console-config") pod "6ab28548-4515-47e7-9c3f-2bb167f1132f" (UID: "6ab28548-4515-47e7-9c3f-2bb167f1132f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 12:34:02.825296 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.825273    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6ab28548-4515-47e7-9c3f-2bb167f1132f" (UID: "6ab28548-4515-47e7-9c3f-2bb167f1132f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 12:34:02.825296 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.825290    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6ab28548-4515-47e7-9c3f-2bb167f1132f" (UID: "6ab28548-4515-47e7-9c3f-2bb167f1132f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 12:34:02.825532 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.825515    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab28548-4515-47e7-9c3f-2bb167f1132f-kube-api-access-bs5bp" (OuterVolumeSpecName: "kube-api-access-bs5bp") pod "6ab28548-4515-47e7-9c3f-2bb167f1132f" (UID: "6ab28548-4515-47e7-9c3f-2bb167f1132f"). InnerVolumeSpecName "kube-api-access-bs5bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:34:02.924281 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.924239    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs5bp\" (UniqueName: \"kubernetes.io/projected/6ab28548-4515-47e7-9c3f-2bb167f1132f-kube-api-access-bs5bp\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:02.924281 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.924272    2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-serving-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:02.924281 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.924283    2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-oauth-config\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:02.924281 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.924292    2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-service-ca\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:02.924559 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.924301    2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-oauth-serving-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:02.924559 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.924338    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-trusted-ca-bundle\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:02.924559 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.924350    2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab28548-4515-47e7-9c3f-2bb167f1132f-console-config\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:02.965849 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.965817    2549 generic.go:356] "Generic (PLEG): container finished" podID="6ab28548-4515-47e7-9c3f-2bb167f1132f" containerID="0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04" exitCode=0
Jul 29 12:34:02.966012 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.965854    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c9f9d5c7-sdkw2" event={"ID":"6ab28548-4515-47e7-9c3f-2bb167f1132f","Type":"ContainerDied","Data":"0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04"}
Jul 29 12:34:02.966012 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.965868    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c9f9d5c7-sdkw2"
Jul 29 12:34:02.966012 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.965889    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c9f9d5c7-sdkw2" event={"ID":"6ab28548-4515-47e7-9c3f-2bb167f1132f","Type":"ContainerDied","Data":"5806d451a97a534dbc16a8bf9a21845293974f88601d86daa7a05af933423e88"}
Jul 29 12:34:02.966012 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.965909    2549 scope.go:117] "RemoveContainer" containerID="0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04"
Jul 29 12:34:02.974516 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.974499    2549 scope.go:117] "RemoveContainer" containerID="0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04"
Jul 29 12:34:02.974768 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:34:02.974749    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04\": container with ID starting with 0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04 not found: ID does not exist" containerID="0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04"
Jul 29 12:34:02.974813 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.974777    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04"} err="failed to get container status \"0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04\": rpc error: code = NotFound desc = could not find container \"0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04\": container with ID starting with 0f274e7aabc713cc09d49e13de9de86db718149f92ebd70c4cfca8805911bd04 not found: ID does not exist"
Jul 29 12:34:02.991624 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.991594    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75c9f9d5c7-sdkw2"]
Jul 29 12:34:02.995888 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:02.995869    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75c9f9d5c7-sdkw2"]
Jul 29 12:34:03.696407 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:03.696372    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab28548-4515-47e7-9c3f-2bb167f1132f" path="/var/lib/kubelet/pods/6ab28548-4515-47e7-9c3f-2bb167f1132f/volumes"
Jul 29 12:34:04.742423 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.742391    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:34:04.742777 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.742689    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74955595-2b3f-4d6b-b079-84f4ecd9f245" containerName="manager"
Jul 29 12:34:04.742777 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.742701    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="74955595-2b3f-4d6b-b079-84f4ecd9f245" containerName="manager"
Jul 29 12:34:04.742777 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.742715    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab28548-4515-47e7-9c3f-2bb167f1132f" containerName="console"
Jul 29 12:34:04.742777 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.742720    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab28548-4515-47e7-9c3f-2bb167f1132f" containerName="console"
Jul 29 12:34:04.742777 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.742769    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab28548-4515-47e7-9c3f-2bb167f1132f" containerName="console"
Jul 29 12:34:04.742777 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.742777    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="74955595-2b3f-4d6b-b079-84f4ecd9f245" containerName="manager"
Jul 29 12:34:04.745574 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.745558    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:04.751344 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.751301    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 12:34:04.768479 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.768455    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:34:04.825739 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.825713    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:34:04.838591 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.838564    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ngtv\" (UniqueName: \"kubernetes.io/projected/6c1ac2f3-7da3-463c-b839-e81246a017fa-kube-api-access-5ngtv\") pod \"limitador-limitador-54d6d988d5-sbzpl\" (UID: \"6c1ac2f3-7da3-463c-b839-e81246a017fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:04.838708 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.838690    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c1ac2f3-7da3-463c-b839-e81246a017fa-config-file\") pod \"limitador-limitador-54d6d988d5-sbzpl\" (UID: \"6c1ac2f3-7da3-463c-b839-e81246a017fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:04.939064 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.939037    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngtv\" (UniqueName: \"kubernetes.io/projected/6c1ac2f3-7da3-463c-b839-e81246a017fa-kube-api-access-5ngtv\") pod \"limitador-limitador-54d6d988d5-sbzpl\" (UID: \"6c1ac2f3-7da3-463c-b839-e81246a017fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:04.939154 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.939084    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c1ac2f3-7da3-463c-b839-e81246a017fa-config-file\") pod \"limitador-limitador-54d6d988d5-sbzpl\" (UID: \"6c1ac2f3-7da3-463c-b839-e81246a017fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:04.939671 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.939652    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c1ac2f3-7da3-463c-b839-e81246a017fa-config-file\") pod \"limitador-limitador-54d6d988d5-sbzpl\" (UID: \"6c1ac2f3-7da3-463c-b839-e81246a017fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:04.948852 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:04.948831    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ngtv\" (UniqueName: \"kubernetes.io/projected/6c1ac2f3-7da3-463c-b839-e81246a017fa-kube-api-access-5ngtv\") pod \"limitador-limitador-54d6d988d5-sbzpl\" (UID: \"6c1ac2f3-7da3-463c-b839-e81246a017fa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:05.055618 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.055592    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:05.183686 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.183655    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8wdrb"]
Jul 29 12:34:05.186599 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.186578    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wdrb"
Jul 29 12:34:05.190782 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.190766    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h26lj\""
Jul 29 12:34:05.198639 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.198619    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:34:05.201980 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:34:05.201954    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1ac2f3_7da3_463c_b839_e81246a017fa.slice/crio-cc7f1ba9d87066392079f6802c6320f2b9d2cb1e8886592923ecccd63b39c144 WatchSource:0}: Error finding container cc7f1ba9d87066392079f6802c6320f2b9d2cb1e8886592923ecccd63b39c144: Status 404 returned error can't find the container with id cc7f1ba9d87066392079f6802c6320f2b9d2cb1e8886592923ecccd63b39c144
Jul 29 12:34:05.204101 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.204084    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wdrb"]
Jul 29 12:34:05.342754 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.342683    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzf58\" (UniqueName: \"kubernetes.io/projected/34ac62fc-f11a-4cef-a971-fcfc9e177a29-kube-api-access-xzf58\") pod \"authorino-58cd955675-8wdrb\" (UID: \"34ac62fc-f11a-4cef-a971-fcfc9e177a29\") " pod="kuadrant-system/authorino-58cd955675-8wdrb"
Jul 29 12:34:05.443413 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.443388    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzf58\" (UniqueName: \"kubernetes.io/projected/34ac62fc-f11a-4cef-a971-fcfc9e177a29-kube-api-access-xzf58\") pod \"authorino-58cd955675-8wdrb\" (UID: \"34ac62fc-f11a-4cef-a971-fcfc9e177a29\") " pod="kuadrant-system/authorino-58cd955675-8wdrb"
Jul 29 12:34:05.457620 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.457591    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzf58\" (UniqueName: \"kubernetes.io/projected/34ac62fc-f11a-4cef-a971-fcfc9e177a29-kube-api-access-xzf58\") pod \"authorino-58cd955675-8wdrb\" (UID: \"34ac62fc-f11a-4cef-a971-fcfc9e177a29\") " pod="kuadrant-system/authorino-58cd955675-8wdrb"
Jul 29 12:34:05.495883 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.495860    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wdrb"
Jul 29 12:34:05.653403 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.652067    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wdrb"]
Jul 29 12:34:05.982065 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.981981    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl" event={"ID":"6c1ac2f3-7da3-463c-b839-e81246a017fa","Type":"ContainerStarted","Data":"cc7f1ba9d87066392079f6802c6320f2b9d2cb1e8886592923ecccd63b39c144"}
Jul 29 12:34:05.983381 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:05.983353    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wdrb" event={"ID":"34ac62fc-f11a-4cef-a971-fcfc9e177a29","Type":"ContainerStarted","Data":"64d04f75f4ea8ab2316410533c2ded2c6d7e98bb91d999e2365ec48beb0821b4"}
Jul 29 12:34:09.722091 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:09.722018    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wdrb"]
Jul 29 12:34:10.006714 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:10.006616    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl" event={"ID":"6c1ac2f3-7da3-463c-b839-e81246a017fa","Type":"ContainerStarted","Data":"cfcac15caee46f03286dbe3b5de87dfaf7be00d067ba894d6061e1df215f26f0"}
Jul 29 12:34:10.006876 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:10.006784    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:10.008083 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:10.008056    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wdrb" event={"ID":"34ac62fc-f11a-4cef-a971-fcfc9e177a29","Type":"ContainerStarted","Data":"d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a"}
Jul 29 12:34:10.027451 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:10.027408    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl" podStartSLOduration=1.837045903 podStartE2EDuration="6.027394361s" totalImagesPullingTime="4.190348458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:34:10.025888654 +0000 UTC m=+526.845939430" watchObservedRunningTime="2026-07-29 12:34:10.027394361 +0000 UTC m=+526.847445138"
Jul 29 12:34:10.045242 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:10.045202    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8wdrb" podStartSLOduration=1.296709498 podStartE2EDuration="5.045188619s" totalImagesPullingTime="3.748479121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:34:10.044136687 +0000 UTC m=+526.864187463" watchObservedRunningTime="2026-07-29 12:34:10.045188619 +0000 UTC m=+526.865239396"
Jul 29 12:34:11.012541 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:11.012494    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8wdrb" podUID="34ac62fc-f11a-4cef-a971-fcfc9e177a29" containerName="authorino" containerID="cri-o://d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a" gracePeriod=30
Jul 29 12:34:11.258693 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:11.258668    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wdrb"
Jul 29 12:34:11.402383 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:11.402357    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzf58\" (UniqueName: \"kubernetes.io/projected/34ac62fc-f11a-4cef-a971-fcfc9e177a29-kube-api-access-xzf58\") pod \"34ac62fc-f11a-4cef-a971-fcfc9e177a29\" (UID: \"34ac62fc-f11a-4cef-a971-fcfc9e177a29\") "
Jul 29 12:34:11.404258 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:11.404232    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ac62fc-f11a-4cef-a971-fcfc9e177a29-kube-api-access-xzf58" (OuterVolumeSpecName: "kube-api-access-xzf58") pod "34ac62fc-f11a-4cef-a971-fcfc9e177a29" (UID: "34ac62fc-f11a-4cef-a971-fcfc9e177a29"). InnerVolumeSpecName "kube-api-access-xzf58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:34:11.503523 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:11.503493    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzf58\" (UniqueName: \"kubernetes.io/projected/34ac62fc-f11a-4cef-a971-fcfc9e177a29-kube-api-access-xzf58\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:12.023748 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.023715    2549 generic.go:356] "Generic (PLEG): container finished" podID="34ac62fc-f11a-4cef-a971-fcfc9e177a29" containerID="d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a" exitCode=0
Jul 29 12:34:12.024170 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.023770    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wdrb"
Jul 29 12:34:12.024170 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.023774    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wdrb" event={"ID":"34ac62fc-f11a-4cef-a971-fcfc9e177a29","Type":"ContainerDied","Data":"d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a"}
Jul 29 12:34:12.024170 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.023822    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wdrb" event={"ID":"34ac62fc-f11a-4cef-a971-fcfc9e177a29","Type":"ContainerDied","Data":"64d04f75f4ea8ab2316410533c2ded2c6d7e98bb91d999e2365ec48beb0821b4"}
Jul 29 12:34:12.024170 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.023843    2549 scope.go:117] "RemoveContainer" containerID="d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a"
Jul 29 12:34:12.032074 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.032053    2549 scope.go:117] "RemoveContainer" containerID="d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a"
Jul 29 12:34:12.032351 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:34:12.032326    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a\": container with ID starting with d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a not found: ID does not exist" containerID="d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a"
Jul 29 12:34:12.032453 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.032361    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a"} err="failed to get container status \"d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a\": rpc error: code = NotFound desc = could not find container \"d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a\": container with ID starting with d8136c892ccd74cfbeb161674cc5b51be068b0a9e255749d2136eabddd6a5d5a not found: ID does not exist"
Jul 29 12:34:12.041453 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.041431    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wdrb"]
Jul 29 12:34:12.046364 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:12.046196    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wdrb"]
Jul 29 12:34:13.696430 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:13.696402    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ac62fc-f11a-4cef-a971-fcfc9e177a29" path="/var/lib/kubelet/pods/34ac62fc-f11a-4cef-a971-fcfc9e177a29/volumes"
Jul 29 12:34:21.013994 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:21.013908    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"
Jul 29 12:34:37.359130 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.359088    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h9rh"]
Jul 29 12:34:37.359729 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.359601    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ac62fc-f11a-4cef-a971-fcfc9e177a29" containerName="authorino"
Jul 29 12:34:37.359729 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.359622    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ac62fc-f11a-4cef-a971-fcfc9e177a29" containerName="authorino"
Jul 29 12:34:37.359729 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.359709    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ac62fc-f11a-4cef-a971-fcfc9e177a29" containerName="authorino"
Jul 29 12:34:37.364114 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.364095    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h9rh"
Jul 29 12:34:37.366645 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.366628    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h26lj\""
Jul 29 12:34:37.370494 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.370465    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h9rh"]
Jul 29 12:34:37.410013 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.409982    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt55n\" (UniqueName: \"kubernetes.io/projected/361a57f9-4fa6-4951-94ec-27bd1c44d974-kube-api-access-kt55n\") pod \"authorino-5d4b67c446-8h9rh\" (UID: \"361a57f9-4fa6-4951-94ec-27bd1c44d974\") " pod="kuadrant-system/authorino-5d4b67c446-8h9rh"
Jul 29 12:34:37.511403 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.511364    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt55n\" (UniqueName: \"kubernetes.io/projected/361a57f9-4fa6-4951-94ec-27bd1c44d974-kube-api-access-kt55n\") pod \"authorino-5d4b67c446-8h9rh\" (UID: \"361a57f9-4fa6-4951-94ec-27bd1c44d974\") " pod="kuadrant-system/authorino-5d4b67c446-8h9rh"
Jul 29 12:34:37.520358 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.520330    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt55n\" (UniqueName: \"kubernetes.io/projected/361a57f9-4fa6-4951-94ec-27bd1c44d974-kube-api-access-kt55n\") pod \"authorino-5d4b67c446-8h9rh\" (UID: \"361a57f9-4fa6-4951-94ec-27bd1c44d974\") " pod="kuadrant-system/authorino-5d4b67c446-8h9rh"
Jul 29 12:34:37.608481 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.608446    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h9rh"]
Jul 29 12:34:37.608738 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.608722    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h9rh"
Jul 29 12:34:37.632837 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.632812    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-845fd4b879-lsxgr"]
Jul 29 12:34:37.636994 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.636974    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845fd4b879-lsxgr"
Jul 29 12:34:37.647302 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.647279    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845fd4b879-lsxgr"]
Jul 29 12:34:37.714023 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.713991    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2h4f\" (UniqueName: \"kubernetes.io/projected/0b8854bc-3cd4-4665-bb8a-aad23f8f00b0-kube-api-access-c2h4f\") pod \"authorino-845fd4b879-lsxgr\" (UID: \"0b8854bc-3cd4-4665-bb8a-aad23f8f00b0\") " pod="kuadrant-system/authorino-845fd4b879-lsxgr"
Jul 29 12:34:37.724371 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.724347    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-845fd4b879-lsxgr"]
Jul 29 12:34:37.724584 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:34:37.724568    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-c2h4f], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-845fd4b879-lsxgr" podUID="0b8854bc-3cd4-4665-bb8a-aad23f8f00b0"
Jul 29 12:34:37.748715 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.748660    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h9rh"]
Jul 29 12:34:37.751074 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:34:37.751047    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod361a57f9_4fa6_4951_94ec_27bd1c44d974.slice/crio-266364338cd3ee0fea8f8e6171348a8e664d0c6d9fa73daf00f546b06678f047 WatchSource:0}: Error finding container 266364338cd3ee0fea8f8e6171348a8e664d0c6d9fa73daf00f546b06678f047: Status 404 returned error can't find the container with id 266364338cd3ee0fea8f8e6171348a8e664d0c6d9fa73daf00f546b06678f047
Jul 29 12:34:37.815061 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.815036    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2h4f\" (UniqueName: \"kubernetes.io/projected/0b8854bc-3cd4-4665-bb8a-aad23f8f00b0-kube-api-access-c2h4f\") pod \"authorino-845fd4b879-lsxgr\" (UID: \"0b8854bc-3cd4-4665-bb8a-aad23f8f00b0\") " pod="kuadrant-system/authorino-845fd4b879-lsxgr"
Jul 29 12:34:37.823930 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:37.823906    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2h4f\" (UniqueName: \"kubernetes.io/projected/0b8854bc-3cd4-4665-bb8a-aad23f8f00b0-kube-api-access-c2h4f\") pod \"authorino-845fd4b879-lsxgr\" (UID: \"0b8854bc-3cd4-4665-bb8a-aad23f8f00b0\") " pod="kuadrant-system/authorino-845fd4b879-lsxgr"
Jul 29 12:34:38.135225 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:38.135194    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h9rh" event={"ID":"361a57f9-4fa6-4951-94ec-27bd1c44d974","Type":"ContainerStarted","Data":"266364338cd3ee0fea8f8e6171348a8e664d0c6d9fa73daf00f546b06678f047"}
Jul 29 12:34:38.135225 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:38.135209    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845fd4b879-lsxgr"
Jul 29 12:34:38.142164 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:38.142144    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845fd4b879-lsxgr"
Jul 29 12:34:38.218545 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:38.218516    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2h4f\" (UniqueName: \"kubernetes.io/projected/0b8854bc-3cd4-4665-bb8a-aad23f8f00b0-kube-api-access-c2h4f\") pod \"0b8854bc-3cd4-4665-bb8a-aad23f8f00b0\" (UID: \"0b8854bc-3cd4-4665-bb8a-aad23f8f00b0\") "
Jul 29 12:34:38.220399 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:38.220376    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8854bc-3cd4-4665-bb8a-aad23f8f00b0-kube-api-access-c2h4f" (OuterVolumeSpecName: "kube-api-access-c2h4f") pod "0b8854bc-3cd4-4665-bb8a-aad23f8f00b0" (UID: "0b8854bc-3cd4-4665-bb8a-aad23f8f00b0"). InnerVolumeSpecName "kube-api-access-c2h4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:34:38.319843 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:38.319810    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2h4f\" (UniqueName: \"kubernetes.io/projected/0b8854bc-3cd4-4665-bb8a-aad23f8f00b0-kube-api-access-c2h4f\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:39.141385 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.141355    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h9rh" event={"ID":"361a57f9-4fa6-4951-94ec-27bd1c44d974","Type":"ContainerStarted","Data":"55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94"}
Jul 29 12:34:39.141385 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.141371    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845fd4b879-lsxgr"
Jul 29 12:34:39.141818 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.141430    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8h9rh" podUID="361a57f9-4fa6-4951-94ec-27bd1c44d974" containerName="authorino" containerID="cri-o://55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94" gracePeriod=30
Jul 29 12:34:39.159135 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.159092    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8h9rh" podStartSLOduration=1.715402808 podStartE2EDuration="2.159076611s" totalImagesPullingTime="443.673803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:34:39.157535611 +0000 UTC m=+555.977586388" watchObservedRunningTime="2026-07-29 12:34:39.159076611 +0000 UTC m=+555.979127388"
Jul 29 12:34:39.186263 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.186240    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-845fd4b879-lsxgr"]
Jul 29 12:34:39.188443 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.188422    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-845fd4b879-lsxgr"]
Jul 29 12:34:39.416967 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.416906    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h9rh"
Jul 29 12:34:39.530394 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.530363    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt55n\" (UniqueName: \"kubernetes.io/projected/361a57f9-4fa6-4951-94ec-27bd1c44d974-kube-api-access-kt55n\") pod \"361a57f9-4fa6-4951-94ec-27bd1c44d974\" (UID: \"361a57f9-4fa6-4951-94ec-27bd1c44d974\") "
Jul 29 12:34:39.532358 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.532327    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361a57f9-4fa6-4951-94ec-27bd1c44d974-kube-api-access-kt55n" (OuterVolumeSpecName: "kube-api-access-kt55n") pod "361a57f9-4fa6-4951-94ec-27bd1c44d974" (UID: "361a57f9-4fa6-4951-94ec-27bd1c44d974"). InnerVolumeSpecName "kube-api-access-kt55n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:34:39.630891 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.630865    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt55n\" (UniqueName: \"kubernetes.io/projected/361a57f9-4fa6-4951-94ec-27bd1c44d974-kube-api-access-kt55n\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:34:39.697099 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:39.697031    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b8854bc-3cd4-4665-bb8a-aad23f8f00b0" path="/var/lib/kubelet/pods/0b8854bc-3cd4-4665-bb8a-aad23f8f00b0/volumes"
Jul 29 12:34:40.146549 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.146516    2549 generic.go:356] "Generic (PLEG): container finished" podID="361a57f9-4fa6-4951-94ec-27bd1c44d974" containerID="55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94" exitCode=0
Jul 29 12:34:40.146949 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.146558    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h9rh" event={"ID":"361a57f9-4fa6-4951-94ec-27bd1c44d974","Type":"ContainerDied","Data":"55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94"}
Jul 29 12:34:40.146949 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.146561    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h9rh"
Jul 29 12:34:40.146949 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.146596    2549 scope.go:117] "RemoveContainer" containerID="55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94"
Jul 29 12:34:40.146949 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.146585    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h9rh" event={"ID":"361a57f9-4fa6-4951-94ec-27bd1c44d974","Type":"ContainerDied","Data":"266364338cd3ee0fea8f8e6171348a8e664d0c6d9fa73daf00f546b06678f047"}
Jul 29 12:34:40.155051 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.154970    2549 scope.go:117] "RemoveContainer" containerID="55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94"
Jul 29 12:34:40.155362 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:34:40.155337    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94\": container with ID starting with 55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94 not found: ID does not exist" containerID="55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94"
Jul 29 12:34:40.155448 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.155367    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94"} err="failed to get container status \"55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94\": rpc error: code = NotFound desc = could not find container \"55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94\": container with ID starting with 55067c9d325a519ed988504c9ce4a59f667ee1741faedc0a49efa380cffa3b94 not found: ID does not exist"
Jul 29 12:34:40.171428 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.171396    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h9rh"]
Jul 29 12:34:40.176072 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:40.176050    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h9rh"]
Jul 29 12:34:41.696195 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:34:41.696152    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361a57f9-4fa6-4951-94ec-27bd1c44d974" path="/var/lib/kubelet/pods/361a57f9-4fa6-4951-94ec-27bd1c44d974/volumes"
Jul 29 12:35:21.054652 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:35:21.054618    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:35:23.599057 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:35:23.599026    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:35:23.602100 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:35:23.602072    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:35:23.602980 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:35:23.602962    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:35:23.606185 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:35:23.606166    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:35:38.693132 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:35:38.693094    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:35:51.633624 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:35:51.633533    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:36:04.343557 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:04.343518    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:36:07.364669 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.364638    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"]
Jul 29 12:36:07.365051 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.364959    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361a57f9-4fa6-4951-94ec-27bd1c44d974" containerName="authorino"
Jul 29 12:36:07.365051 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.364970    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="361a57f9-4fa6-4951-94ec-27bd1c44d974" containerName="authorino"
Jul 29 12:36:07.365051 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.365026    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="361a57f9-4fa6-4951-94ec-27bd1c44d974" containerName="authorino"
Jul 29 12:36:07.367869 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.367852    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.372588 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.372562    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 29 12:36:07.372588 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.372568    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mh475\""
Jul 29 12:36:07.372748 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.372569    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 12:36:07.372748 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.372572    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 12:36:07.386876 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.386852    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"]
Jul 29 12:36:07.468410 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.468376    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ghp\" (UniqueName: \"kubernetes.io/projected/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-kube-api-access-98ghp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.468560 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.468418    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.468560 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.468472    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.468560 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.468529    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.468560 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.468557    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.468708 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.468573    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569043 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569009    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569221 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569057    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569221 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569170    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569221 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569212    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ghp\" (UniqueName: \"kubernetes.io/projected/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-kube-api-access-98ghp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569423 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569243    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569423 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569277    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569543 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569524    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569617 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569601    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.569722 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.569703    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.571422 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.571399    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.571662 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.571645    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.579058 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.579037    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ghp\" (UniqueName: \"kubernetes.io/projected/28cf3f41-2e56-4f16-997e-b0c4e7c6b244-kube-api-access-98ghp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664\" (UID: \"28cf3f41-2e56-4f16-997e-b0c4e7c6b244\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.677895 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.677824    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:07.819797 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.819771    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"]
Jul 29 12:36:07.822338 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:36:07.822297    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cf3f41_2e56_4f16_997e_b0c4e7c6b244.slice/crio-e25f7e17ec62d696a517fc89d9559b37e03161b3755ca4e18fc97fe4991ff881 WatchSource:0}: Error finding container e25f7e17ec62d696a517fc89d9559b37e03161b3755ca4e18fc97fe4991ff881: Status 404 returned error can't find the container with id e25f7e17ec62d696a517fc89d9559b37e03161b3755ca4e18fc97fe4991ff881
Jul 29 12:36:07.823599 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:07.823579    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 12:36:08.521273 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:08.521237    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664" event={"ID":"28cf3f41-2e56-4f16-997e-b0c4e7c6b244","Type":"ContainerStarted","Data":"e25f7e17ec62d696a517fc89d9559b37e03161b3755ca4e18fc97fe4991ff881"}
Jul 29 12:36:08.835662 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:08.835576    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:36:09.526768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:09.526738    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664" event={"ID":"28cf3f41-2e56-4f16-997e-b0c4e7c6b244","Type":"ContainerStarted","Data":"ec2a42242df4e600559a492c4eb8e735ebce4d07d86504cc43c5d10d5dd17256"}
Jul 29 12:36:09.563135 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:09.563078    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664" podStartSLOduration=1.5156040819999999 podStartE2EDuration="2.563059892s" totalImagesPullingTime="1.04745581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:36:09.562561947 +0000 UTC m=+646.382612736" watchObservedRunningTime="2026-07-29 12:36:09.563059892 +0000 UTC m=+646.383110672"
Jul 29 12:36:17.678724 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:17.678684    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:17.679155 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:17.678746    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:17.696319 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:17.696285    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:18.576303 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:18.576273    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664"
Jul 29 12:36:19.232651 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:19.232618    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:36:20.476381 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.476348    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"]
Jul 29 12:36:20.480004 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.479978    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.484048 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.484023    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 12:36:20.492726 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.492704    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"]
Jul 29 12:36:20.581144 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.581109    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.581144 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.581147    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.581406 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.581186    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.581406 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.581254    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.581406 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.581337    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g54t7\" (UniqueName: \"kubernetes.io/projected/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-kube-api-access-g54t7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.581406 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.581384    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.682492 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682455    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.682492 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682495    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.682743 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682527    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.682743 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682555    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.682743 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682597    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g54t7\" (UniqueName: \"kubernetes.io/projected/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-kube-api-access-g54t7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.682743 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682638    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.682943 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682908    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.683007 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.682990    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.683046 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.683016    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.684851 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.684828    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.685047 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.685032    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.697104 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.697081    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g54t7\" (UniqueName: \"kubernetes.io/projected/bff98e58-7e03-40d5-b09c-7ca3a5ced1e5-kube-api-access-g54t7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl\" (UID: \"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.789264 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.789235    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:20.927183 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:20.927150    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"]
Jul 29 12:36:20.930255 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:36:20.930218    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbff98e58_7e03_40d5_b09c_7ca3a5ced1e5.slice/crio-85cd3a9b3eca8f11423df16f09af8ba9cc0d1821bdf739658ae72ef25bfbe218 WatchSource:0}: Error finding container 85cd3a9b3eca8f11423df16f09af8ba9cc0d1821bdf739658ae72ef25bfbe218: Status 404 returned error can't find the container with id 85cd3a9b3eca8f11423df16f09af8ba9cc0d1821bdf739658ae72ef25bfbe218
Jul 29 12:36:21.578641 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:21.578607    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl" event={"ID":"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5","Type":"ContainerStarted","Data":"ffc1629de796ed5c8f03b6eb6c5e0a9902a5531a3d17d362a78675e1109e7e49"}
Jul 29 12:36:21.578641 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:21.578645    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl" event={"ID":"bff98e58-7e03-40d5-b09c-7ca3a5ced1e5","Type":"ContainerStarted","Data":"85cd3a9b3eca8f11423df16f09af8ba9cc0d1821bdf739658ae72ef25bfbe218"}
Jul 29 12:36:21.600356 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:21.600285    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl" podStartSLOduration=1.356776686 podStartE2EDuration="1.600265576s" totalImagesPullingTime="243.48889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:36:21.600035632 +0000 UTC m=+658.420086409" watchObservedRunningTime="2026-07-29 12:36:21.600265576 +0000 UTC m=+658.420316354"
Jul 29 12:36:30.036629 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:30.036597    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:36:30.789406 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:30.789369    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:30.789598 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:30.789447    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:30.801945 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:30.801918    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:36:31.635942 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:36:31.635911    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl"
Jul 29 12:37:11.596288 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.596250    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79c5f5f6f8-z4cgf"]
Jul 29 12:37:11.599850 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.599829    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:11.604465 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.604443    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h26lj\""
Jul 29 12:37:11.605027 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.605002    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 12:37:11.613891 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.613870    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79c5f5f6f8-z4cgf"]
Jul 29 12:37:11.738862 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.738825    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtmrq\" (UniqueName: \"kubernetes.io/projected/9e62e253-19b6-4fb9-bb1d-49ca9d1cd114-kube-api-access-qtmrq\") pod \"authorino-79c5f5f6f8-z4cgf\" (UID: \"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114\") " pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:11.738862 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.738870    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e62e253-19b6-4fb9-bb1d-49ca9d1cd114-tls-cert\") pod \"authorino-79c5f5f6f8-z4cgf\" (UID: \"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114\") " pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:11.840262 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.840229    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtmrq\" (UniqueName: \"kubernetes.io/projected/9e62e253-19b6-4fb9-bb1d-49ca9d1cd114-kube-api-access-qtmrq\") pod \"authorino-79c5f5f6f8-z4cgf\" (UID: \"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114\") " pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:11.840262 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.840267    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e62e253-19b6-4fb9-bb1d-49ca9d1cd114-tls-cert\") pod \"authorino-79c5f5f6f8-z4cgf\" (UID: \"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114\") " pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:11.842748 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.842728    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e62e253-19b6-4fb9-bb1d-49ca9d1cd114-tls-cert\") pod \"authorino-79c5f5f6f8-z4cgf\" (UID: \"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114\") " pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:11.855116 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.855048    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtmrq\" (UniqueName: \"kubernetes.io/projected/9e62e253-19b6-4fb9-bb1d-49ca9d1cd114-kube-api-access-qtmrq\") pod \"authorino-79c5f5f6f8-z4cgf\" (UID: \"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114\") " pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:11.910571 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:11.910540    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf"
Jul 29 12:37:12.059510 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:12.059484    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79c5f5f6f8-z4cgf"]
Jul 29 12:37:12.062060 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:37:12.062030    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e62e253_19b6_4fb9_bb1d_49ca9d1cd114.slice/crio-0c15e6c390749ce667f1340b607ce39c3f809edb6b037e3291a8b7d9b53caddd WatchSource:0}: Error finding container 0c15e6c390749ce667f1340b607ce39c3f809edb6b037e3291a8b7d9b53caddd: Status 404 returned error can't find the container with id 0c15e6c390749ce667f1340b607ce39c3f809edb6b037e3291a8b7d9b53caddd
Jul 29 12:37:12.816229 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:12.816184    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf" event={"ID":"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114","Type":"ContainerStarted","Data":"4a9bcf4c33699de088f071562766038abf7ce27a729933601d3eb51198fe9d3f"}
Jul 29 12:37:12.816704 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:12.816241    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf" event={"ID":"9e62e253-19b6-4fb9-bb1d-49ca9d1cd114","Type":"ContainerStarted","Data":"0c15e6c390749ce667f1340b607ce39c3f809edb6b037e3291a8b7d9b53caddd"}
Jul 29 12:37:12.847695 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:12.847632    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79c5f5f6f8-z4cgf" podStartSLOduration=1.432164754 podStartE2EDuration="1.847610926s" totalImagesPullingTime="415.446172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:37:12.844778309 +0000 UTC m=+709.664829083" watchObservedRunningTime="2026-07-29 12:37:12.847610926 +0000 UTC m=+709.667661705"
Jul 29 12:37:42.333725 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:42.333687    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:37:52.126172 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:37:52.126134    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:38:01.963047 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:38:01.963008    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:39:48.351361 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:39:48.351325    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:40:02.234789 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:40:02.234753    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:40:23.626356 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:40:23.626326    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:40:23.628626 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:40:23.628602    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:40:23.629259 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:40:23.629242    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:40:23.631273 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:40:23.631253    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:41:00.145831 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:41:00.145795    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:41:09.929720 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:41:09.929687    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:41:36.331694 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:41:36.331661    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:41:45.336406 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:41:45.336326    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:41:55.538479 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:41:55.538442    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:42:06.936608 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:42:06.936563    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:42:18.054016 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:42:18.053983    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:42:25.834203 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:42:25.834166    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:42:33.729958 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:42:33.729924    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:42:41.439581 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:42:41.439540    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:42:53.533484 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:42:53.533449    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:43:04.842756 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:43:04.842721    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:43:28.955902 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:43:28.955867    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:43:41.336127 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:43:41.336086    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:43:55.645071 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:43:55.645039    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:44:16.732062 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:44:16.732028    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:44:31.548223 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:44:31.548185    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:44:40.447168 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:44:40.447124    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:44:50.134604 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:44:50.134517    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:44:59.030698 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:44:59.030661    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:45:08.149672 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:08.149634    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:45:21.129382 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:21.129344    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:45:23.654749 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:23.654717    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:45:23.655962 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:23.655940    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:45:23.657618 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:23.657588    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:45:23.658764 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:23.658742    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:45:29.433909 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:29.433873    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:45:37.335111 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:45:37.335075    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:47:51.932758 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:47:51.932683    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:47:59.138645 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:47:59.138610    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:48:22.928971 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:48:22.928938    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:49:02.832198 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:49:02.832158    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:49:11.244282 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:49:11.244246    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:49:20.824772 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:49:20.824694    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:49:29.430611 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:49:29.430576    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:49:37.526402 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:49:37.526365    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:49:47.523025 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:49:47.522984    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:49:55.625659 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:49:55.625628    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:50:05.025190 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:05.025155    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:50:14.324989 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:14.324956    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:50:23.680386 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:23.680353    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:50:23.682041 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:23.682015    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:50:23.683504 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:23.683487    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:50:23.684814 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:23.684797    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:50:25.126006 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:25.125970    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:50:47.320604 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:47.320521    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:50:57.220606 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:50:57.220564    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:51:08.861962 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:08.861928    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"]
Jul 29 12:51:08.864967 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:08.864947    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:08.867195 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:08.867179    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-f1d16833-kserve-self-signed-certs\""
Jul 29 12:51:08.884032 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:08.884004    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"]
Jul 29 12:51:09.000761 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.000730    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-model-cache\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.000916 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.000768    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-home\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.000916 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.000797    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-dshm\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.000916 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.000867    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tls-certs\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.000916 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.000902    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6sk\" (UniqueName: \"kubernetes.io/projected/a95b9241-8b19-4402-b8e4-cf3500a2dd82-kube-api-access-df6sk\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.001068 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.000934    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tmp-dir\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102361 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102335    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tmp-dir\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102507 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102404    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-model-cache\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102507 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102433    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-home\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102507 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102449    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-dshm\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102507 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102486    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tls-certs\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102710 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102516    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6sk\" (UniqueName: \"kubernetes.io/projected/a95b9241-8b19-4402-b8e4-cf3500a2dd82-kube-api-access-df6sk\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102768 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102747    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tmp-dir\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102826 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102784    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-model-cache\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.102879 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.102836    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-home\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.104692 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.104671    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-dshm\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.104987 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.104966    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tls-certs\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.109641 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.109618    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6sk\" (UniqueName: \"kubernetes.io/projected/a95b9241-8b19-4402-b8e4-cf3500a2dd82-kube-api-access-df6sk\") pod \"e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") " pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.174413 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.174353    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:09.303994 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.303964    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"]
Jul 29 12:51:09.306510 ip-10-0-142-162 kubenswrapper[2549]: W0729 12:51:09.306480    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda95b9241_8b19_4402_b8e4_cf3500a2dd82.slice/crio-9ff9e2c2692964e090d35d2aec082e73eb2e9d5e055ac11f551b7de102f313b1 WatchSource:0}: Error finding container 9ff9e2c2692964e090d35d2aec082e73eb2e9d5e055ac11f551b7de102f313b1: Status 404 returned error can't find the container with id 9ff9e2c2692964e090d35d2aec082e73eb2e9d5e055ac11f551b7de102f313b1
Jul 29 12:51:09.516447 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.516373    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p" event={"ID":"a95b9241-8b19-4402-b8e4-cf3500a2dd82","Type":"ContainerStarted","Data":"2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967"}
Jul 29 12:51:09.516447 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.516414    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p" event={"ID":"a95b9241-8b19-4402-b8e4-cf3500a2dd82","Type":"ContainerStarted","Data":"9ff9e2c2692964e090d35d2aec082e73eb2e9d5e055ac11f551b7de102f313b1"}
Jul 29 12:51:09.536949 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:09.536907    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p" podStartSLOduration=1.536891283 podStartE2EDuration="1.536891283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 12:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:51:09.535664572 +0000 UTC m=+1546.355715350" watchObservedRunningTime="2026-07-29 12:51:09.536891283 +0000 UTC m=+1546.356942107"
Jul 29 12:51:11.527773 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:11.527744    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:51:19.174645 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:19.174551    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:19.174645 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:19.174598    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:19.186921 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:19.186899    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:19.576441 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:19.576412    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:51:25.921889 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:25.921848    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:51:44.854049 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:44.854013    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"]
Jul 29 12:51:48.621264 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:48.621231    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:51:59.872719 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:51:59.872658    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p" podUID="a95b9241-8b19-4402-b8e4-cf3500a2dd82" containerName="main" containerID="cri-o://2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967" gracePeriod=45
Jul 29 12:52:00.113189 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.113166    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:52:00.152267 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152189    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df6sk\" (UniqueName: \"kubernetes.io/projected/a95b9241-8b19-4402-b8e4-cf3500a2dd82-kube-api-access-df6sk\") pod \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") "
Jul 29 12:52:00.152267 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152242    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-model-cache\") pod \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") "
Jul 29 12:52:00.152503 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152295    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-home\") pod \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") "
Jul 29 12:52:00.152503 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152331    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tls-certs\") pod \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") "
Jul 29 12:52:00.152503 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152387    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-dshm\") pod \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") "
Jul 29 12:52:00.152503 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152454    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tmp-dir\") pod \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\" (UID: \"a95b9241-8b19-4402-b8e4-cf3500a2dd82\") "
Jul 29 12:52:00.152689 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152556    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-home" (OuterVolumeSpecName: "home") pod "a95b9241-8b19-4402-b8e4-cf3500a2dd82" (UID: "a95b9241-8b19-4402-b8e4-cf3500a2dd82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 12:52:00.152689 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152566    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-model-cache" (OuterVolumeSpecName: "model-cache") pod "a95b9241-8b19-4402-b8e4-cf3500a2dd82" (UID: "a95b9241-8b19-4402-b8e4-cf3500a2dd82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 12:52:00.152785 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152762    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:52:00.152838 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152787    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:52:00.152838 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.152758    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a95b9241-8b19-4402-b8e4-cf3500a2dd82" (UID: "a95b9241-8b19-4402-b8e4-cf3500a2dd82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 12:52:00.154573 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.154534    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-dshm" (OuterVolumeSpecName: "dshm") pod "a95b9241-8b19-4402-b8e4-cf3500a2dd82" (UID: "a95b9241-8b19-4402-b8e4-cf3500a2dd82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 12:52:00.154685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.154574    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a95b9241-8b19-4402-b8e4-cf3500a2dd82" (UID: "a95b9241-8b19-4402-b8e4-cf3500a2dd82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 12:52:00.154685 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.154614    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95b9241-8b19-4402-b8e4-cf3500a2dd82-kube-api-access-df6sk" (OuterVolumeSpecName: "kube-api-access-df6sk") pod "a95b9241-8b19-4402-b8e4-cf3500a2dd82" (UID: "a95b9241-8b19-4402-b8e4-cf3500a2dd82"). InnerVolumeSpecName "kube-api-access-df6sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 12:52:00.253206 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.253172    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:52:00.253206 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.253198    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:52:00.253206 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.253207    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a95b9241-8b19-4402-b8e4-cf3500a2dd82-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:52:00.253435 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.253217    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df6sk\" (UniqueName: \"kubernetes.io/projected/a95b9241-8b19-4402-b8e4-cf3500a2dd82-kube-api-access-df6sk\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 12:52:00.749043 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.749009    2549 generic.go:356] "Generic (PLEG): container finished" podID="a95b9241-8b19-4402-b8e4-cf3500a2dd82" containerID="2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967" exitCode=0
Jul 29 12:52:00.749043 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.749044    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"
Jul 29 12:52:00.749330 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.749094    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p" event={"ID":"a95b9241-8b19-4402-b8e4-cf3500a2dd82","Type":"ContainerDied","Data":"2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967"}
Jul 29 12:52:00.749330 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.749136    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p" event={"ID":"a95b9241-8b19-4402-b8e4-cf3500a2dd82","Type":"ContainerDied","Data":"9ff9e2c2692964e090d35d2aec082e73eb2e9d5e055ac11f551b7de102f313b1"}
Jul 29 12:52:00.749330 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.749158    2549 scope.go:117] "RemoveContainer" containerID="2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967"
Jul 29 12:52:00.758826 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.758809    2549 scope.go:117] "RemoveContainer" containerID="2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967"
Jul 29 12:52:00.759057 ip-10-0-142-162 kubenswrapper[2549]: E0729 12:52:00.759040    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967\": container with ID starting with 2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967 not found: ID does not exist" containerID="2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967"
Jul 29 12:52:00.759106 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.759065    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967"} err="failed to get container status \"2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967\": rpc error: code = NotFound desc = could not find container \"2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967\": container with ID starting with 2341258517a0e0406e5473f774695821a6b77e7ee6d50afe4357343cf21a3967 not found: ID does not exist"
Jul 29 12:52:00.770209 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.770188    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"]
Jul 29 12:52:00.773813 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:00.773795    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-f1d16833-kserve-58d7ddb799-mb46p"]
Jul 29 12:52:01.695941 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:01.695912    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95b9241-8b19-4402-b8e4-cf3500a2dd82" path="/var/lib/kubelet/pods/a95b9241-8b19-4402-b8e4-cf3500a2dd82/volumes"
Jul 29 12:52:02.428951 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:02.428908    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:52:09.128511 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:09.128463    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:52:18.027297 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:18.027215    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:52:25.524858 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:25.524814    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:52:40.632538 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:40.627257    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:52:49.222557 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:49.222522    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:52:59.332925 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:52:59.332888    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:53:08.226661 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:53:08.226623    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:53:17.026631 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:53:17.026590    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:53:23.114943 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:53:23.114912    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:53:32.323857 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:53:32.323818    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:53:41.129203 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:53:41.129162    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:53:50.127239 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:53:50.127151    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:54:02.626988 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:54:02.626948    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:54:11.426358 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:54:11.426302    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:54:18.217634 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:54:18.217597    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:54:30.418011 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:54:30.417972    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:54:44.914546 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:54:44.914514    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:54:53.538709 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:54:53.538667    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:55:12.833558 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:12.833528    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:55:23.712892 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:23.712866    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:55:23.718488 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:23.718459    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:55:23.718896 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:23.718881    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 12:55:23.721626 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:23.721609    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 12:55:38.524703 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:38.524666    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:55:47.227966 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:47.227928    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:55:58.328210 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:55:58.328174    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:56:15.622025 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:56:15.621987    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:56:24.731413 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:56:24.731375    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:56:33.820791 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:56:33.820756    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:56:44.625890 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:56:44.625855    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:57:13.522160 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:57:13.522122    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:57:25.615274 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:57:25.615237    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:57:48.533759 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:57:48.533723    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:57:59.515947 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:57:59.515915    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:58:22.825751 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:58:22.825677    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:58:34.722474 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:58:34.722439    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:58:57.519961 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:58:57.519920    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 12:59:19.933609 ip-10-0-142-162 kubenswrapper[2549]: I0729 12:59:19.933575    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:00:23.741247 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:00:23.741208    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:00:23.743817 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:00:23.743794    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:00:23.744960 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:00:23.744939    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:00:23.748056 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:00:23.748039    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:00:51.216915 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:00:51.216869    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:02:52.225495 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:02:52.225420    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:03:07.220610 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:03:07.220572    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:03:46.843851 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:03:46.843813    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:04:23.425549 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:04:23.425469    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:05:23.766725 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:05:23.766693    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:05:23.769965 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:05:23.769939    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:05:23.775222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:05:23.775196    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:05:23.778823 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:05:23.778802    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:06:10.335265 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:10.335226    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:06:24.422938 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:24.422901    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:06:40.950345 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.950272    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"]
Jul 29 13:06:40.950814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.950653    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95b9241-8b19-4402-b8e4-cf3500a2dd82" containerName="main"
Jul 29 13:06:40.950814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.950666    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95b9241-8b19-4402-b8e4-cf3500a2dd82" containerName="main"
Jul 29 13:06:40.950814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.950723    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95b9241-8b19-4402-b8e4-cf3500a2dd82" containerName="main"
Jul 29 13:06:40.953692 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.953675    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:40.956919 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.956898    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-42b01b5c\"/\"kube-root-ca.crt\""
Jul 29 13:06:40.957037 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.956969    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-42b01b5c\"/\"e2e-lifecycle-model-42b01b5c-kserve-self-signed-certs\""
Jul 29 13:06:40.957037 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.957010    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-42b01b5c\"/\"default-dockercfg-x4frp\""
Jul 29 13:06:40.957037 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.957026    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-42b01b5c\"/\"openshift-service-ca.crt\""
Jul 29 13:06:40.962072 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:40.962046    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"]
Jul 29 13:06:41.094339 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.094273    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-model-cache\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.094546 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.094363    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-home\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.094546 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.094432    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnrn2\" (UniqueName: \"kubernetes.io/projected/76918659-fc59-4fa5-860f-93e305c0b853-kube-api-access-lnrn2\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.094546 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.094457    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-dshm\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.094546 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.094484    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-tmp-dir\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.094714 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.094574    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76918659-fc59-4fa5-860f-93e305c0b853-tls-certs\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.195675 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.195640    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrn2\" (UniqueName: \"kubernetes.io/projected/76918659-fc59-4fa5-860f-93e305c0b853-kube-api-access-lnrn2\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.195675 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.195677    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-dshm\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.195908 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.195698    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-tmp-dir\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.195908 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.195725    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76918659-fc59-4fa5-860f-93e305c0b853-tls-certs\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.195908 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.195757    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-model-cache\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.195908 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.195782    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-home\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.196146 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.196030    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-tmp-dir\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.196146 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.196128    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-home\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.196250 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.196212    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-model-cache\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.198039 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.198019    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-dshm\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.198131 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.198112    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76918659-fc59-4fa5-860f-93e305c0b853-tls-certs\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.206240 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.206184    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnrn2\" (UniqueName: \"kubernetes.io/projected/76918659-fc59-4fa5-860f-93e305c0b853-kube-api-access-lnrn2\") pod \"e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") " pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.263135 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.263087    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:41.393729 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.393705    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"]
Jul 29 13:06:41.396374 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:06:41.396345    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76918659_fc59_4fa5_860f_93e305c0b853.slice/crio-ef0637b4a367de288535dc4e4eaca502c4f037b38ce01408a48a7ab100ebac8d WatchSource:0}: Error finding container ef0637b4a367de288535dc4e4eaca502c4f037b38ce01408a48a7ab100ebac8d: Status 404 returned error can't find the container with id ef0637b4a367de288535dc4e4eaca502c4f037b38ce01408a48a7ab100ebac8d
Jul 29 13:06:41.685036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.684984    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv" event={"ID":"76918659-fc59-4fa5-860f-93e305c0b853","Type":"ContainerStarted","Data":"82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f"}
Jul 29 13:06:41.685036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.685037    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv" event={"ID":"76918659-fc59-4fa5-860f-93e305c0b853","Type":"ContainerStarted","Data":"ef0637b4a367de288535dc4e4eaca502c4f037b38ce01408a48a7ab100ebac8d"}
Jul 29 13:06:41.700872 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:41.700823    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv" podStartSLOduration=1.7008069350000001 podStartE2EDuration="1.700806935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:06:41.699882189 +0000 UTC m=+2478.519932966" watchObservedRunningTime="2026-07-29 13:06:41.700806935 +0000 UTC m=+2478.520857705"
Jul 29 13:06:43.724226 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:43.724187    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:06:51.263930 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:51.263872    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:51.263930 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:51.263938    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:51.276935 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:51.276901    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:51.740632 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:51.740600    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:06:59.923522 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:06:59.923484    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:07:23.522647 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:23.522561    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:07:33.665147 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:33.665112    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"]
Jul 29 13:07:33.918318 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:33.918226    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:07:48.685348 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.685285    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv" podUID="76918659-fc59-4fa5-860f-93e305c0b853" containerName="main" containerID="cri-o://82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f" gracePeriod=45
Jul 29 13:07:48.932352 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.932326    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:07:48.980295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980226    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76918659-fc59-4fa5-860f-93e305c0b853-tls-certs\") pod \"76918659-fc59-4fa5-860f-93e305c0b853\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") "
Jul 29 13:07:48.980295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980261    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-home\") pod \"76918659-fc59-4fa5-860f-93e305c0b853\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") "
Jul 29 13:07:48.980295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980280    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnrn2\" (UniqueName: \"kubernetes.io/projected/76918659-fc59-4fa5-860f-93e305c0b853-kube-api-access-lnrn2\") pod \"76918659-fc59-4fa5-860f-93e305c0b853\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") "
Jul 29 13:07:48.980562 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980349    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-dshm\") pod \"76918659-fc59-4fa5-860f-93e305c0b853\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") "
Jul 29 13:07:48.980562 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980411    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-model-cache\") pod \"76918659-fc59-4fa5-860f-93e305c0b853\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") "
Jul 29 13:07:48.980562 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980450    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-tmp-dir\") pod \"76918659-fc59-4fa5-860f-93e305c0b853\" (UID: \"76918659-fc59-4fa5-860f-93e305c0b853\") "
Jul 29 13:07:48.980562 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980551    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-home" (OuterVolumeSpecName: "home") pod "76918659-fc59-4fa5-860f-93e305c0b853" (UID: "76918659-fc59-4fa5-860f-93e305c0b853"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:07:48.980773 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980722    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:07:48.980773 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980720    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76918659-fc59-4fa5-860f-93e305c0b853" (UID: "76918659-fc59-4fa5-860f-93e305c0b853"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:07:48.980773 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.980748    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-model-cache" (OuterVolumeSpecName: "model-cache") pod "76918659-fc59-4fa5-860f-93e305c0b853" (UID: "76918659-fc59-4fa5-860f-93e305c0b853"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:07:48.982563 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.982538    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76918659-fc59-4fa5-860f-93e305c0b853-kube-api-access-lnrn2" (OuterVolumeSpecName: "kube-api-access-lnrn2") pod "76918659-fc59-4fa5-860f-93e305c0b853" (UID: "76918659-fc59-4fa5-860f-93e305c0b853"). InnerVolumeSpecName "kube-api-access-lnrn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:07:48.982674 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.982641    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-dshm" (OuterVolumeSpecName: "dshm") pod "76918659-fc59-4fa5-860f-93e305c0b853" (UID: "76918659-fc59-4fa5-860f-93e305c0b853"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:07:48.982674 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.982638    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76918659-fc59-4fa5-860f-93e305c0b853-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76918659-fc59-4fa5-860f-93e305c0b853" (UID: "76918659-fc59-4fa5-860f-93e305c0b853"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:07:48.993840 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.993811    2549 generic.go:356] "Generic (PLEG): container finished" podID="76918659-fc59-4fa5-860f-93e305c0b853" containerID="82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f" exitCode=0
Jul 29 13:07:48.993934 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.993862    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv" event={"ID":"76918659-fc59-4fa5-860f-93e305c0b853","Type":"ContainerDied","Data":"82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f"}
Jul 29 13:07:48.993934 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.993877    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"
Jul 29 13:07:48.993934 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.993898    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv" event={"ID":"76918659-fc59-4fa5-860f-93e305c0b853","Type":"ContainerDied","Data":"ef0637b4a367de288535dc4e4eaca502c4f037b38ce01408a48a7ab100ebac8d"}
Jul 29 13:07:48.993934 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:48.993916    2549 scope.go:117] "RemoveContainer" containerID="82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f"
Jul 29 13:07:49.002434 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.002414    2549 scope.go:117] "RemoveContainer" containerID="82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f"
Jul 29 13:07:49.002822 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:07:49.002704    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f\": container with ID starting with 82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f not found: ID does not exist" containerID="82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f"
Jul 29 13:07:49.002822 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.002728    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f"} err="failed to get container status \"82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f\": rpc error: code = NotFound desc = could not find container \"82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f\": container with ID starting with 82cf1d151f6da049199f89a8876badd3b330c94fb6ea63d9d9050de5b887b98f not found: ID does not exist"
Jul 29 13:07:49.015066 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.015043    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"]
Jul 29 13:07:49.019470 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.019442    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-42b01b5c/e2e-lifecycle-model-42b01b5c-kserve-5db7ff95f5-xxrjv"]
Jul 29 13:07:49.081673 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.081644    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:07:49.081673 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.081669    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76918659-fc59-4fa5-860f-93e305c0b853-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:07:49.081823 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.081682    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnrn2\" (UniqueName: \"kubernetes.io/projected/76918659-fc59-4fa5-860f-93e305c0b853-kube-api-access-lnrn2\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:07:49.081823 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.081693    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:07:49.081823 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.081708    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76918659-fc59-4fa5-860f-93e305c0b853-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:07:49.701494 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:07:49.697899    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76918659-fc59-4fa5-860f-93e305c0b853" path="/var/lib/kubelet/pods/76918659-fc59-4fa5-860f-93e305c0b853/volumes"
Jul 29 13:08:25.717965 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:08:25.717921    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:08:36.719857 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:08:36.719818    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:08:49.323277 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:08:49.323184    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:08:58.320321 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:08:58.320283    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:09:57.814471 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:09:57.814431    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:10:23.796803 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:23.796728    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:10:23.799752 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:23.799722    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:10:23.803032 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:23.803014    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:10:23.805614 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:23.805597    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:10:28.918528 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:28.918494    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:10:54.354003 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.353962    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"]
Jul 29 13:10:54.354579 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.354517    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76918659-fc59-4fa5-860f-93e305c0b853" containerName="main"
Jul 29 13:10:54.354579 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.354535    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="76918659-fc59-4fa5-860f-93e305c0b853" containerName="main"
Jul 29 13:10:54.354687 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.354615    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="76918659-fc59-4fa5-860f-93e305c0b853" containerName="main"
Jul 29 13:10:54.357923 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.357901    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.361164 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.361143    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a7e361\"/\"openshift-service-ca.crt\""
Jul 29 13:10:54.361325 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.361286    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a7e361\"/\"test-model-a7e361-kserve-self-signed-certs\""
Jul 29 13:10:54.361409 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.361152    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a7e361\"/\"kube-root-ca.crt\""
Jul 29 13:10:54.361409 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.361172    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a7e361\"/\"default-dockercfg-drmq7\""
Jul 29 13:10:54.367283 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.366868    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"]
Jul 29 13:10:54.491560 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.491519    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-dshm\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.491750 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.491571    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgvw8\" (UniqueName: \"kubernetes.io/projected/613bc3b0-134a-4ec0-827e-7a77dae44fc2-kube-api-access-mgvw8\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.491750 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.491593    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-home\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.491750 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.491684    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-model-cache\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.491750 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.491710    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tls-certs\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.491750 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.491736    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tmp-dir\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.592976 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.592926    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tmp-dir\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.592976 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.592983    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-dshm\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.593235 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.593022    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgvw8\" (UniqueName: \"kubernetes.io/projected/613bc3b0-134a-4ec0-827e-7a77dae44fc2-kube-api-access-mgvw8\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.593235 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.593050    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-home\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.593235 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.593137    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-model-cache\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.593235 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.593157    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tls-certs\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.593493 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.593472    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tmp-dir\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.593554 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.593532    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-model-cache\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.593608 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.593557    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-home\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.595377 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.595350    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-dshm\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.595667 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.595646    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tls-certs\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.601824 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.601808    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgvw8\" (UniqueName: \"kubernetes.io/projected/613bc3b0-134a-4ec0-827e-7a77dae44fc2-kube-api-access-mgvw8\") pod \"test-model-a7e361-kserve-5bdc7455bc-xr4gq\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") " pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.669964 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.669868    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:10:54.801447 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.801413    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"]
Jul 29 13:10:54.804266 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:10:54.804241    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod613bc3b0_134a_4ec0_827e_7a77dae44fc2.slice/crio-b6cbbfb7835d9437cb032867431fec0a24f8ee12327e9a1d322c367b8a5e53fc WatchSource:0}: Error finding container b6cbbfb7835d9437cb032867431fec0a24f8ee12327e9a1d322c367b8a5e53fc: Status 404 returned error can't find the container with id b6cbbfb7835d9437cb032867431fec0a24f8ee12327e9a1d322c367b8a5e53fc
Jul 29 13:10:54.817463 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:54.817437    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq" event={"ID":"613bc3b0-134a-4ec0-827e-7a77dae44fc2","Type":"ContainerStarted","Data":"b6cbbfb7835d9437cb032867431fec0a24f8ee12327e9a1d322c367b8a5e53fc"}
Jul 29 13:10:55.822837 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:55.822794    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq" event={"ID":"613bc3b0-134a-4ec0-827e-7a77dae44fc2","Type":"ContainerStarted","Data":"1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d"}
Jul 29 13:10:55.840285 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:55.840234    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq" podStartSLOduration=1.840221469 podStartE2EDuration="1.840221469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:10:55.838128432 +0000 UTC m=+2732.658179208" watchObservedRunningTime="2026-07-29 13:10:55.840221469 +0000 UTC m=+2732.660272237"
Jul 29 13:10:57.316764 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:10:57.316725    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:11:04.670305 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:04.670263    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:11:04.670305 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:04.670339    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:11:04.683143 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:04.683114    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:11:04.875149 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:04.875121    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:11:07.523970 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:07.523936    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:11:20.075511 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.075477    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"]
Jul 29 13:11:20.078861 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.078843    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.081539 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.081504    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ef0894\"/\"openshift-service-ca.crt\""
Jul 29 13:11:20.082477 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.082457    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ef0894\"/\"default-dockercfg-jcwnk\""
Jul 29 13:11:20.082477 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.082471    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ef0894\"/\"kube-root-ca.crt\""
Jul 29 13:11:20.082642 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.082513    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ef0894\"/\"test-model-ef0894-kserve-self-signed-certs\""
Jul 29 13:11:20.092921 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.092897    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"]
Jul 29 13:11:20.099136 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.099115    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b89a31-d567-44be-a8a6-bcd37905942e-tls-certs\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.099228 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.099183    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-home\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.099228 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.099206    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-tmp-dir\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.099228 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.099223    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvxkc\" (UniqueName: \"kubernetes.io/projected/73b89a31-d567-44be-a8a6-bcd37905942e-kube-api-access-fvxkc\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.099341 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.099250    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-dshm\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.099341 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.099293    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-model-cache\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.199879 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.199842    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-home\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200077 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.199880    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-tmp-dir\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200077 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.199916    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvxkc\" (UniqueName: \"kubernetes.io/projected/73b89a31-d567-44be-a8a6-bcd37905942e-kube-api-access-fvxkc\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200077 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.199941    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-dshm\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200077 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.199956    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-model-cache\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200077 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.200007    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b89a31-d567-44be-a8a6-bcd37905942e-tls-certs\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200375 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.200300    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-tmp-dir\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200440 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.200405    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-home\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.200482 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.200468    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-model-cache\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.202232 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.202211    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-dshm\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.202662 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.202642    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b89a31-d567-44be-a8a6-bcd37905942e-tls-certs\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.213742 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.213716    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvxkc\" (UniqueName: \"kubernetes.io/projected/73b89a31-d567-44be-a8a6-bcd37905942e-kube-api-access-fvxkc\") pod \"test-model-ef0894-kserve-798d6c88d5-jtf2l\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") " pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.388379 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.388286    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:20.517384 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.517360    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"]
Jul 29 13:11:20.519494 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:11:20.519472    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73b89a31_d567_44be_a8a6_bcd37905942e.slice/crio-6df000d049565920f59f57d4b622f83d91d4c2207a9afe36af4fd56c443334c5 WatchSource:0}: Error finding container 6df000d049565920f59f57d4b622f83d91d4c2207a9afe36af4fd56c443334c5: Status 404 returned error can't find the container with id 6df000d049565920f59f57d4b622f83d91d4c2207a9afe36af4fd56c443334c5
Jul 29 13:11:20.940429 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.940397    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l" event={"ID":"73b89a31-d567-44be-a8a6-bcd37905942e","Type":"ContainerStarted","Data":"84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c"}
Jul 29 13:11:20.940429 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.940435    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l" event={"ID":"73b89a31-d567-44be-a8a6-bcd37905942e","Type":"ContainerStarted","Data":"6df000d049565920f59f57d4b622f83d91d4c2207a9afe36af4fd56c443334c5"}
Jul 29 13:11:20.958722 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:20.958679    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l" podStartSLOduration=0.958664661 podStartE2EDuration="958.664661ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:11:20.957187533 +0000 UTC m=+2757.777238311" watchObservedRunningTime="2026-07-29 13:11:20.958664661 +0000 UTC m=+2757.778715437"
Jul 29 13:11:23.917074 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:23.917035    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:11:30.389034 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:30.388991    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:30.389540 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:30.389056    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:30.402492 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:30.402459    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:30.998249 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:30.998210    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:11:36.942692 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:11:36.942661    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:12:06.412060 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:06.411967    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"]
Jul 29 13:12:07.449911 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:07.449874    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"]
Jul 29 13:12:10.757516 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:10.757484    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:12:21.430924 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.430879    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq" podUID="613bc3b0-134a-4ec0-827e-7a77dae44fc2" containerName="main" containerID="cri-o://1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d" gracePeriod=45
Jul 29 13:12:21.680504 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.680479    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:12:21.727134 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727059    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-model-cache\") pod \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") "
Jul 29 13:12:21.727295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727139    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tmp-dir\") pod \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") "
Jul 29 13:12:21.727295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727187    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-home\") pod \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") "
Jul 29 13:12:21.727295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727237    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tls-certs\") pod \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") "
Jul 29 13:12:21.727295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727252    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-dshm\") pod \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") "
Jul 29 13:12:21.727532 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727296    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-model-cache" (OuterVolumeSpecName: "model-cache") pod "613bc3b0-134a-4ec0-827e-7a77dae44fc2" (UID: "613bc3b0-134a-4ec0-827e-7a77dae44fc2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:21.727532 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727337    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgvw8\" (UniqueName: \"kubernetes.io/projected/613bc3b0-134a-4ec0-827e-7a77dae44fc2-kube-api-access-mgvw8\") pod \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\" (UID: \"613bc3b0-134a-4ec0-827e-7a77dae44fc2\") "
Jul 29 13:12:21.727532 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727453    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "613bc3b0-134a-4ec0-827e-7a77dae44fc2" (UID: "613bc3b0-134a-4ec0-827e-7a77dae44fc2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:21.727663 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727521    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-home" (OuterVolumeSpecName: "home") pod "613bc3b0-134a-4ec0-827e-7a77dae44fc2" (UID: "613bc3b0-134a-4ec0-827e-7a77dae44fc2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:21.727717 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727677    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:21.727717 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727695    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:21.727717 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.727704    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:21.729619 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.729590    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-dshm" (OuterVolumeSpecName: "dshm") pod "613bc3b0-134a-4ec0-827e-7a77dae44fc2" (UID: "613bc3b0-134a-4ec0-827e-7a77dae44fc2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:21.729619 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.729603    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613bc3b0-134a-4ec0-827e-7a77dae44fc2-kube-api-access-mgvw8" (OuterVolumeSpecName: "kube-api-access-mgvw8") pod "613bc3b0-134a-4ec0-827e-7a77dae44fc2" (UID: "613bc3b0-134a-4ec0-827e-7a77dae44fc2"). InnerVolumeSpecName "kube-api-access-mgvw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:12:21.729839 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.729820    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "613bc3b0-134a-4ec0-827e-7a77dae44fc2" (UID: "613bc3b0-134a-4ec0-827e-7a77dae44fc2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:12:21.828240 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.828205    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/613bc3b0-134a-4ec0-827e-7a77dae44fc2-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:21.828240 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.828234    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/613bc3b0-134a-4ec0-827e-7a77dae44fc2-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:21.828240 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:21.828244    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgvw8\" (UniqueName: \"kubernetes.io/projected/613bc3b0-134a-4ec0-827e-7a77dae44fc2-kube-api-access-mgvw8\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:22.223567 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.223522    2549 generic.go:356] "Generic (PLEG): container finished" podID="613bc3b0-134a-4ec0-827e-7a77dae44fc2" containerID="1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d" exitCode=0
Jul 29 13:12:22.223747 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.223586    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"
Jul 29 13:12:22.223747 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.223610    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq" event={"ID":"613bc3b0-134a-4ec0-827e-7a77dae44fc2","Type":"ContainerDied","Data":"1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d"}
Jul 29 13:12:22.223747 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.223655    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq" event={"ID":"613bc3b0-134a-4ec0-827e-7a77dae44fc2","Type":"ContainerDied","Data":"b6cbbfb7835d9437cb032867431fec0a24f8ee12327e9a1d322c367b8a5e53fc"}
Jul 29 13:12:22.223747 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.223673    2549 scope.go:117] "RemoveContainer" containerID="1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d"
Jul 29 13:12:22.232549 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.232529    2549 scope.go:117] "RemoveContainer" containerID="1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d"
Jul 29 13:12:22.232809 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:12:22.232790    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d\": container with ID starting with 1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d not found: ID does not exist" containerID="1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d"
Jul 29 13:12:22.232874 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.232816    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d"} err="failed to get container status \"1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d\": rpc error: code = NotFound desc = could not find container \"1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d\": container with ID starting with 1d659291d6483e4681768f977626a99a41f430d843820119c53b187f14a4d86d not found: ID does not exist"
Jul 29 13:12:22.246617 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.246595    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"]
Jul 29 13:12:22.253516 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.253492    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a7e361/test-model-a7e361-kserve-5bdc7455bc-xr4gq"]
Jul 29 13:12:22.330938 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.330897    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:12:22.468713 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.468671    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l" podUID="73b89a31-d567-44be-a8a6-bcd37905942e" containerName="main" containerID="cri-o://84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c" gracePeriod=45
Jul 29 13:12:22.715237 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.715206    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:12:22.736143 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736077    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b89a31-d567-44be-a8a6-bcd37905942e-tls-certs\") pod \"73b89a31-d567-44be-a8a6-bcd37905942e\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") "
Jul 29 13:12:22.736143 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736128    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-tmp-dir\") pod \"73b89a31-d567-44be-a8a6-bcd37905942e\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") "
Jul 29 13:12:22.736358 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736227    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvxkc\" (UniqueName: \"kubernetes.io/projected/73b89a31-d567-44be-a8a6-bcd37905942e-kube-api-access-fvxkc\") pod \"73b89a31-d567-44be-a8a6-bcd37905942e\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") "
Jul 29 13:12:22.736358 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736279    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-home\") pod \"73b89a31-d567-44be-a8a6-bcd37905942e\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") "
Jul 29 13:12:22.736358 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736325    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-model-cache\") pod \"73b89a31-d567-44be-a8a6-bcd37905942e\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") "
Jul 29 13:12:22.736512 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736367    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-dshm\") pod \"73b89a31-d567-44be-a8a6-bcd37905942e\" (UID: \"73b89a31-d567-44be-a8a6-bcd37905942e\") "
Jul 29 13:12:22.736512 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736372    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73b89a31-d567-44be-a8a6-bcd37905942e" (UID: "73b89a31-d567-44be-a8a6-bcd37905942e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:22.736622 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736520    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-home" (OuterVolumeSpecName: "home") pod "73b89a31-d567-44be-a8a6-bcd37905942e" (UID: "73b89a31-d567-44be-a8a6-bcd37905942e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:22.736674 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736656    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-model-cache" (OuterVolumeSpecName: "model-cache") pod "73b89a31-d567-44be-a8a6-bcd37905942e" (UID: "73b89a31-d567-44be-a8a6-bcd37905942e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:22.736835 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736814    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:22.736906 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736840    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:22.736906 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.736853    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:22.738649 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.738622    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-dshm" (OuterVolumeSpecName: "dshm") pod "73b89a31-d567-44be-a8a6-bcd37905942e" (UID: "73b89a31-d567-44be-a8a6-bcd37905942e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:12:22.738758 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.738694    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73b89a31-d567-44be-a8a6-bcd37905942e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73b89a31-d567-44be-a8a6-bcd37905942e" (UID: "73b89a31-d567-44be-a8a6-bcd37905942e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:12:22.738758 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.738735    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b89a31-d567-44be-a8a6-bcd37905942e-kube-api-access-fvxkc" (OuterVolumeSpecName: "kube-api-access-fvxkc") pod "73b89a31-d567-44be-a8a6-bcd37905942e" (UID: "73b89a31-d567-44be-a8a6-bcd37905942e"). InnerVolumeSpecName "kube-api-access-fvxkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:12:22.837287 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.837249    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b89a31-d567-44be-a8a6-bcd37905942e-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:22.837287 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.837279    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvxkc\" (UniqueName: \"kubernetes.io/projected/73b89a31-d567-44be-a8a6-bcd37905942e-kube-api-access-fvxkc\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:22.837287 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:22.837287    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b89a31-d567-44be-a8a6-bcd37905942e-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:12:23.228964 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.228924    2549 generic.go:356] "Generic (PLEG): container finished" podID="73b89a31-d567-44be-a8a6-bcd37905942e" containerID="84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c" exitCode=0
Jul 29 13:12:23.229163 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.228970    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"
Jul 29 13:12:23.229163 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.229008    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l" event={"ID":"73b89a31-d567-44be-a8a6-bcd37905942e","Type":"ContainerDied","Data":"84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c"}
Jul 29 13:12:23.229163 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.229056    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l" event={"ID":"73b89a31-d567-44be-a8a6-bcd37905942e","Type":"ContainerDied","Data":"6df000d049565920f59f57d4b622f83d91d4c2207a9afe36af4fd56c443334c5"}
Jul 29 13:12:23.229163 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.229078    2549 scope.go:117] "RemoveContainer" containerID="84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c"
Jul 29 13:12:23.238299 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.238282    2549 scope.go:117] "RemoveContainer" containerID="84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c"
Jul 29 13:12:23.238561 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:12:23.238542    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c\": container with ID starting with 84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c not found: ID does not exist" containerID="84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c"
Jul 29 13:12:23.238625 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.238569    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c"} err="failed to get container status \"84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c\": rpc error: code = NotFound desc = could not find container \"84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c\": container with ID starting with 84433bf085a849b8c5793d7c6d6248b03c636cff890bd6a518ca87a47c38c54c not found: ID does not exist"
Jul 29 13:12:23.253791 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.253765    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"]
Jul 29 13:12:23.261079 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.261058    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ef0894/test-model-ef0894-kserve-798d6c88d5-jtf2l"]
Jul 29 13:12:23.696055 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.696018    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="613bc3b0-134a-4ec0-827e-7a77dae44fc2" path="/var/lib/kubelet/pods/613bc3b0-134a-4ec0-827e-7a77dae44fc2/volumes"
Jul 29 13:12:23.696592 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:23.696572    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73b89a31-d567-44be-a8a6-bcd37905942e" path="/var/lib/kubelet/pods/73b89a31-d567-44be-a8a6-bcd37905942e/volumes"
Jul 29 13:12:38.837651 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:38.837612    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:12:53.521465 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:12:53.521427    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:13:23.069120 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:13:23.069046    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:14:05.920762 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:14:05.920724    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:14:26.722930 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:14:26.722891    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:14:37.430824 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:14:37.430788    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:15:03.465188 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.465113    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"]
Jul 29 13:15:03.465656 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.465500    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613bc3b0-134a-4ec0-827e-7a77dae44fc2" containerName="main"
Jul 29 13:15:03.465656 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.465512    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="613bc3b0-134a-4ec0-827e-7a77dae44fc2" containerName="main"
Jul 29 13:15:03.465656 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.465520    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b89a31-d567-44be-a8a6-bcd37905942e" containerName="main"
Jul 29 13:15:03.465656 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.465525    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b89a31-d567-44be-a8a6-bcd37905942e" containerName="main"
Jul 29 13:15:03.465656 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.465586    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="73b89a31-d567-44be-a8a6-bcd37905942e" containerName="main"
Jul 29 13:15:03.465656 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.465597    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="613bc3b0-134a-4ec0-827e-7a77dae44fc2" containerName="main"
Jul 29 13:15:03.468423 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.468407    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.470814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.470792    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-11a904-dockercfg-fxtrt\""
Jul 29 13:15:03.470814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.470805    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-11a904\""
Jul 29 13:15:03.479283 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.479258    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"]
Jul 29 13:15:03.516011 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.515977    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpwp7\" (UniqueName: \"kubernetes.io/projected/8101aa61-df6f-427f-9a71-6e42f6a4762c-kube-api-access-jpwp7\") pod \"payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.516160 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.516041    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8101aa61-df6f-427f-9a71-6e42f6a4762c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.617128 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.617089    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpwp7\" (UniqueName: \"kubernetes.io/projected/8101aa61-df6f-427f-9a71-6e42f6a4762c-kube-api-access-jpwp7\") pod \"payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.617303 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.617153    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8101aa61-df6f-427f-9a71-6e42f6a4762c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.617892 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.617871    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8101aa61-df6f-427f-9a71-6e42f6a4762c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.626632 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.626610    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpwp7\" (UniqueName: \"kubernetes.io/projected/8101aa61-df6f-427f-9a71-6e42f6a4762c-kube-api-access-jpwp7\") pod \"payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.780070 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.780043    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:03.914881 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.914850    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"]
Jul 29 13:15:03.917745 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:15:03.917717    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8101aa61_df6f_427f_9a71_6e42f6a4762c.slice/crio-b2dbf9a214b4c2fb3aa3a336b0cc6e1bf8792b4442b50291328390f08dcbffe9 WatchSource:0}: Error finding container b2dbf9a214b4c2fb3aa3a336b0cc6e1bf8792b4442b50291328390f08dcbffe9: Status 404 returned error can't find the container with id b2dbf9a214b4c2fb3aa3a336b0cc6e1bf8792b4442b50291328390f08dcbffe9
Jul 29 13:15:03.919981 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.919962    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 13:15:03.950677 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:03.950645    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6" event={"ID":"8101aa61-df6f-427f-9a71-6e42f6a4762c","Type":"ContainerStarted","Data":"b2dbf9a214b4c2fb3aa3a336b0cc6e1bf8792b4442b50291328390f08dcbffe9"}
Jul 29 13:15:06.966426 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:06.966370    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6" event={"ID":"8101aa61-df6f-427f-9a71-6e42f6a4762c","Type":"ContainerStarted","Data":"99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f"}
Jul 29 13:15:06.966872 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:06.966472    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:06.983517 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:06.983468    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6" podStartSLOduration=1.5125011000000002 podStartE2EDuration="3.983453096s" totalImagesPullingTime="2.470951996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:15:06.982250604 +0000 UTC m=+2983.802301383" watchObservedRunningTime="2026-07-29 13:15:06.983453096 +0000 UTC m=+2983.803503870"
Jul 29 13:15:09.921997 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:09.921963    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:15:17.973140 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:17.973106    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:15:23.824136 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:23.824103    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:15:23.827136 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:23.827109    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:15:23.830826 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:23.830803    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:15:23.833652 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:23.833633    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:15:30.555078 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.555045    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"]
Jul 29 13:15:30.559588 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.559566    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.562831 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.562809    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f0ad55\"/\"default-dockercfg-ls47p\""
Jul 29 13:15:30.562930 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.562855    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f0ad55\"/\"kube-root-ca.crt\""
Jul 29 13:15:30.562930 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.562865    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f0ad55\"/\"auth-test-model-f0ad55-kserve-self-signed-certs\""
Jul 29 13:15:30.562930 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.562854    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f0ad55\"/\"openshift-service-ca.crt\""
Jul 29 13:15:30.567030 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.567009    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"]
Jul 29 13:15:30.649811 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.649779    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-model-cache\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.649811 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.649813    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca0670d-6365-4b67-9e40-dec9a0022b38-tls-certs\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.650002 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.649847    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnp6m\" (UniqueName: \"kubernetes.io/projected/bca0670d-6365-4b67-9e40-dec9a0022b38-kube-api-access-dnp6m\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.650002 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.649900    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-tmp-dir\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.650002 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.649992    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-dshm\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.650103 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.650015    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-home\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751267 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751218    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca0670d-6365-4b67-9e40-dec9a0022b38-tls-certs\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751505 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751280    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnp6m\" (UniqueName: \"kubernetes.io/projected/bca0670d-6365-4b67-9e40-dec9a0022b38-kube-api-access-dnp6m\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751505 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751336    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-tmp-dir\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751505 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751392    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-dshm\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751505 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751418    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-home\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751713 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751520    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-model-cache\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751854 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751833    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-home\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751931 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751902    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-tmp-dir\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.751984 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.751939    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-model-cache\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.753626 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.753597    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-dshm\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.753807 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.753792    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca0670d-6365-4b67-9e40-dec9a0022b38-tls-certs\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.759704 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.759680    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnp6m\" (UniqueName: \"kubernetes.io/projected/bca0670d-6365-4b67-9e40-dec9a0022b38-kube-api-access-dnp6m\") pod \"auth-test-model-f0ad55-kserve-ff77d77f-fr4xt\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") " pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:30.869805 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:30.869726    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:31.000231 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:31.000203    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"]
Jul 29 13:15:31.002708 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:15:31.002682    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbca0670d_6365_4b67_9e40_dec9a0022b38.slice/crio-6048545bf541ed6ad3f6aa9921993319fea4dcec78e1ff746eb15a66647b1174 WatchSource:0}: Error finding container 6048545bf541ed6ad3f6aa9921993319fea4dcec78e1ff746eb15a66647b1174: Status 404 returned error can't find the container with id 6048545bf541ed6ad3f6aa9921993319fea4dcec78e1ff746eb15a66647b1174
Jul 29 13:15:31.079163 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:31.079124    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt" event={"ID":"bca0670d-6365-4b67-9e40-dec9a0022b38","Type":"ContainerStarted","Data":"fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001"}
Jul 29 13:15:31.079327 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:31.079174    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt" event={"ID":"bca0670d-6365-4b67-9e40-dec9a0022b38","Type":"ContainerStarted","Data":"6048545bf541ed6ad3f6aa9921993319fea4dcec78e1ff746eb15a66647b1174"}
Jul 29 13:15:33.815532 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:33.815476    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt" podStartSLOduration=3.815460473 podStartE2EDuration="3.815460473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:15:31.095041698 +0000 UTC m=+3007.915092475" watchObservedRunningTime="2026-07-29 13:15:33.815460473 +0000 UTC m=+3010.635511250"
Jul 29 13:15:33.815914 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:33.815726    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:15:40.870649 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:40.870615    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:40.870649 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:40.870654    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:40.883141 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:40.883117    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:41.137885 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:41.137810    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:15:54.377839 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.377801    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"]
Jul 29 13:15:54.381462 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.381445    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.384006 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.383983    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"openshift-service-ca.crt\""
Jul 29 13:15:54.384305 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.384285    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"kube-root-ca.crt\""
Jul 29 13:15:54.385109 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.385091    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"auth-test-model-11a904-kserve-self-signed-certs\""
Jul 29 13:15:54.385216 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.385185    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"default-dockercfg-t54tw\""
Jul 29 13:15:54.393348 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.393328    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"]
Jul 29 13:15:54.456022 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.455985    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-tmp-dir\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.456213 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.456069    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-home\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.456213 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.456099    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcxm2\" (UniqueName: \"kubernetes.io/projected/608175bc-e80d-4556-9a93-2a2a02d04ab7-kube-api-access-dcxm2\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.456213 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.456133    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608175bc-e80d-4556-9a93-2a2a02d04ab7-tls-certs\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.456213 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.456167    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-dshm\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.456432 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.456219    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-model-cache\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.557508 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557465    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-model-cache\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.557675 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557553    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-tmp-dir\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.557675 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557598    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-home\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.557675 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557626    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcxm2\" (UniqueName: \"kubernetes.io/projected/608175bc-e80d-4556-9a93-2a2a02d04ab7-kube-api-access-dcxm2\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.557675 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557662    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608175bc-e80d-4556-9a93-2a2a02d04ab7-tls-certs\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.557847 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557696    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-dshm\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.557967 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557950    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-model-cache\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.558051 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.557987    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-tmp-dir\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.558051 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.558024    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-home\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.559898 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.559880    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-dshm\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.560295 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.560272    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608175bc-e80d-4556-9a93-2a2a02d04ab7-tls-certs\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.566961 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.566940    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcxm2\" (UniqueName: \"kubernetes.io/projected/608175bc-e80d-4556-9a93-2a2a02d04ab7-kube-api-access-dcxm2\") pod \"auth-test-model-11a904-kserve-88575f87-559xw\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") " pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.690632 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.690547    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:15:54.821193 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:54.821166    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"]
Jul 29 13:15:54.823675 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:15:54.823647    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod608175bc_e80d_4556_9a93_2a2a02d04ab7.slice/crio-264b052ff30ba097111c5e6345b8efd236233b33a040eed9670c2676a4c75d16 WatchSource:0}: Error finding container 264b052ff30ba097111c5e6345b8efd236233b33a040eed9670c2676a4c75d16: Status 404 returned error can't find the container with id 264b052ff30ba097111c5e6345b8efd236233b33a040eed9670c2676a4c75d16
Jul 29 13:15:55.188490 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:55.188455    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw" event={"ID":"608175bc-e80d-4556-9a93-2a2a02d04ab7","Type":"ContainerStarted","Data":"13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e"}
Jul 29 13:15:55.188490 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:55.188497    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw" event={"ID":"608175bc-e80d-4556-9a93-2a2a02d04ab7","Type":"ContainerStarted","Data":"264b052ff30ba097111c5e6345b8efd236233b33a040eed9670c2676a4c75d16"}
Jul 29 13:15:57.620115 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:57.620048    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw" podStartSLOduration=3.620029973 podStartE2EDuration="3.620029973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:15:55.211490678 +0000 UTC m=+3032.031541456" watchObservedRunningTime="2026-07-29 13:15:57.620029973 +0000 UTC m=+3034.440080754"
Jul 29 13:15:57.621718 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:15:57.621698    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:16:04.690781 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:16:04.690749    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:16:04.690781 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:16:04.690783    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:16:04.703396 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:16:04.703371    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:16:05.246987 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:16:05.246955    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:16:39.623499 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:16:39.623465    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:17:06.050607 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:17:06.050572    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:17:23.349843 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:17:23.349808    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:17:51.127099 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:17:51.127017    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:18:06.932439 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:18:06.932402    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:18:34.224291 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:18:34.224255    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:18:51.541220 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:18:51.541178    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:19:17.228045 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:19:17.227967    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:19:30.426181 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:19:30.426142    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:19:41.839190 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:19:41.839156    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:20:00.818773 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:00.818735    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:20:18.123364 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:18.123326    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:20:23.852017 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:23.851987    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:20:23.858212 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:23.858190    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:20:23.863467 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:23.863444    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:20:23.866827 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:23.866808    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:20:43.527809 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:43.527770    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:20:46.730430 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:46.730345    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"]
Jul 29 13:20:47.573840 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:47.573809    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"]
Jul 29 13:20:50.772419 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.772385    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"]
Jul 29 13:20:50.775660 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.775642    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.778126 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.778105    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f0ad55\"/\"sub-test-model-f0ad55-kserve-self-signed-certs\""
Jul 29 13:20:50.784907 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.784888    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"]
Jul 29 13:20:50.826665 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.826642    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-dshm\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.826795 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.826675    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tls-certs\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.826795 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.826696    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7jfn\" (UniqueName: \"kubernetes.io/projected/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-kube-api-access-z7jfn\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.826795 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.826760    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tmp-dir\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.826902 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.826827    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-home\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.826902 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.826855    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-model-cache\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.927554 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.927517    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-dshm\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.927554 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.927554    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tls-certs\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.927811 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.927571    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7jfn\" (UniqueName: \"kubernetes.io/projected/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-kube-api-access-z7jfn\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.927811 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.927597    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tmp-dir\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.927811 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.927642    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-home\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.927811 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.927769    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-model-cache\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.928040 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.928017    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-home\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.928040 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.928032    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tmp-dir\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.928119 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.928100    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-model-cache\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.929805 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.929776    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-dshm\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.930065 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.930047    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tls-certs\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:50.936349 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:50.936303    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7jfn\" (UniqueName: \"kubernetes.io/projected/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-kube-api-access-z7jfn\") pod \"sub-test-model-f0ad55-kserve-688cbdf545-74chw\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") " pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:51.085459 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:51.085373    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:20:51.220157 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:51.220129    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"]
Jul 29 13:20:51.222240 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:20:51.222203    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73dfd1b4_e6cb_41ad_a680_9107be6dc79c.slice/crio-6097fc4629134330bd8be7d146c5905651eedd71d319472b969911d698d96502 WatchSource:0}: Error finding container 6097fc4629134330bd8be7d146c5905651eedd71d319472b969911d698d96502: Status 404 returned error can't find the container with id 6097fc4629134330bd8be7d146c5905651eedd71d319472b969911d698d96502
Jul 29 13:20:51.529399 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:51.529360    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw" event={"ID":"73dfd1b4-e6cb-41ad-a680-9107be6dc79c","Type":"ContainerStarted","Data":"99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419"}
Jul 29 13:20:51.529566 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:51.529407    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw" event={"ID":"73dfd1b4-e6cb-41ad-a680-9107be6dc79c","Type":"ContainerStarted","Data":"6097fc4629134330bd8be7d146c5905651eedd71d319472b969911d698d96502"}
Jul 29 13:20:51.546894 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:51.546825    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw" podStartSLOduration=1.546804559 podStartE2EDuration="1.546804559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:20:51.546269002 +0000 UTC m=+3328.366319790" watchObservedRunningTime="2026-07-29 13:20:51.546804559 +0000 UTC m=+3328.366855336"
Jul 29 13:20:58.924617 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:20:58.924574    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:21:01.085710 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:01.085674    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:21:01.086216 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:01.085732    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:21:01.098705 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:01.098677    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:21:01.589253 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:01.589220    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:21:01.751134 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:01.751093    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt" podUID="bca0670d-6365-4b67-9e40-dec9a0022b38" containerName="main" containerID="cri-o://fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001" gracePeriod=45
Jul 29 13:21:01.994498 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:01.994473    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:21:02.034995 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.034957    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-home\") pod \"bca0670d-6365-4b67-9e40-dec9a0022b38\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") "
Jul 29 13:21:02.034995 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035000    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-model-cache\") pod \"bca0670d-6365-4b67-9e40-dec9a0022b38\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") "
Jul 29 13:21:02.035222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035067    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca0670d-6365-4b67-9e40-dec9a0022b38-tls-certs\") pod \"bca0670d-6365-4b67-9e40-dec9a0022b38\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") "
Jul 29 13:21:02.035222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035154    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnp6m\" (UniqueName: \"kubernetes.io/projected/bca0670d-6365-4b67-9e40-dec9a0022b38-kube-api-access-dnp6m\") pod \"bca0670d-6365-4b67-9e40-dec9a0022b38\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") "
Jul 29 13:21:02.035222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035192    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-dshm\") pod \"bca0670d-6365-4b67-9e40-dec9a0022b38\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") "
Jul 29 13:21:02.035406 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035322    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-home" (OuterVolumeSpecName: "home") pod "bca0670d-6365-4b67-9e40-dec9a0022b38" (UID: "bca0670d-6365-4b67-9e40-dec9a0022b38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.035406 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035330    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-tmp-dir\") pod \"bca0670d-6365-4b67-9e40-dec9a0022b38\" (UID: \"bca0670d-6365-4b67-9e40-dec9a0022b38\") "
Jul 29 13:21:02.035406 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035345    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-model-cache" (OuterVolumeSpecName: "model-cache") pod "bca0670d-6365-4b67-9e40-dec9a0022b38" (UID: "bca0670d-6365-4b67-9e40-dec9a0022b38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.035580 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035545    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bca0670d-6365-4b67-9e40-dec9a0022b38" (UID: "bca0670d-6365-4b67-9e40-dec9a0022b38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.035670 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035652    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.035725 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035676    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.035725 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.035690    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.037584 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.037559    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca0670d-6365-4b67-9e40-dec9a0022b38-kube-api-access-dnp6m" (OuterVolumeSpecName: "kube-api-access-dnp6m") pod "bca0670d-6365-4b67-9e40-dec9a0022b38" (UID: "bca0670d-6365-4b67-9e40-dec9a0022b38"). InnerVolumeSpecName "kube-api-access-dnp6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:21:02.037790 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.037767    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-dshm" (OuterVolumeSpecName: "dshm") pod "bca0670d-6365-4b67-9e40-dec9a0022b38" (UID: "bca0670d-6365-4b67-9e40-dec9a0022b38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.037896 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.037788    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bca0670d-6365-4b67-9e40-dec9a0022b38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bca0670d-6365-4b67-9e40-dec9a0022b38" (UID: "bca0670d-6365-4b67-9e40-dec9a0022b38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:21:02.136771 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.136674    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca0670d-6365-4b67-9e40-dec9a0022b38-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.136771 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.136706    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnp6m\" (UniqueName: \"kubernetes.io/projected/bca0670d-6365-4b67-9e40-dec9a0022b38-kube-api-access-dnp6m\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.136771 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.136715    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca0670d-6365-4b67-9e40-dec9a0022b38-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.583739 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.583708    2549 generic.go:356] "Generic (PLEG): container finished" podID="bca0670d-6365-4b67-9e40-dec9a0022b38" containerID="fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001" exitCode=0
Jul 29 13:21:02.583940 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.583748    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"
Jul 29 13:21:02.583940 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.583793    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt" event={"ID":"bca0670d-6365-4b67-9e40-dec9a0022b38","Type":"ContainerDied","Data":"fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001"}
Jul 29 13:21:02.583940 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.583841    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt" event={"ID":"bca0670d-6365-4b67-9e40-dec9a0022b38","Type":"ContainerDied","Data":"6048545bf541ed6ad3f6aa9921993319fea4dcec78e1ff746eb15a66647b1174"}
Jul 29 13:21:02.583940 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.583867    2549 scope.go:117] "RemoveContainer" containerID="fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001"
Jul 29 13:21:02.592681 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.592642    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw" podUID="608175bc-e80d-4556-9a93-2a2a02d04ab7" containerName="main" containerID="cri-o://13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e" gracePeriod=45
Jul 29 13:21:02.597715 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.597695    2549 scope.go:117] "RemoveContainer" containerID="fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001"
Jul 29 13:21:02.597999 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:21:02.597966    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001\": container with ID starting with fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001 not found: ID does not exist" containerID="fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001"
Jul 29 13:21:02.598096 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.598006    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001"} err="failed to get container status \"fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001\": rpc error: code = NotFound desc = could not find container \"fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001\": container with ID starting with fcebc39e1f9f41236b6cae2103bbef8cf506d0dcae9368b3c32e150fc6d36001 not found: ID does not exist"
Jul 29 13:21:02.608627 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.608598    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"]
Jul 29 13:21:02.614275 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.614253    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/auth-test-model-f0ad55-kserve-ff77d77f-fr4xt"]
Jul 29 13:21:02.847014 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.846943    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:21:02.943090 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943055    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-model-cache\") pod \"608175bc-e80d-4556-9a93-2a2a02d04ab7\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") "
Jul 29 13:21:02.943272 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943102    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-tmp-dir\") pod \"608175bc-e80d-4556-9a93-2a2a02d04ab7\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") "
Jul 29 13:21:02.943272 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943124    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-dshm\") pod \"608175bc-e80d-4556-9a93-2a2a02d04ab7\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") "
Jul 29 13:21:02.943272 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943183    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-home\") pod \"608175bc-e80d-4556-9a93-2a2a02d04ab7\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") "
Jul 29 13:21:02.943272 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943232    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcxm2\" (UniqueName: \"kubernetes.io/projected/608175bc-e80d-4556-9a93-2a2a02d04ab7-kube-api-access-dcxm2\") pod \"608175bc-e80d-4556-9a93-2a2a02d04ab7\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") "
Jul 29 13:21:02.943538 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943278    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608175bc-e80d-4556-9a93-2a2a02d04ab7-tls-certs\") pod \"608175bc-e80d-4556-9a93-2a2a02d04ab7\" (UID: \"608175bc-e80d-4556-9a93-2a2a02d04ab7\") "
Jul 29 13:21:02.943538 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943416    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-model-cache" (OuterVolumeSpecName: "model-cache") pod "608175bc-e80d-4556-9a93-2a2a02d04ab7" (UID: "608175bc-e80d-4556-9a93-2a2a02d04ab7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.943538 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943426    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "608175bc-e80d-4556-9a93-2a2a02d04ab7" (UID: "608175bc-e80d-4556-9a93-2a2a02d04ab7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.943538 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943509    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-home" (OuterVolumeSpecName: "home") pod "608175bc-e80d-4556-9a93-2a2a02d04ab7" (UID: "608175bc-e80d-4556-9a93-2a2a02d04ab7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.943714 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943623    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.943714 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943644    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.943714 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.943661    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:02.945441 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.945418    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-dshm" (OuterVolumeSpecName: "dshm") pod "608175bc-e80d-4556-9a93-2a2a02d04ab7" (UID: "608175bc-e80d-4556-9a93-2a2a02d04ab7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:21:02.945550 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.945486    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/608175bc-e80d-4556-9a93-2a2a02d04ab7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "608175bc-e80d-4556-9a93-2a2a02d04ab7" (UID: "608175bc-e80d-4556-9a93-2a2a02d04ab7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:21:02.945550 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:02.945531    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/608175bc-e80d-4556-9a93-2a2a02d04ab7-kube-api-access-dcxm2" (OuterVolumeSpecName: "kube-api-access-dcxm2") pod "608175bc-e80d-4556-9a93-2a2a02d04ab7" (UID: "608175bc-e80d-4556-9a93-2a2a02d04ab7"). InnerVolumeSpecName "kube-api-access-dcxm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:21:03.044593 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.044557    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcxm2\" (UniqueName: \"kubernetes.io/projected/608175bc-e80d-4556-9a93-2a2a02d04ab7-kube-api-access-dcxm2\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:03.044593 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.044588    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608175bc-e80d-4556-9a93-2a2a02d04ab7-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:03.044593 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.044598    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608175bc-e80d-4556-9a93-2a2a02d04ab7-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:21:03.590797 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.590755    2549 generic.go:356] "Generic (PLEG): container finished" podID="608175bc-e80d-4556-9a93-2a2a02d04ab7" containerID="13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e" exitCode=0
Jul 29 13:21:03.590797 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.590797    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"
Jul 29 13:21:03.591438 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.590804    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw" event={"ID":"608175bc-e80d-4556-9a93-2a2a02d04ab7","Type":"ContainerDied","Data":"13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e"}
Jul 29 13:21:03.591438 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.590836    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw" event={"ID":"608175bc-e80d-4556-9a93-2a2a02d04ab7","Type":"ContainerDied","Data":"264b052ff30ba097111c5e6345b8efd236233b33a040eed9670c2676a4c75d16"}
Jul 29 13:21:03.591438 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.590853    2549 scope.go:117] "RemoveContainer" containerID="13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e"
Jul 29 13:21:03.599687 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.599671    2549 scope.go:117] "RemoveContainer" containerID="13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e"
Jul 29 13:21:03.599921 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:21:03.599901    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e\": container with ID starting with 13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e not found: ID does not exist" containerID="13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e"
Jul 29 13:21:03.599964 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.599930    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e"} err="failed to get container status \"13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e\": rpc error: code = NotFound desc = could not find container \"13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e\": container with ID starting with 13b3e2b4d818415049e8f49e3a61dec8973adf74f37e804cc47645e6acd2ab7e not found: ID does not exist"
Jul 29 13:21:03.612495 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.612474    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"]
Jul 29 13:21:03.617614 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.617594    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/auth-test-model-11a904-kserve-88575f87-559xw"]
Jul 29 13:21:03.697131 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.697089    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="608175bc-e80d-4556-9a93-2a2a02d04ab7" path="/var/lib/kubelet/pods/608175bc-e80d-4556-9a93-2a2a02d04ab7/volumes"
Jul 29 13:21:03.697509 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:03.697495    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca0670d-6365-4b67-9e40-dec9a0022b38" path="/var/lib/kubelet/pods/bca0670d-6365-4b67-9e40-dec9a0022b38/volumes"
Jul 29 13:21:13.347801 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.347767    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"]
Jul 29 13:21:13.348290 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.348275    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="608175bc-e80d-4556-9a93-2a2a02d04ab7" containerName="main"
Jul 29 13:21:13.348356 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.348293    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="608175bc-e80d-4556-9a93-2a2a02d04ab7" containerName="main"
Jul 29 13:21:13.348356 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.348339    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca0670d-6365-4b67-9e40-dec9a0022b38" containerName="main"
Jul 29 13:21:13.348356 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.348350    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca0670d-6365-4b67-9e40-dec9a0022b38" containerName="main"
Jul 29 13:21:13.348459 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.348447    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="608175bc-e80d-4556-9a93-2a2a02d04ab7" containerName="main"
Jul 29 13:21:13.348494 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.348462    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca0670d-6365-4b67-9e40-dec9a0022b38" containerName="main"
Jul 29 13:21:13.351667 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.351648    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.354954 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.354934    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"kube-root-ca.crt\""
Jul 29 13:21:13.355073 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.355006    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"sub-test-model-11a904-kserve-self-signed-certs\""
Jul 29 13:21:13.355073 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.355053    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"default-dockercfg-t54tw\""
Jul 29 13:21:13.355172 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.355115    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"openshift-service-ca.crt\""
Jul 29 13:21:13.362671 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.362650    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"]
Jul 29 13:21:13.441420 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.441385    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tls-certs\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.441615 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.441427    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd24l\" (UniqueName: \"kubernetes.io/projected/198bedae-70ae-46dd-b0ab-9b4d413b3deb-kube-api-access-dd24l\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.441615 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.441496    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tmp-dir\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.441615 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.441530    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-dshm\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.441615 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.441561    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-home\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.441615 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.441581    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-model-cache\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.541988 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.541961    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tls-certs\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.541988 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.541998    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd24l\" (UniqueName: \"kubernetes.io/projected/198bedae-70ae-46dd-b0ab-9b4d413b3deb-kube-api-access-dd24l\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.542237 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.542046    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tmp-dir\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.542237 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.542078    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-dshm\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.542381 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.542227    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-home\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.542381 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.542270    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-model-cache\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.542593 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.542570    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tmp-dir\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.542670 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.542645    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-home\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.542724 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.542694    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-model-cache\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.544331 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.544292    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-dshm\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.544657 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.544640    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tls-certs\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.550044 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.550022    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd24l\" (UniqueName: \"kubernetes.io/projected/198bedae-70ae-46dd-b0ab-9b4d413b3deb-kube-api-access-dd24l\") pod \"sub-test-model-11a904-kserve-8498877895-s5ffz\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") " pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.660100 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.660016    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:13.797146 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:13.797117    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"]
Jul 29 13:21:13.799134 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:21:13.799109    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod198bedae_70ae_46dd_b0ab_9b4d413b3deb.slice/crio-a92c423591436b83241899dc9e389321ad3f6ab1a88685e0fc46c42f49a2360f WatchSource:0}: Error finding container a92c423591436b83241899dc9e389321ad3f6ab1a88685e0fc46c42f49a2360f: Status 404 returned error can't find the container with id a92c423591436b83241899dc9e389321ad3f6ab1a88685e0fc46c42f49a2360f
Jul 29 13:21:14.644074 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:14.644038    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz" event={"ID":"198bedae-70ae-46dd-b0ab-9b4d413b3deb","Type":"ContainerStarted","Data":"8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680"}
Jul 29 13:21:14.644074 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:14.644086    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz" event={"ID":"198bedae-70ae-46dd-b0ab-9b4d413b3deb","Type":"ContainerStarted","Data":"a92c423591436b83241899dc9e389321ad3f6ab1a88685e0fc46c42f49a2360f"}
Jul 29 13:21:14.662595 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:14.662538    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz" podStartSLOduration=1.662522154 podStartE2EDuration="1.662522154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:21:14.661303325 +0000 UTC m=+3351.481354105" watchObservedRunningTime="2026-07-29 13:21:14.662522154 +0000 UTC m=+3351.482572931"
Jul 29 13:21:16.519119 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:16.519080    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:21:23.660775 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:23.660745    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:23.661224 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:23.660790    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:23.673471 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:23.673445    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:21:23.699766 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:21:23.699745    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:22:01.227820 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:01.227783    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:22:20.634592 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:20.634507    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:22:42.325934 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:42.325897    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:22:48.101224 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:48.101186    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"]
Jul 29 13:22:48.867505 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:48.867473    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"]
Jul 29 13:22:58.424519 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.424433    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:22:58.668623 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.668590    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"]
Jul 29 13:22:58.671961 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.671947    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.674872 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.674805    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f0ad55\"/\"rate-test-model-f0ad55-kserve-self-signed-certs\""
Jul 29 13:22:58.681572 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.681550    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"]
Jul 29 13:22:58.770828 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.770790    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tls-certs\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.770986 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.770842    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-dshm\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.770986 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.770916    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hctfb\" (UniqueName: \"kubernetes.io/projected/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-kube-api-access-hctfb\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.771065 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.770992    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-model-cache\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.771065 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.771031    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tmp-dir\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.771128 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.771063    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-home\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.872526 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872490    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hctfb\" (UniqueName: \"kubernetes.io/projected/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-kube-api-access-hctfb\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.872706 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872537    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-model-cache\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.872706 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872571    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tmp-dir\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.872706 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872690    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-home\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.872953 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872801    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tls-certs\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.872953 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872894    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-dshm\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.872953 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872944    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-model-cache\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.873107 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.872965    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tmp-dir\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.873107 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.873028    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-home\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.875001 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.874979    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-dshm\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.875156 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.875139    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tls-certs\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.880461 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.880444    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hctfb\" (UniqueName: \"kubernetes.io/projected/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-kube-api-access-hctfb\") pod \"rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") " pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:58.981244 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:58.981186    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:22:59.109362 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:59.109334    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"]
Jul 29 13:22:59.111812 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:22:59.111785    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda516c38e_016f_4dfa_bb10_f8ba8b0c04ae.slice/crio-7771c856b46a46efcd7e293a4cb0e822d1e3b890f20a487786f9d8c796a642e7 WatchSource:0}: Error finding container 7771c856b46a46efcd7e293a4cb0e822d1e3b890f20a487786f9d8c796a642e7: Status 404 returned error can't find the container with id 7771c856b46a46efcd7e293a4cb0e822d1e3b890f20a487786f9d8c796a642e7
Jul 29 13:22:59.121179 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:22:59.121156    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5" event={"ID":"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae","Type":"ContainerStarted","Data":"7771c856b46a46efcd7e293a4cb0e822d1e3b890f20a487786f9d8c796a642e7"}
Jul 29 13:23:00.127351 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:00.127298    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5" event={"ID":"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae","Type":"ContainerStarted","Data":"33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2"}
Jul 29 13:23:00.146543 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:00.146497    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5" podStartSLOduration=2.146474924 podStartE2EDuration="2.146474924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:22:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:23:00.144816692 +0000 UTC m=+3456.964867468" watchObservedRunningTime="2026-07-29 13:23:00.146474924 +0000 UTC m=+3456.966525702"
Jul 29 13:23:03.119957 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.119906    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw" podUID="73dfd1b4-e6cb-41ad-a680-9107be6dc79c" containerName="main" containerID="cri-o://99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419" gracePeriod=45
Jul 29 13:23:03.370587 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.370522    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:23:03.425052 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425018    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tls-certs\") pod \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") "
Jul 29 13:23:03.425212 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425074    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7jfn\" (UniqueName: \"kubernetes.io/projected/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-kube-api-access-z7jfn\") pod \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") "
Jul 29 13:23:03.425212 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425119    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tmp-dir\") pod \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") "
Jul 29 13:23:03.425212 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425141    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-dshm\") pod \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") "
Jul 29 13:23:03.425212 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425189    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-home\") pod \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") "
Jul 29 13:23:03.425435 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425221    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-model-cache\") pod \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\" (UID: \"73dfd1b4-e6cb-41ad-a680-9107be6dc79c\") "
Jul 29 13:23:03.425491 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425446    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73dfd1b4-e6cb-41ad-a680-9107be6dc79c" (UID: "73dfd1b4-e6cb-41ad-a680-9107be6dc79c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:03.425588 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425557    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-home" (OuterVolumeSpecName: "home") pod "73dfd1b4-e6cb-41ad-a680-9107be6dc79c" (UID: "73dfd1b4-e6cb-41ad-a680-9107be6dc79c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:03.425588 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.425577    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-model-cache" (OuterVolumeSpecName: "model-cache") pod "73dfd1b4-e6cb-41ad-a680-9107be6dc79c" (UID: "73dfd1b4-e6cb-41ad-a680-9107be6dc79c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:03.427263 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.427239    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73dfd1b4-e6cb-41ad-a680-9107be6dc79c" (UID: "73dfd1b4-e6cb-41ad-a680-9107be6dc79c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:23:03.427373 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.427288    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-dshm" (OuterVolumeSpecName: "dshm") pod "73dfd1b4-e6cb-41ad-a680-9107be6dc79c" (UID: "73dfd1b4-e6cb-41ad-a680-9107be6dc79c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:03.427373 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.427330    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-kube-api-access-z7jfn" (OuterVolumeSpecName: "kube-api-access-z7jfn") pod "73dfd1b4-e6cb-41ad-a680-9107be6dc79c" (UID: "73dfd1b4-e6cb-41ad-a680-9107be6dc79c"). InnerVolumeSpecName "kube-api-access-z7jfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:23:03.526715 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.526681    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7jfn\" (UniqueName: \"kubernetes.io/projected/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-kube-api-access-z7jfn\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:03.526715 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.526711    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:03.526715 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.526723    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:03.526931 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.526731    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:03.526931 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.526738    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:03.526931 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.526746    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73dfd1b4-e6cb-41ad-a680-9107be6dc79c-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:03.886012 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:03.885964    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz" podUID="198bedae-70ae-46dd-b0ab-9b4d413b3deb" containerName="main" containerID="cri-o://8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680" gracePeriod=45
Jul 29 13:23:04.115066 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.115043    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:23:04.131550 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.131529    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tmp-dir\") pod \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") "
Jul 29 13:23:04.131943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.131574    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tls-certs\") pod \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") "
Jul 29 13:23:04.131943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.131604    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-dshm\") pod \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") "
Jul 29 13:23:04.131943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.131629    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-home\") pod \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") "
Jul 29 13:23:04.131943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.131644    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-model-cache\") pod \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") "
Jul 29 13:23:04.131943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.131674    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd24l\" (UniqueName: \"kubernetes.io/projected/198bedae-70ae-46dd-b0ab-9b4d413b3deb-kube-api-access-dd24l\") pod \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\" (UID: \"198bedae-70ae-46dd-b0ab-9b4d413b3deb\") "
Jul 29 13:23:04.131943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.131919    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "198bedae-70ae-46dd-b0ab-9b4d413b3deb" (UID: "198bedae-70ae-46dd-b0ab-9b4d413b3deb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:04.134842 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.132068    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-model-cache" (OuterVolumeSpecName: "model-cache") pod "198bedae-70ae-46dd-b0ab-9b4d413b3deb" (UID: "198bedae-70ae-46dd-b0ab-9b4d413b3deb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:04.134842 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.132223    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-home" (OuterVolumeSpecName: "home") pod "198bedae-70ae-46dd-b0ab-9b4d413b3deb" (UID: "198bedae-70ae-46dd-b0ab-9b4d413b3deb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:04.134842 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.134278    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-dshm" (OuterVolumeSpecName: "dshm") pod "198bedae-70ae-46dd-b0ab-9b4d413b3deb" (UID: "198bedae-70ae-46dd-b0ab-9b4d413b3deb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:23:04.134842 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.134295    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "198bedae-70ae-46dd-b0ab-9b4d413b3deb" (UID: "198bedae-70ae-46dd-b0ab-9b4d413b3deb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:23:04.134842 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.134552    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198bedae-70ae-46dd-b0ab-9b4d413b3deb-kube-api-access-dd24l" (OuterVolumeSpecName: "kube-api-access-dd24l") pod "198bedae-70ae-46dd-b0ab-9b4d413b3deb" (UID: "198bedae-70ae-46dd-b0ab-9b4d413b3deb"). InnerVolumeSpecName "kube-api-access-dd24l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:23:04.148705 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.148680    2549 generic.go:356] "Generic (PLEG): container finished" podID="73dfd1b4-e6cb-41ad-a680-9107be6dc79c" containerID="99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419" exitCode=0
Jul 29 13:23:04.148830 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.148725    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"
Jul 29 13:23:04.148830 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.148744    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw" event={"ID":"73dfd1b4-e6cb-41ad-a680-9107be6dc79c","Type":"ContainerDied","Data":"99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419"}
Jul 29 13:23:04.148830 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.148795    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw" event={"ID":"73dfd1b4-e6cb-41ad-a680-9107be6dc79c","Type":"ContainerDied","Data":"6097fc4629134330bd8be7d146c5905651eedd71d319472b969911d698d96502"}
Jul 29 13:23:04.148830 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.148819    2549 scope.go:117] "RemoveContainer" containerID="99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419"
Jul 29 13:23:04.150450 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.150291    2549 generic.go:356] "Generic (PLEG): container finished" podID="198bedae-70ae-46dd-b0ab-9b4d413b3deb" containerID="8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680" exitCode=0
Jul 29 13:23:04.150450 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.150345    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"
Jul 29 13:23:04.150450 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.150344    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz" event={"ID":"198bedae-70ae-46dd-b0ab-9b4d413b3deb","Type":"ContainerDied","Data":"8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680"}
Jul 29 13:23:04.150637 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.150441    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz" event={"ID":"198bedae-70ae-46dd-b0ab-9b4d413b3deb","Type":"ContainerDied","Data":"a92c423591436b83241899dc9e389321ad3f6ab1a88685e0fc46c42f49a2360f"}
Jul 29 13:23:04.159488 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.159472    2549 scope.go:117] "RemoveContainer" containerID="99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419"
Jul 29 13:23:04.159717 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:23:04.159699    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419\": container with ID starting with 99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419 not found: ID does not exist" containerID="99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419"
Jul 29 13:23:04.159770 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.159726    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419"} err="failed to get container status \"99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419\": rpc error: code = NotFound desc = could not find container \"99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419\": container with ID starting with 99e2c291ea466c8f2e5f160826c1e78dd115e47bfedab1ad5c3ab29991d7e419 not found: ID does not exist"
Jul 29 13:23:04.159770 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.159743    2549 scope.go:117] "RemoveContainer" containerID="8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680"
Jul 29 13:23:04.166578 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.166553    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"]
Jul 29 13:23:04.167847 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.167827    2549 scope.go:117] "RemoveContainer" containerID="8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680"
Jul 29 13:23:04.168139 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:23:04.168118    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680\": container with ID starting with 8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680 not found: ID does not exist" containerID="8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680"
Jul 29 13:23:04.168216 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.168152    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680"} err="failed to get container status \"8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680\": rpc error: code = NotFound desc = could not find container \"8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680\": container with ID starting with 8bd346351d8b5c65bbd52acbd5ec0b0507b5132e83afb5e86227e0ad59d62680 not found: ID does not exist"
Jul 29 13:23:04.169226 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.169208    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/sub-test-model-f0ad55-kserve-688cbdf545-74chw"]
Jul 29 13:23:04.184348 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.184329    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"]
Jul 29 13:23:04.190557 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.190530    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/sub-test-model-11a904-kserve-8498877895-s5ffz"]
Jul 29 13:23:04.233302 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.233275    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:04.233302 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.233297    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:04.233470 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.233333    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:04.233470 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.233346    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:04.233470 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.233358    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd24l\" (UniqueName: \"kubernetes.io/projected/198bedae-70ae-46dd-b0ab-9b4d413b3deb-kube-api-access-dd24l\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:04.233470 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:04.233371    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198bedae-70ae-46dd-b0ab-9b4d413b3deb-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:23:05.701324 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:05.701285    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198bedae-70ae-46dd-b0ab-9b4d413b3deb" path="/var/lib/kubelet/pods/198bedae-70ae-46dd-b0ab-9b4d413b3deb/volumes"
Jul 29 13:23:05.701689 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:05.701674    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73dfd1b4-e6cb-41ad-a680-9107be6dc79c" path="/var/lib/kubelet/pods/73dfd1b4-e6cb-41ad-a680-9107be6dc79c/volumes"
Jul 29 13:23:07.822574 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:07.822540    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:23:08.981984 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:08.981950    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:23:08.982378 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:08.981998    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:23:08.994451 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:08.994426    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:23:09.184230 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:09.184200    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:23:22.123541 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.123506    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"]
Jul 29 13:23:22.124036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.123852    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198bedae-70ae-46dd-b0ab-9b4d413b3deb" containerName="main"
Jul 29 13:23:22.124036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.123863    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="198bedae-70ae-46dd-b0ab-9b4d413b3deb" containerName="main"
Jul 29 13:23:22.124036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.123874    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73dfd1b4-e6cb-41ad-a680-9107be6dc79c" containerName="main"
Jul 29 13:23:22.124036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.123880    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="73dfd1b4-e6cb-41ad-a680-9107be6dc79c" containerName="main"
Jul 29 13:23:22.124036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.123930    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="198bedae-70ae-46dd-b0ab-9b4d413b3deb" containerName="main"
Jul 29 13:23:22.124036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.123942    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="73dfd1b4-e6cb-41ad-a680-9107be6dc79c" containerName="main"
Jul 29 13:23:22.126938 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.126920    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.131214 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.131185    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"rate-test-model-11a904-kserve-self-signed-certs\""
Jul 29 13:23:22.131214 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.131194    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"kube-root-ca.crt\""
Jul 29 13:23:22.131419 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.131250    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"default-dockercfg-t54tw\""
Jul 29 13:23:22.131419 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.131194    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11a904\"/\"openshift-service-ca.crt\""
Jul 29 13:23:22.143553 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.143530    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"]
Jul 29 13:23:22.179872 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.179848    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tls-certs\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.179991 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.179890    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-dshm\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.179991 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.179914    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpw7v\" (UniqueName: \"kubernetes.io/projected/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-kube-api-access-gpw7v\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.179991 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.179982    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tmp-dir\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.180099 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.180032    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-home\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.180099 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.180063    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-model-cache\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281238 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281206    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-home\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281400 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281245    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-model-cache\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281400 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281305    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tls-certs\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281400 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281368    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-dshm\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281400 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281392    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw7v\" (UniqueName: \"kubernetes.io/projected/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-kube-api-access-gpw7v\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281586 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281432    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tmp-dir\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281693 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281671    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-home\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281753 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281683    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-model-cache\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.281753 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.281739    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tmp-dir\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.283739 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.283716    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-dshm\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.283973 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.283953    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tls-certs\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.291849 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.291830    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpw7v\" (UniqueName: \"kubernetes.io/projected/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-kube-api-access-gpw7v\") pod \"rate-test-model-11a904-kserve-6867b75ff9-p9lcn\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") " pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.436367 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.436267    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:22.567973 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:22.567949    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"]
Jul 29 13:23:22.570687 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:23:22.570653    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb20c8d3_3afa_45db_bdab_bc87d2d8dc90.slice/crio-fabc319114d95ac1321a3706690a3ad4473084e5e2e4ac6f733c2acc0baec0d6 WatchSource:0}: Error finding container fabc319114d95ac1321a3706690a3ad4473084e5e2e4ac6f733c2acc0baec0d6: Status 404 returned error can't find the container with id fabc319114d95ac1321a3706690a3ad4473084e5e2e4ac6f733c2acc0baec0d6
Jul 29 13:23:23.236872 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:23.236838    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn" event={"ID":"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90","Type":"ContainerStarted","Data":"26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c"}
Jul 29 13:23:23.236872 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:23.236876    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn" event={"ID":"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90","Type":"ContainerStarted","Data":"fabc319114d95ac1321a3706690a3ad4473084e5e2e4ac6f733c2acc0baec0d6"}
Jul 29 13:23:23.259796 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:23.259749    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn" podStartSLOduration=1.259736252 podStartE2EDuration="1.259736252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:23:23.258348692 +0000 UTC m=+3480.078399470" watchObservedRunningTime="2026-07-29 13:23:23.259736252 +0000 UTC m=+3480.079787029"
Jul 29 13:23:25.552216 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:25.552180    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:23:32.437022 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:32.436988    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:32.437425 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:32.437252    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:32.449522 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:32.449501    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:23:33.292911 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:23:33.292886    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:24:01.635629 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:01.635588    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:24:15.635971 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:15.635941    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:24:44.127930 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:44.127899    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:24:50.703654 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:50.703616    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"]
Jul 29 13:24:51.472795 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:51.472752    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"]
Jul 29 13:24:52.446325 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.446278    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7689-139906784934960"]
Jul 29 13:24:52.449710 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.449692    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:52.452045 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.452027    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-94vlt\""
Jul 29 13:24:52.456220 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.456200    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906784934960"]
Jul 29 13:24:52.561479 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.561446    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ng9\" (UniqueName: \"kubernetes.io/projected/30c0eb51-a5f5-4c38-9d76-2a049bcfe149-kube-api-access-59ng9\") pod \"test-curl-7689-139906784934960\" (UID: \"30c0eb51-a5f5-4c38-9d76-2a049bcfe149\") " pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:52.662484 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.662450    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59ng9\" (UniqueName: \"kubernetes.io/projected/30c0eb51-a5f5-4c38-9d76-2a049bcfe149-kube-api-access-59ng9\") pod \"test-curl-7689-139906784934960\" (UID: \"30c0eb51-a5f5-4c38-9d76-2a049bcfe149\") " pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:52.670989 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.670958    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ng9\" (UniqueName: \"kubernetes.io/projected/30c0eb51-a5f5-4c38-9d76-2a049bcfe149-kube-api-access-59ng9\") pod \"test-curl-7689-139906784934960\" (UID: \"30c0eb51-a5f5-4c38-9d76-2a049bcfe149\") " pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:52.760448 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.760361    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:52.892617 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.892592    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906784934960"]
Jul 29 13:24:52.895173 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:24:52.895148    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30c0eb51_a5f5_4c38_9d76_2a049bcfe149.slice/crio-11d31a0b4fa515a21bcd30cb3d3368ef3fd1eb1679ec939623984e205e48215f WatchSource:0}: Error finding container 11d31a0b4fa515a21bcd30cb3d3368ef3fd1eb1679ec939623984e205e48215f: Status 404 returned error can't find the container with id 11d31a0b4fa515a21bcd30cb3d3368ef3fd1eb1679ec939623984e205e48215f
Jul 29 13:24:52.896544 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:52.896523    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 13:24:53.656629 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:53.656602    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906784934960" event={"ID":"30c0eb51-a5f5-4c38-9d76-2a049bcfe149","Type":"ContainerStarted","Data":"13062917b013282c9eb5ea77bf419a4657b9a2ebc0dc8faca0515e8a71a00fbf"}
Jul 29 13:24:53.657014 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:53.656638    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906784934960" event={"ID":"30c0eb51-a5f5-4c38-9d76-2a049bcfe149","Type":"ContainerStarted","Data":"11d31a0b4fa515a21bcd30cb3d3368ef3fd1eb1679ec939623984e205e48215f"}
Jul 29 13:24:53.674479 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:53.674431    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7689-139906784934960" podStartSLOduration=0.997228356 podStartE2EDuration="1.674410212s" totalImagesPullingTime="677.181856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:24:53.67347896 +0000 UTC m=+3570.493529737" watchObservedRunningTime="2026-07-29 13:24:53.674410212 +0000 UTC m=+3570.494461025"
Jul 29 13:24:53.789198 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:53.789177    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7689-139906784934960_30c0eb51-a5f5-4c38-9d76-2a049bcfe149/test-curl-7689-139906784934960/0.log"
Jul 29 13:24:54.662136 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:54.662104    2549 generic.go:356] "Generic (PLEG): container finished" podID="30c0eb51-a5f5-4c38-9d76-2a049bcfe149" containerID="13062917b013282c9eb5ea77bf419a4657b9a2ebc0dc8faca0515e8a71a00fbf" exitCode=0
Jul 29 13:24:54.662552 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:54.662179    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906784934960" event={"ID":"30c0eb51-a5f5-4c38-9d76-2a049bcfe149","Type":"ContainerDied","Data":"13062917b013282c9eb5ea77bf419a4657b9a2ebc0dc8faca0515e8a71a00fbf"}
Jul 29 13:24:55.803062 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.803037    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:55.837189 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.837156    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7689-139906784934960"]
Jul 29 13:24:55.842359 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.842334    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7689-139906784934960"]
Jul 29 13:24:55.890006 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.889981    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59ng9\" (UniqueName: \"kubernetes.io/projected/30c0eb51-a5f5-4c38-9d76-2a049bcfe149-kube-api-access-59ng9\") pod \"30c0eb51-a5f5-4c38-9d76-2a049bcfe149\" (UID: \"30c0eb51-a5f5-4c38-9d76-2a049bcfe149\") "
Jul 29 13:24:55.891943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.891917    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c0eb51-a5f5-4c38-9d76-2a049bcfe149-kube-api-access-59ng9" (OuterVolumeSpecName: "kube-api-access-59ng9") pod "30c0eb51-a5f5-4c38-9d76-2a049bcfe149" (UID: "30c0eb51-a5f5-4c38-9d76-2a049bcfe149"). InnerVolumeSpecName "kube-api-access-59ng9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:24:55.964181 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.964105    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7689-139906784932784"]
Jul 29 13:24:55.964481 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.964467    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c0eb51-a5f5-4c38-9d76-2a049bcfe149" containerName="test-curl-7689-139906784934960"
Jul 29 13:24:55.964535 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.964482    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c0eb51-a5f5-4c38-9d76-2a049bcfe149" containerName="test-curl-7689-139906784934960"
Jul 29 13:24:55.964571 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.964542    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c0eb51-a5f5-4c38-9d76-2a049bcfe149" containerName="test-curl-7689-139906784934960"
Jul 29 13:24:55.967502 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.967485    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784932784"
Jul 29 13:24:55.972321 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.972279    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906784932784"]
Jul 29 13:24:55.991639 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:55.991611    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59ng9\" (UniqueName: \"kubernetes.io/projected/30c0eb51-a5f5-4c38-9d76-2a049bcfe149-kube-api-access-59ng9\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:24:56.093026 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.092991    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr9tq\" (UniqueName: \"kubernetes.io/projected/3af08243-f081-4866-b246-e46ff87ddddd-kube-api-access-nr9tq\") pod \"test-curl-7689-139906784932784\" (UID: \"3af08243-f081-4866-b246-e46ff87ddddd\") " pod="opendatahub/test-curl-7689-139906784932784"
Jul 29 13:24:56.193940 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.193887    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr9tq\" (UniqueName: \"kubernetes.io/projected/3af08243-f081-4866-b246-e46ff87ddddd-kube-api-access-nr9tq\") pod \"test-curl-7689-139906784932784\" (UID: \"3af08243-f081-4866-b246-e46ff87ddddd\") " pod="opendatahub/test-curl-7689-139906784932784"
Jul 29 13:24:56.201990 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.201957    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr9tq\" (UniqueName: \"kubernetes.io/projected/3af08243-f081-4866-b246-e46ff87ddddd-kube-api-access-nr9tq\") pod \"test-curl-7689-139906784932784\" (UID: \"3af08243-f081-4866-b246-e46ff87ddddd\") " pod="opendatahub/test-curl-7689-139906784932784"
Jul 29 13:24:56.279052 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.279024    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784932784"
Jul 29 13:24:56.411291 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.411263    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906784932784"]
Jul 29 13:24:56.413811 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:24:56.413783    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3af08243_f081_4866_b246_e46ff87ddddd.slice/crio-747465c398f843603a05214977d0d78bc4e9a9718ff3f6345681b36924b7d709 WatchSource:0}: Error finding container 747465c398f843603a05214977d0d78bc4e9a9718ff3f6345681b36924b7d709: Status 404 returned error can't find the container with id 747465c398f843603a05214977d0d78bc4e9a9718ff3f6345681b36924b7d709
Jul 29 13:24:56.671970 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.671882    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906784932784" event={"ID":"3af08243-f081-4866-b246-e46ff87ddddd","Type":"ContainerStarted","Data":"747465c398f843603a05214977d0d78bc4e9a9718ff3f6345681b36924b7d709"}
Jul 29 13:24:56.673007 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.672991    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11d31a0b4fa515a21bcd30cb3d3368ef3fd1eb1679ec939623984e205e48215f"
Jul 29 13:24:56.673068 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:56.673030    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:56.683723 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:24:56.683696    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7689-139906784934960\" is forbidden: User \"system:node:ip-10-0-142-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-162.ec2.internal' and this object" podUID="30c0eb51-a5f5-4c38-9d76-2a049bcfe149" pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:57.629754 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:57.629715    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:24:57.679577 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:57.679537    2549 generic.go:356] "Generic (PLEG): container finished" podID="3af08243-f081-4866-b246-e46ff87ddddd" containerID="8b2d19890ad11b780dd6b5b824e85950999a381138f013504e347894b17a0fbf" exitCode=0
Jul 29 13:24:57.679756 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:57.679582    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906784932784" event={"ID":"3af08243-f081-4866-b246-e46ff87ddddd","Type":"ContainerDied","Data":"8b2d19890ad11b780dd6b5b824e85950999a381138f013504e347894b17a0fbf"}
Jul 29 13:24:57.696364 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:57.696338    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30c0eb51-a5f5-4c38-9d76-2a049bcfe149" path="/var/lib/kubelet/pods/30c0eb51-a5f5-4c38-9d76-2a049bcfe149/volumes"
Jul 29 13:24:57.696683 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:24:57.696656    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7689-139906784934960\" is forbidden: User \"system:node:ip-10-0-142-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-162.ec2.internal' and this object" podUID="30c0eb51-a5f5-4c38-9d76-2a049bcfe149" pod="opendatahub/test-curl-7689-139906784934960"
Jul 29 13:24:58.817755 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:58.817730    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784932784"
Jul 29 13:24:58.855777 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:58.855749    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7689-139906784932784_3af08243-f081-4866-b246-e46ff87ddddd/test-curl-7689-139906784932784/0.log"
Jul 29 13:24:58.897086 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:58.897057    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7689-139906784932784"]
Jul 29 13:24:58.901271 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:58.901241    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7689-139906784932784"]
Jul 29 13:24:58.919035 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:58.919004    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr9tq\" (UniqueName: \"kubernetes.io/projected/3af08243-f081-4866-b246-e46ff87ddddd-kube-api-access-nr9tq\") pod \"3af08243-f081-4866-b246-e46ff87ddddd\" (UID: \"3af08243-f081-4866-b246-e46ff87ddddd\") "
Jul 29 13:24:58.921078 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:58.921051    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af08243-f081-4866-b246-e46ff87ddddd-kube-api-access-nr9tq" (OuterVolumeSpecName: "kube-api-access-nr9tq") pod "3af08243-f081-4866-b246-e46ff87ddddd" (UID: "3af08243-f081-4866-b246-e46ff87ddddd"). InnerVolumeSpecName "kube-api-access-nr9tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:24:59.019935 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.019844    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr9tq\" (UniqueName: \"kubernetes.io/projected/3af08243-f081-4866-b246-e46ff87ddddd-kube-api-access-nr9tq\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:24:59.063328 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.063285    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:24:59.063653 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.063639    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af08243-f081-4866-b246-e46ff87ddddd" containerName="test-curl-7689-139906784932784"
Jul 29 13:24:59.063702 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.063656    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af08243-f081-4866-b246-e46ff87ddddd" containerName="test-curl-7689-139906784932784"
Jul 29 13:24:59.063734 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.063723    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af08243-f081-4866-b246-e46ff87ddddd" containerName="test-curl-7689-139906784932784"
Jul 29 13:24:59.066506 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.066491    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:24:59.074771 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.074750    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:24:59.120776 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.120753    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8lpr\" (UniqueName: \"kubernetes.io/projected/b9e752c8-528f-4b70-8c7b-4137d11459bf-kube-api-access-c8lpr\") pod \"test-curl-7689-139906786435264\" (UID: \"b9e752c8-528f-4b70-8c7b-4137d11459bf\") " pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:24:59.222273 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.222247    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8lpr\" (UniqueName: \"kubernetes.io/projected/b9e752c8-528f-4b70-8c7b-4137d11459bf-kube-api-access-c8lpr\") pod \"test-curl-7689-139906786435264\" (UID: \"b9e752c8-528f-4b70-8c7b-4137d11459bf\") " pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:24:59.231505 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.231476    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8lpr\" (UniqueName: \"kubernetes.io/projected/b9e752c8-528f-4b70-8c7b-4137d11459bf-kube-api-access-c8lpr\") pod \"test-curl-7689-139906786435264\" (UID: \"b9e752c8-528f-4b70-8c7b-4137d11459bf\") " pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:24:59.376475 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.376450    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:24:59.506487 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.506461    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:24:59.507922 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:24:59.507899    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9e752c8_528f_4b70_8c7b_4137d11459bf.slice/crio-9aac7633b54ca2924d7c67545f9cecd7ffbd13e4bd8b6934486a861a3f4d1970 WatchSource:0}: Error finding container 9aac7633b54ca2924d7c67545f9cecd7ffbd13e4bd8b6934486a861a3f4d1970: Status 404 returned error can't find the container with id 9aac7633b54ca2924d7c67545f9cecd7ffbd13e4bd8b6934486a861a3f4d1970
Jul 29 13:24:59.690208 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.690125    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906784932784"
Jul 29 13:24:59.690208 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.690157    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="747465c398f843603a05214977d0d78bc4e9a9718ff3f6345681b36924b7d709"
Jul 29 13:24:59.696278 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.696248    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af08243-f081-4866-b246-e46ff87ddddd" path="/var/lib/kubelet/pods/3af08243-f081-4866-b246-e46ff87ddddd/volumes"
Jul 29 13:24:59.696652 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:24:59.696635    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786435264" event={"ID":"b9e752c8-528f-4b70-8c7b-4137d11459bf","Type":"ContainerStarted","Data":"9aac7633b54ca2924d7c67545f9cecd7ffbd13e4bd8b6934486a861a3f4d1970"}
Jul 29 13:25:00.697439 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:00.697401    2549 generic.go:356] "Generic (PLEG): container finished" podID="b9e752c8-528f-4b70-8c7b-4137d11459bf" containerID="663da614552cdb946fff98474436c88b06f21098f1263e63e291bf6b37be74ff" exitCode=0
Jul 29 13:25:00.697760 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:00.697478    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786435264" event={"ID":"b9e752c8-528f-4b70-8c7b-4137d11459bf","Type":"ContainerDied","Data":"663da614552cdb946fff98474436c88b06f21098f1263e63e291bf6b37be74ff"}
Jul 29 13:25:01.831360 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:01.831329    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:01.853365 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:01.853334    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7689-139906786435264_b9e752c8-528f-4b70-8c7b-4137d11459bf/test-curl-7689-139906786435264/0.log"
Jul 29 13:25:01.880331 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:01.880284    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:25:01.884228 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:01.884195    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:25:01.944913 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:01.944877    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8lpr\" (UniqueName: \"kubernetes.io/projected/b9e752c8-528f-4b70-8c7b-4137d11459bf-kube-api-access-c8lpr\") pod \"b9e752c8-528f-4b70-8c7b-4137d11459bf\" (UID: \"b9e752c8-528f-4b70-8c7b-4137d11459bf\") "
Jul 29 13:25:01.946936 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:01.946909    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e752c8-528f-4b70-8c7b-4137d11459bf-kube-api-access-c8lpr" (OuterVolumeSpecName: "kube-api-access-c8lpr") pod "b9e752c8-528f-4b70-8c7b-4137d11459bf" (UID: "b9e752c8-528f-4b70-8c7b-4137d11459bf"). InnerVolumeSpecName "kube-api-access-c8lpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:25:02.001179 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.001091    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:25:02.001543 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.001525    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e752c8-528f-4b70-8c7b-4137d11459bf" containerName="test-curl-7689-139906786435264"
Jul 29 13:25:02.001647 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.001546    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e752c8-528f-4b70-8c7b-4137d11459bf" containerName="test-curl-7689-139906786435264"
Jul 29 13:25:02.001706 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.001663    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e752c8-528f-4b70-8c7b-4137d11459bf" containerName="test-curl-7689-139906786435264"
Jul 29 13:25:02.004647 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.004628    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:02.011571 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.011536    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:25:02.045527 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.045495    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8lpr\" (UniqueName: \"kubernetes.io/projected/b9e752c8-528f-4b70-8c7b-4137d11459bf-kube-api-access-c8lpr\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:02.146779 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.146736    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zv7s\" (UniqueName: \"kubernetes.io/projected/50129f2b-6aef-4122-b750-8fcf403557c7-kube-api-access-2zv7s\") pod \"test-curl-7689-139906786435264\" (UID: \"50129f2b-6aef-4122-b750-8fcf403557c7\") " pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:02.247693 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.247650    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zv7s\" (UniqueName: \"kubernetes.io/projected/50129f2b-6aef-4122-b750-8fcf403557c7-kube-api-access-2zv7s\") pod \"test-curl-7689-139906786435264\" (UID: \"50129f2b-6aef-4122-b750-8fcf403557c7\") " pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:02.256796 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.256727    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zv7s\" (UniqueName: \"kubernetes.io/projected/50129f2b-6aef-4122-b750-8fcf403557c7-kube-api-access-2zv7s\") pod \"test-curl-7689-139906786435264\" (UID: \"50129f2b-6aef-4122-b750-8fcf403557c7\") " pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:02.314784 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.314740    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:02.445881 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.445853    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:25:02.448289 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:25:02.448262    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50129f2b_6aef_4122_b750_8fcf403557c7.slice/crio-1efd017a47bb3106f6d25d7b1491bc5be2a2f9facaf42a5700cb0225845f6f89 WatchSource:0}: Error finding container 1efd017a47bb3106f6d25d7b1491bc5be2a2f9facaf42a5700cb0225845f6f89: Status 404 returned error can't find the container with id 1efd017a47bb3106f6d25d7b1491bc5be2a2f9facaf42a5700cb0225845f6f89
Jul 29 13:25:02.708006 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.707976    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:02.708201 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.708016    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9aac7633b54ca2924d7c67545f9cecd7ffbd13e4bd8b6934486a861a3f4d1970"
Jul 29 13:25:02.709178 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.709153    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786435264" event={"ID":"50129f2b-6aef-4122-b750-8fcf403557c7","Type":"ContainerStarted","Data":"1efd017a47bb3106f6d25d7b1491bc5be2a2f9facaf42a5700cb0225845f6f89"}
Jul 29 13:25:02.720370 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:02.720343    2549 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7689-139906786435264" oldPodUID="b9e752c8-528f-4b70-8c7b-4137d11459bf" podUID="50129f2b-6aef-4122-b750-8fcf403557c7"
Jul 29 13:25:03.697798 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:03.697764    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e752c8-528f-4b70-8c7b-4137d11459bf" path="/var/lib/kubelet/pods/b9e752c8-528f-4b70-8c7b-4137d11459bf/volumes"
Jul 29 13:25:03.715063 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:03.715032    2549 generic.go:356] "Generic (PLEG): container finished" podID="50129f2b-6aef-4122-b750-8fcf403557c7" containerID="d2b0935438ef9ebaa6e62617ea3a30d4bed19a716976fd108b650379fb6efcc3" exitCode=0
Jul 29 13:25:03.715186 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:03.715105    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786435264" event={"ID":"50129f2b-6aef-4122-b750-8fcf403557c7","Type":"ContainerDied","Data":"d2b0935438ef9ebaa6e62617ea3a30d4bed19a716976fd108b650379fb6efcc3"}
Jul 29 13:25:04.858643 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:04.858617    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:04.880782 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:04.880759    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7689-139906786435264_50129f2b-6aef-4122-b750-8fcf403557c7/test-curl-7689-139906786435264/0.log"
Jul 29 13:25:04.906999 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:04.906969    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:25:04.910856 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:04.910830    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7689-139906786435264"]
Jul 29 13:25:04.971238 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:04.971152    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zv7s\" (UniqueName: \"kubernetes.io/projected/50129f2b-6aef-4122-b750-8fcf403557c7-kube-api-access-2zv7s\") pod \"50129f2b-6aef-4122-b750-8fcf403557c7\" (UID: \"50129f2b-6aef-4122-b750-8fcf403557c7\") "
Jul 29 13:25:04.973221 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:04.973198    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50129f2b-6aef-4122-b750-8fcf403557c7-kube-api-access-2zv7s" (OuterVolumeSpecName: "kube-api-access-2zv7s") pod "50129f2b-6aef-4122-b750-8fcf403557c7" (UID: "50129f2b-6aef-4122-b750-8fcf403557c7"). InnerVolumeSpecName "kube-api-access-2zv7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:25:05.030015 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.029980    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:05.030369 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.030354    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50129f2b-6aef-4122-b750-8fcf403557c7" containerName="test-curl-7689-139906786435264"
Jul 29 13:25:05.030369 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.030369    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="50129f2b-6aef-4122-b750-8fcf403557c7" containerName="test-curl-7689-139906786435264"
Jul 29 13:25:05.030471 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.030443    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="50129f2b-6aef-4122-b750-8fcf403557c7" containerName="test-curl-7689-139906786435264"
Jul 29 13:25:05.033273 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.033256    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:05.045003 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.044104    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:05.072733 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.072694    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zv7s\" (UniqueName: \"kubernetes.io/projected/50129f2b-6aef-4122-b750-8fcf403557c7-kube-api-access-2zv7s\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:05.173335 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.173271    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5ms\" (UniqueName: \"kubernetes.io/projected/932cf120-67ed-4551-9e9a-eaf4216b4db8-kube-api-access-hb5ms\") pod \"test-curl-7689-139906786436272\" (UID: \"932cf120-67ed-4551-9e9a-eaf4216b4db8\") " pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:05.274492 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.274457    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5ms\" (UniqueName: \"kubernetes.io/projected/932cf120-67ed-4551-9e9a-eaf4216b4db8-kube-api-access-hb5ms\") pod \"test-curl-7689-139906786436272\" (UID: \"932cf120-67ed-4551-9e9a-eaf4216b4db8\") " pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:05.285660 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.285632    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5ms\" (UniqueName: \"kubernetes.io/projected/932cf120-67ed-4551-9e9a-eaf4216b4db8-kube-api-access-hb5ms\") pod \"test-curl-7689-139906786436272\" (UID: \"932cf120-67ed-4551-9e9a-eaf4216b4db8\") " pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:05.343199 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.343159    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:05.475995 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.475965    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:05.478160 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:25:05.478133    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod932cf120_67ed_4551_9e9a_eaf4216b4db8.slice/crio-b53c91781a4fcd092f3d481d3833c313364d3435b0fa3f4ef6594d5815475466 WatchSource:0}: Error finding container b53c91781a4fcd092f3d481d3833c313364d3435b0fa3f4ef6594d5815475466: Status 404 returned error can't find the container with id b53c91781a4fcd092f3d481d3833c313364d3435b0fa3f4ef6594d5815475466
Jul 29 13:25:05.696940 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.696843    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50129f2b-6aef-4122-b750-8fcf403557c7" path="/var/lib/kubelet/pods/50129f2b-6aef-4122-b750-8fcf403557c7/volumes"
Jul 29 13:25:05.722084 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.722047    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5" podUID="a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" containerName="main" containerID="cri-o://33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2" gracePeriod=45
Jul 29 13:25:05.726346 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.726325    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786435264"
Jul 29 13:25:05.726467 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.726356    2549 scope.go:117] "RemoveContainer" containerID="d2b0935438ef9ebaa6e62617ea3a30d4bed19a716976fd108b650379fb6efcc3"
Jul 29 13:25:05.727487 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.727460    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786436272" event={"ID":"932cf120-67ed-4551-9e9a-eaf4216b4db8","Type":"ContainerStarted","Data":"b53c91781a4fcd092f3d481d3833c313364d3435b0fa3f4ef6594d5815475466"}
Jul 29 13:25:05.995395 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:05.995368    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:25:06.081943 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.081905    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-model-cache\") pod \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") "
Jul 29 13:25:06.082137 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.081980    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-dshm\") pod \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") "
Jul 29 13:25:06.082137 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082028    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hctfb\" (UniqueName: \"kubernetes.io/projected/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-kube-api-access-hctfb\") pod \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") "
Jul 29 13:25:06.082137 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082054    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tls-certs\") pod \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") "
Jul 29 13:25:06.082137 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082075    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-home\") pod \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") "
Jul 29 13:25:06.082373 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082215    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tmp-dir\") pod \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\" (UID: \"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae\") "
Jul 29 13:25:06.082373 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082242    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" (UID: "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.082373 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082300    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-home" (OuterVolumeSpecName: "home") pod "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" (UID: "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.082511 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082485    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" (UID: "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.082596 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082581    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.082643 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082598    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.082643 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.082607    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.084272 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.084243    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" (UID: "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:25:06.084417 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.084397    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-kube-api-access-hctfb" (OuterVolumeSpecName: "kube-api-access-hctfb") pod "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" (UID: "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae"). InnerVolumeSpecName "kube-api-access-hctfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:25:06.084477 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.084421    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-dshm" (OuterVolumeSpecName: "dshm") pod "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" (UID: "a516c38e-016f-4dfa-bb10-f8ba8b0c04ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.183510 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.183478    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.183510 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.183504    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hctfb\" (UniqueName: \"kubernetes.io/projected/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-kube-api-access-hctfb\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.183510 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.183516    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.491720 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.491672    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn" podUID="bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" containerName="main" containerID="cri-o://26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c" gracePeriod=45
Jul 29 13:25:06.734461 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.734428    2549 generic.go:356] "Generic (PLEG): container finished" podID="a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" containerID="33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2" exitCode=0
Jul 29 13:25:06.734582 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.734468    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"
Jul 29 13:25:06.734582 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.734505    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5" event={"ID":"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae","Type":"ContainerDied","Data":"33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2"}
Jul 29 13:25:06.734582 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.734547    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5" event={"ID":"a516c38e-016f-4dfa-bb10-f8ba8b0c04ae","Type":"ContainerDied","Data":"7771c856b46a46efcd7e293a4cb0e822d1e3b890f20a487786f9d8c796a642e7"}
Jul 29 13:25:06.734582 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.734570    2549 scope.go:117] "RemoveContainer" containerID="33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2"
Jul 29 13:25:06.735670 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.735650    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:25:06.735904 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.735877    2549 generic.go:356] "Generic (PLEG): container finished" podID="bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" containerID="26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c" exitCode=0
Jul 29 13:25:06.735980 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.735941    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn" event={"ID":"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90","Type":"ContainerDied","Data":"26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c"}
Jul 29 13:25:06.735980 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.735972    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn" event={"ID":"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90","Type":"ContainerDied","Data":"fabc319114d95ac1321a3706690a3ad4473084e5e2e4ac6f733c2acc0baec0d6"}
Jul 29 13:25:06.737428 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.737405    2549 generic.go:356] "Generic (PLEG): container finished" podID="932cf120-67ed-4551-9e9a-eaf4216b4db8" containerID="d4e204d2abcac6aafcd6f29d79f894a9b887fa19c4f1c1e92dc6e1ffcb358628" exitCode=0
Jul 29 13:25:06.737522 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.737449    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786436272" event={"ID":"932cf120-67ed-4551-9e9a-eaf4216b4db8","Type":"ContainerDied","Data":"d4e204d2abcac6aafcd6f29d79f894a9b887fa19c4f1c1e92dc6e1ffcb358628"}
Jul 29 13:25:06.744634 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.744619    2549 scope.go:117] "RemoveContainer" containerID="33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2"
Jul 29 13:25:06.744865 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:25:06.744846    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2\": container with ID starting with 33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2 not found: ID does not exist" containerID="33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2"
Jul 29 13:25:06.744934 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.744877    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2"} err="failed to get container status \"33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2\": rpc error: code = NotFound desc = could not find container \"33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2\": container with ID starting with 33b0304018e5e498012b01848e7d58e2dfe42da4bcaa55ce86ed6df56e86f3c2 not found: ID does not exist"
Jul 29 13:25:06.744934 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.744900    2549 scope.go:117] "RemoveContainer" containerID="26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c"
Jul 29 13:25:06.752406 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.752386    2549 scope.go:117] "RemoveContainer" containerID="26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c"
Jul 29 13:25:06.752656 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:25:06.752637    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c\": container with ID starting with 26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c not found: ID does not exist" containerID="26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c"
Jul 29 13:25:06.752711 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.752665    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c"} err="failed to get container status \"26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c\": rpc error: code = NotFound desc = could not find container \"26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c\": container with ID starting with 26e58dfc5327dd21305a79eb2580a9e9b10b6e77ffcb31c8067ba20042db097c not found: ID does not exist"
Jul 29 13:25:06.788056 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.788025    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"]
Jul 29 13:25:06.792997 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.792968    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f0ad55/rate-test-model-f0ad55-kserve-5cfd8f6767-5rfd5"]
Jul 29 13:25:06.890971 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.890934    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-home\") pod \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") "
Jul 29 13:25:06.891100 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.890978    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpw7v\" (UniqueName: \"kubernetes.io/projected/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-kube-api-access-gpw7v\") pod \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") "
Jul 29 13:25:06.891100 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891006    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-dshm\") pod \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") "
Jul 29 13:25:06.891100 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891024    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tls-certs\") pod \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") "
Jul 29 13:25:06.891100 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891044    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tmp-dir\") pod \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") "
Jul 29 13:25:06.891393 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891103    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-model-cache\") pod \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\" (UID: \"bb20c8d3-3afa-45db-bdab-bc87d2d8dc90\") "
Jul 29 13:25:06.891393 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891260    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-home" (OuterVolumeSpecName: "home") pod "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" (UID: "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.891503 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891396    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.891503 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891401    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" (UID: "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.891503 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.891449    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" (UID: "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.893221 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.893199    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-kube-api-access-gpw7v" (OuterVolumeSpecName: "kube-api-access-gpw7v") pod "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" (UID: "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90"). InnerVolumeSpecName "kube-api-access-gpw7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:25:06.893570 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.893550    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-dshm" (OuterVolumeSpecName: "dshm") pod "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" (UID: "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:25:06.893633 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.893614    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" (UID: "bb20c8d3-3afa-45db-bdab-bc87d2d8dc90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:25:06.992222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.992181    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.992222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.992215    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpw7v\" (UniqueName: \"kubernetes.io/projected/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-kube-api-access-gpw7v\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.992222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.992225    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.992477 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.992233    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:06.992477 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:06.992244    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:07.697986 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.697951    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" path="/var/lib/kubelet/pods/a516c38e-016f-4dfa-bb10-f8ba8b0c04ae/volumes"
Jul 29 13:25:07.744183 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.744152    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"
Jul 29 13:25:07.762024 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.761991    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"]
Jul 29 13:25:07.765674 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.765651    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-11a904/rate-test-model-11a904-kserve-6867b75ff9-p9lcn"]
Jul 29 13:25:07.878047 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.878023    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:07.902546 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.902518    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7689-139906786436272_932cf120-67ed-4551-9e9a-eaf4216b4db8/test-curl-7689-139906786436272/0.log"
Jul 29 13:25:07.926807 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.926770    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:07.932895 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:07.932858    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:08.001718 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.001634    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb5ms\" (UniqueName: \"kubernetes.io/projected/932cf120-67ed-4551-9e9a-eaf4216b4db8-kube-api-access-hb5ms\") pod \"932cf120-67ed-4551-9e9a-eaf4216b4db8\" (UID: \"932cf120-67ed-4551-9e9a-eaf4216b4db8\") "
Jul 29 13:25:08.003729 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.003701    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/932cf120-67ed-4551-9e9a-eaf4216b4db8-kube-api-access-hb5ms" (OuterVolumeSpecName: "kube-api-access-hb5ms") pod "932cf120-67ed-4551-9e9a-eaf4216b4db8" (UID: "932cf120-67ed-4551-9e9a-eaf4216b4db8"). InnerVolumeSpecName "kube-api-access-hb5ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:25:08.063707 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.063675    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:08.064009 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.063996    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="932cf120-67ed-4551-9e9a-eaf4216b4db8" containerName="test-curl-7689-139906786436272"
Jul 29 13:25:08.064054 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064011    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="932cf120-67ed-4551-9e9a-eaf4216b4db8" containerName="test-curl-7689-139906786436272"
Jul 29 13:25:08.064054 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064029    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" containerName="main"
Jul 29 13:25:08.064054 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064035    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" containerName="main"
Jul 29 13:25:08.064054 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064048    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" containerName="main"
Jul 29 13:25:08.064054 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064053    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" containerName="main"
Jul 29 13:25:08.064201 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064122    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a516c38e-016f-4dfa-bb10-f8ba8b0c04ae" containerName="main"
Jul 29 13:25:08.064201 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064131    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" containerName="main"
Jul 29 13:25:08.064201 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.064138    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="932cf120-67ed-4551-9e9a-eaf4216b4db8" containerName="test-curl-7689-139906786436272"
Jul 29 13:25:08.066865 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.066849    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:08.074939 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.074916    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:08.103074 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.103048    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb5ms\" (UniqueName: \"kubernetes.io/projected/932cf120-67ed-4551-9e9a-eaf4216b4db8-kube-api-access-hb5ms\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:08.204038 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.204010    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbg6z\" (UniqueName: \"kubernetes.io/projected/d67993f3-a95e-4d71-8402-1f9b8d63145d-kube-api-access-kbg6z\") pod \"test-curl-7689-139906786436272\" (UID: \"d67993f3-a95e-4d71-8402-1f9b8d63145d\") " pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:08.305456 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.305411    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbg6z\" (UniqueName: \"kubernetes.io/projected/d67993f3-a95e-4d71-8402-1f9b8d63145d-kube-api-access-kbg6z\") pod \"test-curl-7689-139906786436272\" (UID: \"d67993f3-a95e-4d71-8402-1f9b8d63145d\") " pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:08.314697 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.314672    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbg6z\" (UniqueName: \"kubernetes.io/projected/d67993f3-a95e-4d71-8402-1f9b8d63145d-kube-api-access-kbg6z\") pod \"test-curl-7689-139906786436272\" (UID: \"d67993f3-a95e-4d71-8402-1f9b8d63145d\") " pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:08.376726 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.376695    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:08.506729 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.506702    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:08.509165 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:25:08.509138    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd67993f3_a95e_4d71_8402_1f9b8d63145d.slice/crio-d8448ddfcaa79d5a9026644396da4b809ee7a52dd4719067a16c82c22c878314 WatchSource:0}: Error finding container d8448ddfcaa79d5a9026644396da4b809ee7a52dd4719067a16c82c22c878314: Status 404 returned error can't find the container with id d8448ddfcaa79d5a9026644396da4b809ee7a52dd4719067a16c82c22c878314
Jul 29 13:25:08.751153 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.751071    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:08.751584 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.751078    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b53c91781a4fcd092f3d481d3833c313364d3435b0fa3f4ef6594d5815475466"
Jul 29 13:25:08.752342 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.752301    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786436272" event={"ID":"d67993f3-a95e-4d71-8402-1f9b8d63145d","Type":"ContainerStarted","Data":"d8448ddfcaa79d5a9026644396da4b809ee7a52dd4719067a16c82c22c878314"}
Jul 29 13:25:08.766780 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:08.766754    2549 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7689-139906786436272" oldPodUID="932cf120-67ed-4551-9e9a-eaf4216b4db8" podUID="d67993f3-a95e-4d71-8402-1f9b8d63145d"
Jul 29 13:25:09.696970 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:09.696939    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="932cf120-67ed-4551-9e9a-eaf4216b4db8" path="/var/lib/kubelet/pods/932cf120-67ed-4551-9e9a-eaf4216b4db8/volumes"
Jul 29 13:25:09.697399 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:09.697384    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb20c8d3-3afa-45db-bdab-bc87d2d8dc90" path="/var/lib/kubelet/pods/bb20c8d3-3afa-45db-bdab-bc87d2d8dc90/volumes"
Jul 29 13:25:09.758866 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:09.758836    2549 generic.go:356] "Generic (PLEG): container finished" podID="d67993f3-a95e-4d71-8402-1f9b8d63145d" containerID="7eb3c3710cdad07da571dfd974af209c6a0df5aaa64b78a5811d0add44f20715" exitCode=0
Jul 29 13:25:09.759225 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:09.758881    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7689-139906786436272" event={"ID":"d67993f3-a95e-4d71-8402-1f9b8d63145d","Type":"ContainerDied","Data":"7eb3c3710cdad07da571dfd974af209c6a0df5aaa64b78a5811d0add44f20715"}
Jul 29 13:25:10.902657 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:10.902632    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:10.925965 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:10.925940    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7689-139906786436272_d67993f3-a95e-4d71-8402-1f9b8d63145d/test-curl-7689-139906786436272/0.log"
Jul 29 13:25:10.955741 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:10.955711    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:10.959528 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:10.959508    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7689-139906786436272"]
Jul 29 13:25:11.030816 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:11.030791    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbg6z\" (UniqueName: \"kubernetes.io/projected/d67993f3-a95e-4d71-8402-1f9b8d63145d-kube-api-access-kbg6z\") pod \"d67993f3-a95e-4d71-8402-1f9b8d63145d\" (UID: \"d67993f3-a95e-4d71-8402-1f9b8d63145d\") "
Jul 29 13:25:11.032851 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:11.032826    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67993f3-a95e-4d71-8402-1f9b8d63145d-kube-api-access-kbg6z" (OuterVolumeSpecName: "kube-api-access-kbg6z") pod "d67993f3-a95e-4d71-8402-1f9b8d63145d" (UID: "d67993f3-a95e-4d71-8402-1f9b8d63145d"). InnerVolumeSpecName "kube-api-access-kbg6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:25:11.132214 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:11.132184    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbg6z\" (UniqueName: \"kubernetes.io/projected/d67993f3-a95e-4d71-8402-1f9b8d63145d-kube-api-access-kbg6z\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:25:11.696408 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:11.696376    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67993f3-a95e-4d71-8402-1f9b8d63145d" path="/var/lib/kubelet/pods/d67993f3-a95e-4d71-8402-1f9b8d63145d/volumes"
Jul 29 13:25:11.770676 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:11.770646    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7689-139906786436272"
Jul 29 13:25:11.770849 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:11.770651    2549 scope.go:117] "RemoveContainer" containerID="7eb3c3710cdad07da571dfd974af209c6a0df5aaa64b78a5811d0add44f20715"
Jul 29 13:25:15.290553 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.290475    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"]
Jul 29 13:25:15.290893 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.290845    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67993f3-a95e-4d71-8402-1f9b8d63145d" containerName="test-curl-7689-139906786436272"
Jul 29 13:25:15.290893 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.290861    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67993f3-a95e-4d71-8402-1f9b8d63145d" containerName="test-curl-7689-139906786436272"
Jul 29 13:25:15.290973 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.290932    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67993f3-a95e-4d71-8402-1f9b8d63145d" containerName="test-curl-7689-139906786436272"
Jul 29 13:25:15.295259 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.295239    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.298219 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.298198    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-86053a\""
Jul 29 13:25:15.298849 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.298829    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-86053a-dockercfg-mxvxr\""
Jul 29 13:25:15.300466 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.300446    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"]
Jul 29 13:25:15.303538 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.303522    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.309728 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.309691    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"]
Jul 29 13:25:15.316023 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.315999    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"]
Jul 29 13:25:15.466455 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.466412    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7a41d1-af81-4e07-8668-0f9e5224394f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.466596 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.466488    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv6lz\" (UniqueName: \"kubernetes.io/projected/012c4453-2aa2-41d9-a331-73d989a53f6c-kube-api-access-fv6lz\") pod \"payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.466596 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.466512    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/012c4453-2aa2-41d9-a331-73d989a53f6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.466596 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.466539    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmlfr\" (UniqueName: \"kubernetes.io/projected/7b7a41d1-af81-4e07-8668-0f9e5224394f-kube-api-access-jmlfr\") pod \"payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.567057 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.566971    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7a41d1-af81-4e07-8668-0f9e5224394f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.567057 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.567030    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv6lz\" (UniqueName: \"kubernetes.io/projected/012c4453-2aa2-41d9-a331-73d989a53f6c-kube-api-access-fv6lz\") pod \"payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.567057 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.567056    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/012c4453-2aa2-41d9-a331-73d989a53f6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.567359 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.567083    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmlfr\" (UniqueName: \"kubernetes.io/projected/7b7a41d1-af81-4e07-8668-0f9e5224394f-kube-api-access-jmlfr\") pod \"payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.567760 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.567739    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7a41d1-af81-4e07-8668-0f9e5224394f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.567798 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.567757    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/012c4453-2aa2-41d9-a331-73d989a53f6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.578054 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.578034    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmlfr\" (UniqueName: \"kubernetes.io/projected/7b7a41d1-af81-4e07-8668-0f9e5224394f-kube-api-access-jmlfr\") pod \"payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.578539 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.578520    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv6lz\" (UniqueName: \"kubernetes.io/projected/012c4453-2aa2-41d9-a331-73d989a53f6c-kube-api-access-fv6lz\") pod \"payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.606193 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.606169    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:15.622460 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.622437    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:15.751987 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.751878    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"]
Jul 29 13:25:15.756120 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:25:15.756086    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012c4453_2aa2_41d9_a331_73d989a53f6c.slice/crio-c015e1db265d6accffe4d6569a629ee7c63707631a00e86199108e2b9b612593 WatchSource:0}: Error finding container c015e1db265d6accffe4d6569a629ee7c63707631a00e86199108e2b9b612593: Status 404 returned error can't find the container with id c015e1db265d6accffe4d6569a629ee7c63707631a00e86199108e2b9b612593
Jul 29 13:25:15.782959 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.782934    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"]
Jul 29 13:25:15.791301 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:15.791264    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb" event={"ID":"012c4453-2aa2-41d9-a331-73d989a53f6c","Type":"ContainerStarted","Data":"c015e1db265d6accffe4d6569a629ee7c63707631a00e86199108e2b9b612593"}
Jul 29 13:25:15.791517 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:25:15.791491    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7a41d1_af81_4e07_8668_0f9e5224394f.slice/crio-644600c5e3abf6a3eaf39a019bca0427d48eeb8708ad10851b75919536304548 WatchSource:0}: Error finding container 644600c5e3abf6a3eaf39a019bca0427d48eeb8708ad10851b75919536304548: Status 404 returned error can't find the container with id 644600c5e3abf6a3eaf39a019bca0427d48eeb8708ad10851b75919536304548
Jul 29 13:25:16.797063 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:16.797019    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx" event={"ID":"7b7a41d1-af81-4e07-8668-0f9e5224394f","Type":"ContainerStarted","Data":"7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0"}
Jul 29 13:25:16.797550 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:16.797089    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:16.797550 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:16.797109    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx" event={"ID":"7b7a41d1-af81-4e07-8668-0f9e5224394f","Type":"ContainerStarted","Data":"644600c5e3abf6a3eaf39a019bca0427d48eeb8708ad10851b75919536304548"}
Jul 29 13:25:16.798477 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:16.798450    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb" event={"ID":"012c4453-2aa2-41d9-a331-73d989a53f6c","Type":"ContainerStarted","Data":"12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb"}
Jul 29 13:25:16.798555 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:16.798493    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:16.815727 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:16.815684    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx" podStartSLOduration=1.815670889 podStartE2EDuration="1.815670889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:25:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:25:16.813913318 +0000 UTC m=+3593.633964098" watchObservedRunningTime="2026-07-29 13:25:16.815670889 +0000 UTC m=+3593.635721665"
Jul 29 13:25:16.830244 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:16.830199    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb" podStartSLOduration=1.83018662 podStartE2EDuration="1.83018662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:25:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:25:16.829650859 +0000 UTC m=+3593.649701637" watchObservedRunningTime="2026-07-29 13:25:16.83018662 +0000 UTC m=+3593.650237686"
Jul 29 13:25:21.922756 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:21.922720    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:25:23.885043 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:23.885020    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:25:23.888051 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:23.888023    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:25:23.894823 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:23.894802    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:25:23.897622 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:23.897601    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:25:27.806487 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:27.806456    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:25:27.806870 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:27.806663    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:25:48.405415 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.405369    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"]
Jul 29 13:25:48.408919 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.408902    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.412396 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.412369    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-bb0da0\""
Jul 29 13:25:48.421529 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.421507    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"]
Jul 29 13:25:48.427159 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.427139    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"]
Jul 29 13:25:48.430364 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.430348    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.432651 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.432630    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-bb0da0-dockercfg-6qs4s\""
Jul 29 13:25:48.443684 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.443664    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"]
Jul 29 13:25:48.534928 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.534900    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.535063 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.534934    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b612df8f-b5e8-4667-8abe-630dec038eb9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.535063 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.534975    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjvd\" (UniqueName: \"kubernetes.io/projected/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-kube-api-access-vmjvd\") pod \"payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.535140 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.535088    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsp5p\" (UniqueName: \"kubernetes.io/projected/b612df8f-b5e8-4667-8abe-630dec038eb9-kube-api-access-qsp5p\") pod \"payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.635673 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.635648    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.635831 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.635679    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b612df8f-b5e8-4667-8abe-630dec038eb9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.635831 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.635708    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjvd\" (UniqueName: \"kubernetes.io/projected/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-kube-api-access-vmjvd\") pod \"payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.635831 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.635743    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsp5p\" (UniqueName: \"kubernetes.io/projected/b612df8f-b5e8-4667-8abe-630dec038eb9-kube-api-access-qsp5p\") pod \"payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.636394 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.636375    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b612df8f-b5e8-4667-8abe-630dec038eb9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.636444 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.636402    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.646706 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.646680    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsp5p\" (UniqueName: \"kubernetes.io/projected/b612df8f-b5e8-4667-8abe-630dec038eb9-kube-api-access-qsp5p\") pod \"payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.648177 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.648158    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjvd\" (UniqueName: \"kubernetes.io/projected/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-kube-api-access-vmjvd\") pod \"payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.718627 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.718572    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:48.740553 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.740530    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:48.866251 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.866110    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"]
Jul 29 13:25:48.868956 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:25:48.868928    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02cbfc5_4de7_42b8_864b_0dc4b092a15a.slice/crio-a1ba677b50d8c226f1ecf15afea6830f0ccb7d7233685d184453ca0b794c8e34 WatchSource:0}: Error finding container a1ba677b50d8c226f1ecf15afea6830f0ccb7d7233685d184453ca0b794c8e34: Status 404 returned error can't find the container with id a1ba677b50d8c226f1ecf15afea6830f0ccb7d7233685d184453ca0b794c8e34
Jul 29 13:25:48.890819 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.890795    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"]
Jul 29 13:25:48.892211 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:25:48.892172    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb612df8f_b5e8_4667_8abe_630dec038eb9.slice/crio-711c11d267c6cd4cbee80bdfda589eb0f3993fa767badbed7b0238eaebb121e8 WatchSource:0}: Error finding container 711c11d267c6cd4cbee80bdfda589eb0f3993fa767badbed7b0238eaebb121e8: Status 404 returned error can't find the container with id 711c11d267c6cd4cbee80bdfda589eb0f3993fa767badbed7b0238eaebb121e8
Jul 29 13:25:48.952856 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.952827    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr" event={"ID":"b612df8f-b5e8-4667-8abe-630dec038eb9","Type":"ContainerStarted","Data":"711c11d267c6cd4cbee80bdfda589eb0f3993fa767badbed7b0238eaebb121e8"}
Jul 29 13:25:48.954414 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:48.954390    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4" event={"ID":"d02cbfc5-4de7-42b8-864b-0dc4b092a15a","Type":"ContainerStarted","Data":"a1ba677b50d8c226f1ecf15afea6830f0ccb7d7233685d184453ca0b794c8e34"}
Jul 29 13:25:49.960188 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:49.960147    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr" event={"ID":"b612df8f-b5e8-4667-8abe-630dec038eb9","Type":"ContainerStarted","Data":"cf0cba64268724dad2a51804c6859266ec050d9e40a66a17e438a0125054d994"}
Jul 29 13:25:49.960713 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:49.960252    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:25:49.962270 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:49.962234    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4" event={"ID":"d02cbfc5-4de7-42b8-864b-0dc4b092a15a","Type":"ContainerStarted","Data":"c629f4d0a2e51471985becfbe659a244bfb4da45e07735953444a076a681d68d"}
Jul 29 13:25:49.962411 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:49.962354    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:25:49.982195 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:49.982151    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr" podStartSLOduration=1.982137831 podStartE2EDuration="1.982137831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:25:49.980686138 +0000 UTC m=+3626.800736915" watchObservedRunningTime="2026-07-29 13:25:49.982137831 +0000 UTC m=+3626.802188607"
Jul 29 13:25:50.001867 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:50.001830    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4" podStartSLOduration=2.001814327 podStartE2EDuration="2.001814327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:25:50.000724878 +0000 UTC m=+3626.820775655" watchObservedRunningTime="2026-07-29 13:25:50.001814327 +0000 UTC m=+3626.821865108"
Jul 29 13:25:51.558791 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:25:51.558752    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:26:00.969530 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:00.969443    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:26:00.970022 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:00.969664    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:26:19.403457 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:19.403426    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr_b612df8f-b5e8-4667-8abe-630dec038eb9/payload-processing/0.log"
Jul 29 13:26:21.763224 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.763192    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"]
Jul 29 13:26:21.766979 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.766963    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.769380 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.769358    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-86053a\"/\"openshift-service-ca.crt\""
Jul 29 13:26:21.770193 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.770169    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-86053a\"/\"ipp-route-86053a-kserve-self-signed-certs\""
Jul 29 13:26:21.770296 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.770204    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-86053a\"/\"kube-root-ca.crt\""
Jul 29 13:26:21.770296 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.770261    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-86053a\"/\"default-dockercfg-c4x96\""
Jul 29 13:26:21.775169 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.775146    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"]
Jul 29 13:26:21.813771 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.813739    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-home\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.813771 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.813769    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-model-cache\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.813945 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.813786    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/511b996e-ed72-43d5-8f8a-0ca70dcece81-tls-certs\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.813945 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.813829    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-dshm\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.813945 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.813892    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-tmp-dir\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.813945 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.813926    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhtcs\" (UniqueName: \"kubernetes.io/projected/511b996e-ed72-43d5-8f8a-0ca70dcece81-kube-api-access-dhtcs\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915218 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915181    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-tmp-dir\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915427 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915233    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhtcs\" (UniqueName: \"kubernetes.io/projected/511b996e-ed72-43d5-8f8a-0ca70dcece81-kube-api-access-dhtcs\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915427 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915285    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-home\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915427 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915337    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-model-cache\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915601 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915448    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/511b996e-ed72-43d5-8f8a-0ca70dcece81-tls-certs\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915601 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915498    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-dshm\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915601 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915584    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-tmp-dir\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915762 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915637    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-home\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.915762 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.915737    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-model-cache\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.917703 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.917681    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-dshm\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.917925 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.917908    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/511b996e-ed72-43d5-8f8a-0ca70dcece81-tls-certs\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:21.923445 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:21.923425    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhtcs\" (UniqueName: \"kubernetes.io/projected/511b996e-ed72-43d5-8f8a-0ca70dcece81-kube-api-access-dhtcs\") pod \"ipp-route-86053a-kserve-6785599899-wzplg\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") " pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:22.077942 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:22.077911    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:22.206873 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:22.206850    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"]
Jul 29 13:26:22.208706 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:26:22.208677    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod511b996e_ed72_43d5_8f8a_0ca70dcece81.slice/crio-506ed2d36c2057a06a9514638c64ba71ddc4d97e77122d72eb053290293213d4 WatchSource:0}: Error finding container 506ed2d36c2057a06a9514638c64ba71ddc4d97e77122d72eb053290293213d4: Status 404 returned error can't find the container with id 506ed2d36c2057a06a9514638c64ba71ddc4d97e77122d72eb053290293213d4
Jul 29 13:26:23.123562 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:23.123518    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg" event={"ID":"511b996e-ed72-43d5-8f8a-0ca70dcece81","Type":"ContainerStarted","Data":"22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c"}
Jul 29 13:26:23.124039 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:23.123572    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg" event={"ID":"511b996e-ed72-43d5-8f8a-0ca70dcece81","Type":"ContainerStarted","Data":"506ed2d36c2057a06a9514638c64ba71ddc4d97e77122d72eb053290293213d4"}
Jul 29 13:26:23.140507 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:23.140455    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg" podStartSLOduration=2.140439596 podStartE2EDuration="2.140439596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:26:23.139160576 +0000 UTC m=+3659.959211371" watchObservedRunningTime="2026-07-29 13:26:23.140439596 +0000 UTC m=+3659.960490423"
Jul 29 13:26:25.223331 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:25.223281    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:26:32.078064 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:32.078029    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:32.078567 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:32.078075    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:32.090606 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:32.090582    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:32.176151 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:32.176124    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:26:54.137576 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:26:54.137500    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:27:06.390355 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:06.390326    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx_7b7a41d1-af81-4e07-8668-0f9e5224394f/payload-processing/0.log"
Jul 29 13:27:06.647085 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:06.647008    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr_b612df8f-b5e8-4667-8abe-630dec038eb9/payload-processing/0.log"
Jul 29 13:27:11.109773 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.109740    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"]
Jul 29 13:27:11.113222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.113205    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.117008 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.116982    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-08bb55\""
Jul 29 13:27:11.117119 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.116986    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-08bb55-dockercfg-mq2q6\""
Jul 29 13:27:11.128401 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.128377    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"]
Jul 29 13:27:11.138351 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.138320    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ad5dada-addb-43eb-a32a-c0d249013781-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.138458 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.138359    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4gcw\" (UniqueName: \"kubernetes.io/projected/5ad5dada-addb-43eb-a32a-c0d249013781-kube-api-access-p4gcw\") pod \"payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.160096 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.160070    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"]
Jul 29 13:27:11.163461 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.163444    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.174737 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.174716    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"]
Jul 29 13:27:11.239790 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.239755    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs4d7\" (UniqueName: \"kubernetes.io/projected/7f405e91-69a8-4e55-a1b1-b58ec821d65f-kube-api-access-qs4d7\") pod \"payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.239947 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.239820    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ad5dada-addb-43eb-a32a-c0d249013781-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.239947 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.239838    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4gcw\" (UniqueName: \"kubernetes.io/projected/5ad5dada-addb-43eb-a32a-c0d249013781-kube-api-access-p4gcw\") pod \"payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.239947 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.239857    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f405e91-69a8-4e55-a1b1-b58ec821d65f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.240566 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.240546    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ad5dada-addb-43eb-a32a-c0d249013781-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.248630 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.248608    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4gcw\" (UniqueName: \"kubernetes.io/projected/5ad5dada-addb-43eb-a32a-c0d249013781-kube-api-access-p4gcw\") pod \"payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.340231 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.340197    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs4d7\" (UniqueName: \"kubernetes.io/projected/7f405e91-69a8-4e55-a1b1-b58ec821d65f-kube-api-access-qs4d7\") pod \"payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.340394 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.340256    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f405e91-69a8-4e55-a1b1-b58ec821d65f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.340922 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.340902    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f405e91-69a8-4e55-a1b1-b58ec821d65f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.348883 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.348854    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs4d7\" (UniqueName: \"kubernetes.io/projected/7f405e91-69a8-4e55-a1b1-b58ec821d65f-kube-api-access-qs4d7\") pod \"payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.423875 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.423811    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:11.473786 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.473205    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:11.569447 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.569058    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"]
Jul 29 13:27:11.572134 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:27:11.571844    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad5dada_addb_43eb_a32a_c0d249013781.slice/crio-5fe686a762e89d5dc4018d42de309f33b3192fbef1ae30e88b6971cb04fe4901 WatchSource:0}: Error finding container 5fe686a762e89d5dc4018d42de309f33b3192fbef1ae30e88b6971cb04fe4901: Status 404 returned error can't find the container with id 5fe686a762e89d5dc4018d42de309f33b3192fbef1ae30e88b6971cb04fe4901
Jul 29 13:27:11.625775 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:11.625750    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"]
Jul 29 13:27:11.628057 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:27:11.628021    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f405e91_69a8_4e55_a1b1_b58ec821d65f.slice/crio-a9b7bddf45c3015787f01fe4f5b92743983552efb72ea76794e7d6906fe8d71c WatchSource:0}: Error finding container a9b7bddf45c3015787f01fe4f5b92743983552efb72ea76794e7d6906fe8d71c: Status 404 returned error can't find the container with id a9b7bddf45c3015787f01fe4f5b92743983552efb72ea76794e7d6906fe8d71c
Jul 29 13:27:12.358018 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.357984    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2" event={"ID":"5ad5dada-addb-43eb-a32a-c0d249013781","Type":"ContainerStarted","Data":"e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d"}
Jul 29 13:27:12.358579 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.358034    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2" event={"ID":"5ad5dada-addb-43eb-a32a-c0d249013781","Type":"ContainerStarted","Data":"5fe686a762e89d5dc4018d42de309f33b3192fbef1ae30e88b6971cb04fe4901"}
Jul 29 13:27:12.358579 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.358169    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:12.359546 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.359524    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj" event={"ID":"7f405e91-69a8-4e55-a1b1-b58ec821d65f","Type":"ContainerStarted","Data":"9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786"}
Jul 29 13:27:12.359654 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.359570    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj" event={"ID":"7f405e91-69a8-4e55-a1b1-b58ec821d65f","Type":"ContainerStarted","Data":"a9b7bddf45c3015787f01fe4f5b92743983552efb72ea76794e7d6906fe8d71c"}
Jul 29 13:27:12.359654 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.359603    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:12.375405 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.375359    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2" podStartSLOduration=1.375342815 podStartE2EDuration="1.375342815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:27:12.373657848 +0000 UTC m=+3709.193708626" watchObservedRunningTime="2026-07-29 13:27:12.375342815 +0000 UTC m=+3709.195393586"
Jul 29 13:27:12.389880 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:12.389838    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj" podStartSLOduration=1.3898257809999999 podStartE2EDuration="1.389825781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:27:12.388858452 +0000 UTC m=+3709.208909231" watchObservedRunningTime="2026-07-29 13:27:12.389825781 +0000 UTC m=+3709.209876554"
Jul 29 13:27:22.828342 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:22.828294    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:27:23.367865 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:23.367831    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:23.368041 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:23.368007    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:40.899367 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:40.899304    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"]
Jul 29 13:27:40.899774 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:40.899581    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2" podUID="5ad5dada-addb-43eb-a32a-c0d249013781" containerName="payload-processing" containerID="cri-o://e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d" gracePeriod=30
Jul 29 13:27:40.906215 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:40.906191    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"]
Jul 29 13:27:40.906440 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:40.906414    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj" podUID="7f405e91-69a8-4e55-a1b1-b58ec821d65f" containerName="payload-pre-processing" containerID="cri-o://9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786" gracePeriod=30
Jul 29 13:27:41.179417 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.179392    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:41.182250 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.182229    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:41.309908 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.309882    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4gcw\" (UniqueName: \"kubernetes.io/projected/5ad5dada-addb-43eb-a32a-c0d249013781-kube-api-access-p4gcw\") pod \"5ad5dada-addb-43eb-a32a-c0d249013781\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") "
Jul 29 13:27:41.310074 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.309959    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs4d7\" (UniqueName: \"kubernetes.io/projected/7f405e91-69a8-4e55-a1b1-b58ec821d65f-kube-api-access-qs4d7\") pod \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") "
Jul 29 13:27:41.310074 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.309988    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ad5dada-addb-43eb-a32a-c0d249013781-plugins-config-volume\") pod \"5ad5dada-addb-43eb-a32a-c0d249013781\" (UID: \"5ad5dada-addb-43eb-a32a-c0d249013781\") "
Jul 29 13:27:41.310074 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.310037    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f405e91-69a8-4e55-a1b1-b58ec821d65f-plugins-config-volume\") pod \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\" (UID: \"7f405e91-69a8-4e55-a1b1-b58ec821d65f\") "
Jul 29 13:27:41.310425 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.310393    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ad5dada-addb-43eb-a32a-c0d249013781-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ad5dada-addb-43eb-a32a-c0d249013781" (UID: "5ad5dada-addb-43eb-a32a-c0d249013781"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 13:27:41.310503 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.310433    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f405e91-69a8-4e55-a1b1-b58ec821d65f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f405e91-69a8-4e55-a1b1-b58ec821d65f" (UID: "7f405e91-69a8-4e55-a1b1-b58ec821d65f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 13:27:41.312145 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.312123    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f405e91-69a8-4e55-a1b1-b58ec821d65f-kube-api-access-qs4d7" (OuterVolumeSpecName: "kube-api-access-qs4d7") pod "7f405e91-69a8-4e55-a1b1-b58ec821d65f" (UID: "7f405e91-69a8-4e55-a1b1-b58ec821d65f"). InnerVolumeSpecName "kube-api-access-qs4d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:27:41.312198 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.312128    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad5dada-addb-43eb-a32a-c0d249013781-kube-api-access-p4gcw" (OuterVolumeSpecName: "kube-api-access-p4gcw") pod "5ad5dada-addb-43eb-a32a-c0d249013781" (UID: "5ad5dada-addb-43eb-a32a-c0d249013781"). InnerVolumeSpecName "kube-api-access-p4gcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:27:41.410702 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.410622    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f405e91-69a8-4e55-a1b1-b58ec821d65f-plugins-config-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:27:41.410702 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.410652    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4gcw\" (UniqueName: \"kubernetes.io/projected/5ad5dada-addb-43eb-a32a-c0d249013781-kube-api-access-p4gcw\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:27:41.410702 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.410662    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs4d7\" (UniqueName: \"kubernetes.io/projected/7f405e91-69a8-4e55-a1b1-b58ec821d65f-kube-api-access-qs4d7\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:27:41.410702 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.410672    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ad5dada-addb-43eb-a32a-c0d249013781-plugins-config-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:27:41.506266 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.506225    2549 generic.go:356] "Generic (PLEG): container finished" podID="5ad5dada-addb-43eb-a32a-c0d249013781" containerID="e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d" exitCode=0
Jul 29 13:27:41.506475 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.506275    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"
Jul 29 13:27:41.506475 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.506329    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2" event={"ID":"5ad5dada-addb-43eb-a32a-c0d249013781","Type":"ContainerDied","Data":"e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d"}
Jul 29 13:27:41.506475 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.506432    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2" event={"ID":"5ad5dada-addb-43eb-a32a-c0d249013781","Type":"ContainerDied","Data":"5fe686a762e89d5dc4018d42de309f33b3192fbef1ae30e88b6971cb04fe4901"}
Jul 29 13:27:41.506475 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.506463    2549 scope.go:117] "RemoveContainer" containerID="e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d"
Jul 29 13:27:41.507729 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.507705    2549 generic.go:356] "Generic (PLEG): container finished" podID="7f405e91-69a8-4e55-a1b1-b58ec821d65f" containerID="9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786" exitCode=0
Jul 29 13:27:41.507814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.507744    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"
Jul 29 13:27:41.507814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.507756    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj" event={"ID":"7f405e91-69a8-4e55-a1b1-b58ec821d65f","Type":"ContainerDied","Data":"9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786"}
Jul 29 13:27:41.507814 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.507802    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj" event={"ID":"7f405e91-69a8-4e55-a1b1-b58ec821d65f","Type":"ContainerDied","Data":"a9b7bddf45c3015787f01fe4f5b92743983552efb72ea76794e7d6906fe8d71c"}
Jul 29 13:27:41.515968 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.515946    2549 scope.go:117] "RemoveContainer" containerID="e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d"
Jul 29 13:27:41.516234 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:27:41.516211    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d\": container with ID starting with e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d not found: ID does not exist" containerID="e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d"
Jul 29 13:27:41.516291 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.516250    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d"} err="failed to get container status \"e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d\": rpc error: code = NotFound desc = could not find container \"e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d\": container with ID starting with e91977c897320625cb504f1d502a3224a1b2e3622fcaca1cf3a54af9d1b5482d not found: ID does not exist"
Jul 29 13:27:41.516291 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.516268    2549 scope.go:117] "RemoveContainer" containerID="9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786"
Jul 29 13:27:41.524270 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.524254    2549 scope.go:117] "RemoveContainer" containerID="9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786"
Jul 29 13:27:41.524526 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:27:41.524506    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786\": container with ID starting with 9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786 not found: ID does not exist" containerID="9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786"
Jul 29 13:27:41.524617 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.524530    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786"} err="failed to get container status \"9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786\": rpc error: code = NotFound desc = could not find container \"9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786\": container with ID starting with 9ee8b361971cf8b3e738bc191fa17d85710372b2620c89d66f768466ca9c9786 not found: ID does not exist"
Jul 29 13:27:41.530202 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.530180    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"]
Jul 29 13:27:41.533858 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.533837    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-08bb55-78599c5fbd-6zxx2"]
Jul 29 13:27:41.546982 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.546962    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"]
Jul 29 13:27:41.550442 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.550423    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-08bb55-854d6747f6-xhmcj"]
Jul 29 13:27:41.698267 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.698189    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ad5dada-addb-43eb-a32a-c0d249013781" path="/var/lib/kubelet/pods/5ad5dada-addb-43eb-a32a-c0d249013781/volumes"
Jul 29 13:27:41.698593 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:41.698578    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f405e91-69a8-4e55-a1b1-b58ec821d65f" path="/var/lib/kubelet/pods/7f405e91-69a8-4e55-a1b1-b58ec821d65f/volumes"
Jul 29 13:27:45.222476 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:27:45.222439    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:28:06.821783 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:06.821745    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:28:07.204091 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.203998    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"]
Jul 29 13:28:07.204263 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.204202    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx" podUID="7b7a41d1-af81-4e07-8668-0f9e5224394f" containerName="payload-processing" containerID="cri-o://7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0" gracePeriod=30
Jul 29 13:28:07.209305 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.209272    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"]
Jul 29 13:28:07.209594 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.209544    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb" podUID="012c4453-2aa2-41d9-a331-73d989a53f6c" containerName="payload-pre-processing" containerID="cri-o://12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb" gracePeriod=30
Jul 29 13:28:07.490460 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.490427    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:28:07.493216 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.493186    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:28:07.538997 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.538966    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv6lz\" (UniqueName: \"kubernetes.io/projected/012c4453-2aa2-41d9-a331-73d989a53f6c-kube-api-access-fv6lz\") pod \"012c4453-2aa2-41d9-a331-73d989a53f6c\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") "
Jul 29 13:28:07.539159 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.539015    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/012c4453-2aa2-41d9-a331-73d989a53f6c-plugins-config-volume\") pod \"012c4453-2aa2-41d9-a331-73d989a53f6c\" (UID: \"012c4453-2aa2-41d9-a331-73d989a53f6c\") "
Jul 29 13:28:07.539159 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.539076    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7a41d1-af81-4e07-8668-0f9e5224394f-plugins-config-volume\") pod \"7b7a41d1-af81-4e07-8668-0f9e5224394f\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") "
Jul 29 13:28:07.539159 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.539099    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmlfr\" (UniqueName: \"kubernetes.io/projected/7b7a41d1-af81-4e07-8668-0f9e5224394f-kube-api-access-jmlfr\") pod \"7b7a41d1-af81-4e07-8668-0f9e5224394f\" (UID: \"7b7a41d1-af81-4e07-8668-0f9e5224394f\") "
Jul 29 13:28:07.539491 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.539466    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/012c4453-2aa2-41d9-a331-73d989a53f6c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "012c4453-2aa2-41d9-a331-73d989a53f6c" (UID: "012c4453-2aa2-41d9-a331-73d989a53f6c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 13:28:07.539562 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.539535    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b7a41d1-af81-4e07-8668-0f9e5224394f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b7a41d1-af81-4e07-8668-0f9e5224394f" (UID: "7b7a41d1-af81-4e07-8668-0f9e5224394f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 13:28:07.541177 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.541153    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012c4453-2aa2-41d9-a331-73d989a53f6c-kube-api-access-fv6lz" (OuterVolumeSpecName: "kube-api-access-fv6lz") pod "012c4453-2aa2-41d9-a331-73d989a53f6c" (UID: "012c4453-2aa2-41d9-a331-73d989a53f6c"). InnerVolumeSpecName "kube-api-access-fv6lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:28:07.541281 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.541234    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b7a41d1-af81-4e07-8668-0f9e5224394f-kube-api-access-jmlfr" (OuterVolumeSpecName: "kube-api-access-jmlfr") pod "7b7a41d1-af81-4e07-8668-0f9e5224394f" (UID: "7b7a41d1-af81-4e07-8668-0f9e5224394f"). InnerVolumeSpecName "kube-api-access-jmlfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:28:07.639845 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.639810    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv6lz\" (UniqueName: \"kubernetes.io/projected/012c4453-2aa2-41d9-a331-73d989a53f6c-kube-api-access-fv6lz\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:07.639845 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.639838    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/012c4453-2aa2-41d9-a331-73d989a53f6c-plugins-config-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:07.639845 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.639849    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b7a41d1-af81-4e07-8668-0f9e5224394f-plugins-config-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:07.640170 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.639858    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmlfr\" (UniqueName: \"kubernetes.io/projected/7b7a41d1-af81-4e07-8668-0f9e5224394f-kube-api-access-jmlfr\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:07.645104 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.645074    2549 generic.go:356] "Generic (PLEG): container finished" podID="012c4453-2aa2-41d9-a331-73d989a53f6c" containerID="12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb" exitCode=0
Jul 29 13:28:07.645266 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.645127    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"
Jul 29 13:28:07.645266 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.645162    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb" event={"ID":"012c4453-2aa2-41d9-a331-73d989a53f6c","Type":"ContainerDied","Data":"12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb"}
Jul 29 13:28:07.645266 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.645210    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb" event={"ID":"012c4453-2aa2-41d9-a331-73d989a53f6c","Type":"ContainerDied","Data":"c015e1db265d6accffe4d6569a629ee7c63707631a00e86199108e2b9b612593"}
Jul 29 13:28:07.645266 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.645238    2549 scope.go:117] "RemoveContainer" containerID="12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb"
Jul 29 13:28:07.646546 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.646526    2549 generic.go:356] "Generic (PLEG): container finished" podID="7b7a41d1-af81-4e07-8668-0f9e5224394f" containerID="7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0" exitCode=0
Jul 29 13:28:07.646649 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.646556    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx" event={"ID":"7b7a41d1-af81-4e07-8668-0f9e5224394f","Type":"ContainerDied","Data":"7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0"}
Jul 29 13:28:07.646649 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.646576    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"
Jul 29 13:28:07.646649 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.646597    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx" event={"ID":"7b7a41d1-af81-4e07-8668-0f9e5224394f","Type":"ContainerDied","Data":"644600c5e3abf6a3eaf39a019bca0427d48eeb8708ad10851b75919536304548"}
Jul 29 13:28:07.655223 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.655207    2549 scope.go:117] "RemoveContainer" containerID="12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb"
Jul 29 13:28:07.655588 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:28:07.655501    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb\": container with ID starting with 12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb not found: ID does not exist" containerID="12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb"
Jul 29 13:28:07.655588 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.655529    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb"} err="failed to get container status \"12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb\": rpc error: code = NotFound desc = could not find container \"12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb\": container with ID starting with 12074e0fd95a8a3aab62fd6fa327cae66d4a843720509527d17146afcb19bffb not found: ID does not exist"
Jul 29 13:28:07.655588 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.655545    2549 scope.go:117] "RemoveContainer" containerID="7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0"
Jul 29 13:28:07.663653 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.663635    2549 scope.go:117] "RemoveContainer" containerID="7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0"
Jul 29 13:28:07.663925 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:28:07.663905    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0\": container with ID starting with 7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0 not found: ID does not exist" containerID="7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0"
Jul 29 13:28:07.663978 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.663941    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0"} err="failed to get container status \"7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0\": rpc error: code = NotFound desc = could not find container \"7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0\": container with ID starting with 7c50cd6bc79541005144e21709b1a8b48b7b64248b8be11ca328df452c0dcbf0 not found: ID does not exist"
Jul 29 13:28:07.671632 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.671605    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"]
Jul 29 13:28:07.675766 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.675745    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-86053a-645466d6d4-tslvx"]
Jul 29 13:28:07.688712 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.688683    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"]
Jul 29 13:28:07.697407 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.697383    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b7a41d1-af81-4e07-8668-0f9e5224394f" path="/var/lib/kubelet/pods/7b7a41d1-af81-4e07-8668-0f9e5224394f/volumes"
Jul 29 13:28:07.697652 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:07.697639    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-86053a-5c87d4679b-nsdqb"]
Jul 29 13:28:09.696839 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:09.696806    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="012c4453-2aa2-41d9-a331-73d989a53f6c" path="/var/lib/kubelet/pods/012c4453-2aa2-41d9-a331-73d989a53f6c/volumes"
Jul 29 13:28:12.715571 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:12.715537    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"]
Jul 29 13:28:17.223738 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:17.223652    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:28:27.734815 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:27.734760    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg" podUID="511b996e-ed72-43d5-8f8a-0ca70dcece81" containerName="main" containerID="cri-o://22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c" gracePeriod=45
Jul 29 13:28:27.983505 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:27.983482    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:28:28.122122 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122091    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-model-cache\") pod \"511b996e-ed72-43d5-8f8a-0ca70dcece81\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") "
Jul 29 13:28:28.122336 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122162    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/511b996e-ed72-43d5-8f8a-0ca70dcece81-tls-certs\") pod \"511b996e-ed72-43d5-8f8a-0ca70dcece81\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") "
Jul 29 13:28:28.122336 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122190    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhtcs\" (UniqueName: \"kubernetes.io/projected/511b996e-ed72-43d5-8f8a-0ca70dcece81-kube-api-access-dhtcs\") pod \"511b996e-ed72-43d5-8f8a-0ca70dcece81\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") "
Jul 29 13:28:28.122336 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122210    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-home\") pod \"511b996e-ed72-43d5-8f8a-0ca70dcece81\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") "
Jul 29 13:28:28.122336 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122227    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-dshm\") pod \"511b996e-ed72-43d5-8f8a-0ca70dcece81\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") "
Jul 29 13:28:28.122554 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122336    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-tmp-dir\") pod \"511b996e-ed72-43d5-8f8a-0ca70dcece81\" (UID: \"511b996e-ed72-43d5-8f8a-0ca70dcece81\") "
Jul 29 13:28:28.122554 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122411    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-model-cache" (OuterVolumeSpecName: "model-cache") pod "511b996e-ed72-43d5-8f8a-0ca70dcece81" (UID: "511b996e-ed72-43d5-8f8a-0ca70dcece81"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:28:28.122626 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122539    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-home" (OuterVolumeSpecName: "home") pod "511b996e-ed72-43d5-8f8a-0ca70dcece81" (UID: "511b996e-ed72-43d5-8f8a-0ca70dcece81"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:28:28.122626 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122597    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "511b996e-ed72-43d5-8f8a-0ca70dcece81" (UID: "511b996e-ed72-43d5-8f8a-0ca70dcece81"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:28:28.122691 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122655    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-home\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:28.122691 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.122677    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-model-cache\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:28.124460 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.124428    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-dshm" (OuterVolumeSpecName: "dshm") pod "511b996e-ed72-43d5-8f8a-0ca70dcece81" (UID: "511b996e-ed72-43d5-8f8a-0ca70dcece81"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 13:28:28.124572 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.124490    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/511b996e-ed72-43d5-8f8a-0ca70dcece81-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "511b996e-ed72-43d5-8f8a-0ca70dcece81" (UID: "511b996e-ed72-43d5-8f8a-0ca70dcece81"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 13:28:28.124572 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.124531    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/511b996e-ed72-43d5-8f8a-0ca70dcece81-kube-api-access-dhtcs" (OuterVolumeSpecName: "kube-api-access-dhtcs") pod "511b996e-ed72-43d5-8f8a-0ca70dcece81" (UID: "511b996e-ed72-43d5-8f8a-0ca70dcece81"). InnerVolumeSpecName "kube-api-access-dhtcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:28:28.224024 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.223994    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-tmp-dir\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:28.224024 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.224018    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/511b996e-ed72-43d5-8f8a-0ca70dcece81-tls-certs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:28.224024 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.224027    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhtcs\" (UniqueName: \"kubernetes.io/projected/511b996e-ed72-43d5-8f8a-0ca70dcece81-kube-api-access-dhtcs\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:28.224222 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.224035    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/511b996e-ed72-43d5-8f8a-0ca70dcece81-dshm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:28:28.753216 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.753180    2549 generic.go:356] "Generic (PLEG): container finished" podID="511b996e-ed72-43d5-8f8a-0ca70dcece81" containerID="22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c" exitCode=0
Jul 29 13:28:28.753650 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.753239    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"
Jul 29 13:28:28.753650 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.753265    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg" event={"ID":"511b996e-ed72-43d5-8f8a-0ca70dcece81","Type":"ContainerDied","Data":"22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c"}
Jul 29 13:28:28.753650 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.753322    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg" event={"ID":"511b996e-ed72-43d5-8f8a-0ca70dcece81","Type":"ContainerDied","Data":"506ed2d36c2057a06a9514638c64ba71ddc4d97e77122d72eb053290293213d4"}
Jul 29 13:28:28.753650 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.753329    2549 scope.go:117] "RemoveContainer" containerID="22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c"
Jul 29 13:28:28.762836 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.762819    2549 scope.go:117] "RemoveContainer" containerID="22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c"
Jul 29 13:28:28.763078 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:28:28.763060    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c\": container with ID starting with 22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c not found: ID does not exist" containerID="22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c"
Jul 29 13:28:28.763122 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.763087    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c"} err="failed to get container status \"22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c\": rpc error: code = NotFound desc = could not find container \"22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c\": container with ID starting with 22ebe58ecb792c2c4bcdbc5abd5a4e8839f7046a2d9159875c8fc2796c7ca76c not found: ID does not exist"
Jul 29 13:28:28.775347 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.775322    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"]
Jul 29 13:28:28.778932 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:28.778912    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-86053a/ipp-route-86053a-kserve-6785599899-wzplg"]
Jul 29 13:28:29.697084 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:28:29.697045    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="511b996e-ed72-43d5-8f8a-0ca70dcece81" path="/var/lib/kubelet/pods/511b996e-ed72-43d5-8f8a-0ca70dcece81/volumes"
Jul 29 13:29:06.685764 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.685728    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"]
Jul 29 13:29:06.686323 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.685938    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr" podUID="b612df8f-b5e8-4667-8abe-630dec038eb9" containerName="payload-processing" containerID="cri-o://cf0cba64268724dad2a51804c6859266ec050d9e40a66a17e438a0125054d994" gracePeriod=30
Jul 29 13:29:06.695443 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.695410    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"]
Jul 29 13:29:06.695750 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.695667    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4" podUID="d02cbfc5-4de7-42b8-864b-0dc4b092a15a" containerName="payload-pre-processing" containerID="cri-o://c629f4d0a2e51471985becfbe659a244bfb4da45e07735953444a076a681d68d" gracePeriod=30
Jul 29 13:29:06.934953 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.934916    2549 generic.go:356] "Generic (PLEG): container finished" podID="d02cbfc5-4de7-42b8-864b-0dc4b092a15a" containerID="c629f4d0a2e51471985becfbe659a244bfb4da45e07735953444a076a681d68d" exitCode=0
Jul 29 13:29:06.935122 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.934979    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4" event={"ID":"d02cbfc5-4de7-42b8-864b-0dc4b092a15a","Type":"ContainerDied","Data":"c629f4d0a2e51471985becfbe659a244bfb4da45e07735953444a076a681d68d"}
Jul 29 13:29:06.936817 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.936747    2549 generic.go:356] "Generic (PLEG): container finished" podID="b612df8f-b5e8-4667-8abe-630dec038eb9" containerID="cf0cba64268724dad2a51804c6859266ec050d9e40a66a17e438a0125054d994" exitCode=0
Jul 29 13:29:06.936817 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.936782    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr" event={"ID":"b612df8f-b5e8-4667-8abe-630dec038eb9","Type":"ContainerDied","Data":"cf0cba64268724dad2a51804c6859266ec050d9e40a66a17e438a0125054d994"}
Jul 29 13:29:06.970452 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.970425    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:29:06.973208 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:06.973187    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:29:07.038036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.037999    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b612df8f-b5e8-4667-8abe-630dec038eb9-plugins-config-volume\") pod \"b612df8f-b5e8-4667-8abe-630dec038eb9\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") "
Jul 29 13:29:07.038036 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.038044    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-plugins-config-volume\") pod \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") "
Jul 29 13:29:07.038241 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.038090    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmjvd\" (UniqueName: \"kubernetes.io/projected/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-kube-api-access-vmjvd\") pod \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\" (UID: \"d02cbfc5-4de7-42b8-864b-0dc4b092a15a\") "
Jul 29 13:29:07.038241 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.038122    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsp5p\" (UniqueName: \"kubernetes.io/projected/b612df8f-b5e8-4667-8abe-630dec038eb9-kube-api-access-qsp5p\") pod \"b612df8f-b5e8-4667-8abe-630dec038eb9\" (UID: \"b612df8f-b5e8-4667-8abe-630dec038eb9\") "
Jul 29 13:29:07.038478 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.038452    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b612df8f-b5e8-4667-8abe-630dec038eb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b612df8f-b5e8-4667-8abe-630dec038eb9" (UID: "b612df8f-b5e8-4667-8abe-630dec038eb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 13:29:07.038561 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.038537    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d02cbfc5-4de7-42b8-864b-0dc4b092a15a" (UID: "d02cbfc5-4de7-42b8-864b-0dc4b092a15a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 13:29:07.040443 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.040420    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-kube-api-access-vmjvd" (OuterVolumeSpecName: "kube-api-access-vmjvd") pod "d02cbfc5-4de7-42b8-864b-0dc4b092a15a" (UID: "d02cbfc5-4de7-42b8-864b-0dc4b092a15a"). InnerVolumeSpecName "kube-api-access-vmjvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:29:07.040543 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.040460    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b612df8f-b5e8-4667-8abe-630dec038eb9-kube-api-access-qsp5p" (OuterVolumeSpecName: "kube-api-access-qsp5p") pod "b612df8f-b5e8-4667-8abe-630dec038eb9" (UID: "b612df8f-b5e8-4667-8abe-630dec038eb9"). InnerVolumeSpecName "kube-api-access-qsp5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:29:07.138886 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.138832    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b612df8f-b5e8-4667-8abe-630dec038eb9-plugins-config-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:29:07.138886 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.138879    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-plugins-config-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:29:07.138886 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.138888    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmjvd\" (UniqueName: \"kubernetes.io/projected/d02cbfc5-4de7-42b8-864b-0dc4b092a15a-kube-api-access-vmjvd\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:29:07.138886 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.138898    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsp5p\" (UniqueName: \"kubernetes.io/projected/b612df8f-b5e8-4667-8abe-630dec038eb9-kube-api-access-qsp5p\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:29:07.943225 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.943169    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"
Jul 29 13:29:07.943725 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.943174    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr" event={"ID":"b612df8f-b5e8-4667-8abe-630dec038eb9","Type":"ContainerDied","Data":"711c11d267c6cd4cbee80bdfda589eb0f3993fa767badbed7b0238eaebb121e8"}
Jul 29 13:29:07.943725 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.943344    2549 scope.go:117] "RemoveContainer" containerID="cf0cba64268724dad2a51804c6859266ec050d9e40a66a17e438a0125054d994"
Jul 29 13:29:07.944624 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.944559    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"
Jul 29 13:29:07.944704 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.944558    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4" event={"ID":"d02cbfc5-4de7-42b8-864b-0dc4b092a15a","Type":"ContainerDied","Data":"a1ba677b50d8c226f1ecf15afea6830f0ccb7d7233685d184453ca0b794c8e34"}
Jul 29 13:29:07.952204 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.952185    2549 scope.go:117] "RemoveContainer" containerID="c629f4d0a2e51471985becfbe659a244bfb4da45e07735953444a076a681d68d"
Jul 29 13:29:07.964985 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.964958    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"]
Jul 29 13:29:07.966474 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.966453    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bb0da0-567c789d74-mrqfr"]
Jul 29 13:29:07.980451 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.980426    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"]
Jul 29 13:29:07.987571 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:07.987551    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-bb0da0-7745b55876-tbfw4"]
Jul 29 13:29:09.696672 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:09.696632    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b612df8f-b5e8-4667-8abe-630dec038eb9" path="/var/lib/kubelet/pods/b612df8f-b5e8-4667-8abe-630dec038eb9/volumes"
Jul 29 13:29:09.697178 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:09.697157    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d02cbfc5-4de7-42b8-864b-0dc4b092a15a" path="/var/lib/kubelet/pods/d02cbfc5-4de7-42b8-864b-0dc4b092a15a/volumes"
Jul 29 13:29:09.718685 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:09.718654    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:29:27.524942 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:27.524901    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:29:42.321788 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.321754    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"]
Jul 29 13:29:42.322388 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.322016    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6" podUID="8101aa61-df6f-427f-9a71-6e42f6a4762c" containerName="payload-processing" containerID="cri-o://99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f" gracePeriod=30
Jul 29 13:29:42.575054 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.574983    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:29:42.750569 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.750533    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpwp7\" (UniqueName: \"kubernetes.io/projected/8101aa61-df6f-427f-9a71-6e42f6a4762c-kube-api-access-jpwp7\") pod \"8101aa61-df6f-427f-9a71-6e42f6a4762c\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") "
Jul 29 13:29:42.750773 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.750601    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8101aa61-df6f-427f-9a71-6e42f6a4762c-plugins-config-volume\") pod \"8101aa61-df6f-427f-9a71-6e42f6a4762c\" (UID: \"8101aa61-df6f-427f-9a71-6e42f6a4762c\") "
Jul 29 13:29:42.750977 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.750949    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8101aa61-df6f-427f-9a71-6e42f6a4762c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8101aa61-df6f-427f-9a71-6e42f6a4762c" (UID: "8101aa61-df6f-427f-9a71-6e42f6a4762c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 13:29:42.752660 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.752637    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8101aa61-df6f-427f-9a71-6e42f6a4762c-kube-api-access-jpwp7" (OuterVolumeSpecName: "kube-api-access-jpwp7") pod "8101aa61-df6f-427f-9a71-6e42f6a4762c" (UID: "8101aa61-df6f-427f-9a71-6e42f6a4762c"). InnerVolumeSpecName "kube-api-access-jpwp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 13:29:42.851560 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.851483    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8101aa61-df6f-427f-9a71-6e42f6a4762c-plugins-config-volume\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:29:42.851560 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:42.851515    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpwp7\" (UniqueName: \"kubernetes.io/projected/8101aa61-df6f-427f-9a71-6e42f6a4762c-kube-api-access-jpwp7\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\""
Jul 29 13:29:43.108497 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.108405    2549 generic.go:356] "Generic (PLEG): container finished" podID="8101aa61-df6f-427f-9a71-6e42f6a4762c" containerID="99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f" exitCode=0
Jul 29 13:29:43.108497 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.108454    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"
Jul 29 13:29:43.108688 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.108491    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6" event={"ID":"8101aa61-df6f-427f-9a71-6e42f6a4762c","Type":"ContainerDied","Data":"99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f"}
Jul 29 13:29:43.108688 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.108548    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6" event={"ID":"8101aa61-df6f-427f-9a71-6e42f6a4762c","Type":"ContainerDied","Data":"b2dbf9a214b4c2fb3aa3a336b0cc6e1bf8792b4442b50291328390f08dcbffe9"}
Jul 29 13:29:43.108688 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.108571    2549 scope.go:117] "RemoveContainer" containerID="99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f"
Jul 29 13:29:43.117143 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.117127    2549 scope.go:117] "RemoveContainer" containerID="99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f"
Jul 29 13:29:43.117506 ip-10-0-142-162 kubenswrapper[2549]: E0729 13:29:43.117487    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f\": container with ID starting with 99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f not found: ID does not exist" containerID="99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f"
Jul 29 13:29:43.117580 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.117517    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f"} err="failed to get container status \"99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f\": rpc error: code = NotFound desc = could not find container \"99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f\": container with ID starting with 99c4740534ed4702dab9e0899deda3d5be0959e4d92c40e2bde9977e9808111f not found: ID does not exist"
Jul 29 13:29:43.129301 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.129280    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"]
Jul 29 13:29:43.133582 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.133559    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-11a904-59476cc6c4-46ps6"]
Jul 29 13:29:43.696684 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:43.696654    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8101aa61-df6f-427f-9a71-6e42f6a4762c" path="/var/lib/kubelet/pods/8101aa61-df6f-427f-9a71-6e42f6a4762c/volumes"
Jul 29 13:29:45.232609 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:45.232517    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sbzpl"]
Jul 29 13:29:50.897033 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:50.897000    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79c5f5f6f8-z4cgf_9e62e253-19b6-4fb9-bb1d-49ca9d1cd114/authorino/0.log"
Jul 29 13:29:57.386832 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:57.386804    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556f8bf875-z5plj_8ab25446-1663-4c1b-b280-96ddc45eb9d7/copy-manifests/0.log"
Jul 29 13:29:57.393929 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:57.393906    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556f8bf875-z5plj_8ab25446-1663-4c1b-b280-96ddc45eb9d7/manager/0.log"
Jul 29 13:29:59.686908 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:29:59.686877    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79c5f5f6f8-z4cgf_9e62e253-19b6-4fb9-bb1d-49ca9d1cd114/authorino/0.log"
Jul 29 13:30:00.074026 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:00.073994    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fn2cd_9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab/kuadrant-console-plugin/0.log"
Jul 29 13:30:00.499549 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:00.499469    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sbzpl_6c1ac2f3-7da3-463c-b839-e81246a017fa/limitador/0.log"
Jul 29 13:30:01.259992 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:01.259958    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bb9c5fc49-6h4sq_896a5175-d6b1-4e6d-96a4-01d8f255b98d/kube-auth-proxy/0.log"
Jul 29 13:30:01.878465 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:01.878431    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6999b477-zzhch_a8a6840f-d7d1-47b6-951f-a8f9b222e3db/router/0.log"
Jul 29 13:30:02.552002 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:02.551969    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5664_28cf3f41-2e56-4f16-997e-b0c4e7c6b244/main/0.log"
Jul 29 13:30:02.772771 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:02.772738    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-9zjdl_bff98e58-7e03-40d5-b09c-7ca3a5ced1e5/main/0.log"
Jul 29 13:30:08.401770 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.401730    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gv8zd/must-gather-vdz6r"]
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402072    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b612df8f-b5e8-4667-8abe-630dec038eb9" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402084    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b612df8f-b5e8-4667-8abe-630dec038eb9" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402094    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8101aa61-df6f-427f-9a71-6e42f6a4762c" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402100    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8101aa61-df6f-427f-9a71-6e42f6a4762c" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402114    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="012c4453-2aa2-41d9-a331-73d989a53f6c" containerName="payload-pre-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402119    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="012c4453-2aa2-41d9-a331-73d989a53f6c" containerName="payload-pre-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402127    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="511b996e-ed72-43d5-8f8a-0ca70dcece81" containerName="main"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402134    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="511b996e-ed72-43d5-8f8a-0ca70dcece81" containerName="main"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402141    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d02cbfc5-4de7-42b8-864b-0dc4b092a15a" containerName="payload-pre-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402147    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d02cbfc5-4de7-42b8-864b-0dc4b092a15a" containerName="payload-pre-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402154    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad5dada-addb-43eb-a32a-c0d249013781" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402159    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad5dada-addb-43eb-a32a-c0d249013781" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402170    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b7a41d1-af81-4e07-8668-0f9e5224394f" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402175    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b7a41d1-af81-4e07-8668-0f9e5224394f" containerName="payload-processing"
Jul 29 13:30:08.402173 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402181    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f405e91-69a8-4e55-a1b1-b58ec821d65f" containerName="payload-pre-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402186    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f405e91-69a8-4e55-a1b1-b58ec821d65f" containerName="payload-pre-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402240    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f405e91-69a8-4e55-a1b1-b58ec821d65f" containerName="payload-pre-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402250    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ad5dada-addb-43eb-a32a-c0d249013781" containerName="payload-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402257    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8101aa61-df6f-427f-9a71-6e42f6a4762c" containerName="payload-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402262    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b7a41d1-af81-4e07-8668-0f9e5224394f" containerName="payload-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402269    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="012c4453-2aa2-41d9-a331-73d989a53f6c" containerName="payload-pre-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402275    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b612df8f-b5e8-4667-8abe-630dec038eb9" containerName="payload-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402280    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d02cbfc5-4de7-42b8-864b-0dc4b092a15a" containerName="payload-pre-processing"
Jul 29 13:30:08.402682 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.402285    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="511b996e-ed72-43d5-8f8a-0ca70dcece81" containerName="main"
Jul 29 13:30:08.406817 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.406791    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.409868 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.409845    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gv8zd\"/\"kube-root-ca.crt\""
Jul 29 13:30:08.410015 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.409845    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gv8zd\"/\"openshift-service-ca.crt\""
Jul 29 13:30:08.410746 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.410729    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gv8zd\"/\"default-dockercfg-k884m\""
Jul 29 13:30:08.418134 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.418111    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gv8zd/must-gather-vdz6r"]
Jul 29 13:30:08.478376 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.478338    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6970f583-aac7-40ba-955e-ebc7668273aa-must-gather-output\") pod \"must-gather-vdz6r\" (UID: \"6970f583-aac7-40ba-955e-ebc7668273aa\") " pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.478376 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.478384    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxzj7\" (UniqueName: \"kubernetes.io/projected/6970f583-aac7-40ba-955e-ebc7668273aa-kube-api-access-cxzj7\") pod \"must-gather-vdz6r\" (UID: \"6970f583-aac7-40ba-955e-ebc7668273aa\") " pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.579377 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.579344    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6970f583-aac7-40ba-955e-ebc7668273aa-must-gather-output\") pod \"must-gather-vdz6r\" (UID: \"6970f583-aac7-40ba-955e-ebc7668273aa\") " pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.579542 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.579387    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxzj7\" (UniqueName: \"kubernetes.io/projected/6970f583-aac7-40ba-955e-ebc7668273aa-kube-api-access-cxzj7\") pod \"must-gather-vdz6r\" (UID: \"6970f583-aac7-40ba-955e-ebc7668273aa\") " pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.579750 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.579727    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6970f583-aac7-40ba-955e-ebc7668273aa-must-gather-output\") pod \"must-gather-vdz6r\" (UID: \"6970f583-aac7-40ba-955e-ebc7668273aa\") " pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.587831 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.587801    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxzj7\" (UniqueName: \"kubernetes.io/projected/6970f583-aac7-40ba-955e-ebc7668273aa-kube-api-access-cxzj7\") pod \"must-gather-vdz6r\" (UID: \"6970f583-aac7-40ba-955e-ebc7668273aa\") " pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.715927 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.715824    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gv8zd/must-gather-vdz6r"
Jul 29 13:30:08.853237 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.853209    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gv8zd/must-gather-vdz6r"]
Jul 29 13:30:08.855592 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:30:08.855566    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6970f583_aac7_40ba_955e_ebc7668273aa.slice/crio-6785c38cd237f6396e161fe191a8a851f36375034a4d2e187a833cfc5b212af5 WatchSource:0}: Error finding container 6785c38cd237f6396e161fe191a8a851f36375034a4d2e187a833cfc5b212af5: Status 404 returned error can't find the container with id 6785c38cd237f6396e161fe191a8a851f36375034a4d2e187a833cfc5b212af5
Jul 29 13:30:08.857525 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:08.857507    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 13:30:09.231145 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:09.231108    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gv8zd/must-gather-vdz6r" event={"ID":"6970f583-aac7-40ba-955e-ebc7668273aa","Type":"ContainerStarted","Data":"6785c38cd237f6396e161fe191a8a851f36375034a4d2e187a833cfc5b212af5"}
Jul 29 13:30:10.243827 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:10.243786    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gv8zd/must-gather-vdz6r" event={"ID":"6970f583-aac7-40ba-955e-ebc7668273aa","Type":"ContainerStarted","Data":"a30168dc512a64a73c8d50124230f7c029e8d2d3989d6380929ea6401290500b"}
Jul 29 13:30:10.244226 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:10.243841    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gv8zd/must-gather-vdz6r" event={"ID":"6970f583-aac7-40ba-955e-ebc7668273aa","Type":"ContainerStarted","Data":"55cc6ad81382209813f8af2b8051e0b6bc5708386f04cd177d1e33da3181322b"}
Jul 29 13:30:10.262199 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:10.262136    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gv8zd/must-gather-vdz6r" podStartSLOduration=1.461140451 podStartE2EDuration="2.262111789s" totalImagesPullingTime="800.971338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 13:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:30:10.260025112 +0000 UTC m=+3887.080075890" watchObservedRunningTime="2026-07-29 13:30:10.262111789 +0000 UTC m=+3887.082162562"
Jul 29 13:30:11.306363 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:11.306305    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dxw26_6a0b1de9-3f31-4d44-93da-67c53dea462d/global-pull-secret-syncer/0.log"
Jul 29 13:30:11.502321 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:11.502273    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jvjsv_f8b2f0a9-981b-4c82-a9d1-11ed3d05b40f/konnectivity-agent/0.log"
Jul 29 13:30:11.611019 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:11.610946    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-162.ec2.internal_4ce42396a29d504fabed2a2525556f09/haproxy/0.log"
Jul 29 13:30:16.403798 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:16.402882    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79c5f5f6f8-z4cgf_9e62e253-19b6-4fb9-bb1d-49ca9d1cd114/authorino/0.log"
Jul 29 13:30:16.487876 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:16.487840    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fn2cd_9d2d7a8e-96fa-434f-ad5a-0ea0c7caccab/kuadrant-console-plugin/0.log"
Jul 29 13:30:16.691415 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:16.691337    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sbzpl_6c1ac2f3-7da3-463c-b839-e81246a017fa/limitador/0.log"
Jul 29 13:30:18.524082 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.524046    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8lh2x_ba9bc6ab-3df0-44b4-8f33-a471410b307d/kube-state-metrics/0.log"
Jul 29 13:30:18.544228 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.544193    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8lh2x_ba9bc6ab-3df0-44b4-8f33-a471410b307d/kube-rbac-proxy-main/0.log"
Jul 29 13:30:18.575344 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.575164    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8lh2x_ba9bc6ab-3df0-44b4-8f33-a471410b307d/kube-rbac-proxy-self/0.log"
Jul 29 13:30:18.754892 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.754794    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lj84r_499165fc-ef99-47ea-8457-9b1b2c424d53/node-exporter/0.log"
Jul 29 13:30:18.773107 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.773070    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lj84r_499165fc-ef99-47ea-8457-9b1b2c424d53/kube-rbac-proxy/0.log"
Jul 29 13:30:18.798175 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.798146    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lj84r_499165fc-ef99-47ea-8457-9b1b2c424d53/init-textfile/0.log"
Jul 29 13:30:18.907950 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.907912    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qnpcc_73a85260-8109-40da-9219-406a7c03291a/kube-rbac-proxy-main/0.log"
Jul 29 13:30:18.933197 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.933169    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qnpcc_73a85260-8109-40da-9219-406a7c03291a/kube-rbac-proxy-self/0.log"
Jul 29 13:30:18.963687 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:18.963655    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qnpcc_73a85260-8109-40da-9219-406a7c03291a/openshift-state-metrics/0.log"
Jul 29 13:30:19.198605 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.198575    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-24zvl_cd4ef8ae-287e-435c-96a1-48156c9d4679/prometheus-operator/0.log"
Jul 29 13:30:19.220038 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.220008    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-24zvl_cd4ef8ae-287e-435c-96a1-48156c9d4679/kube-rbac-proxy/0.log"
Jul 29 13:30:19.357267 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.357230    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5596f46cc-x4s2f_246e61c7-0c14-473b-b64b-9123effc47a7/thanos-query/0.log"
Jul 29 13:30:19.400144 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.400108    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5596f46cc-x4s2f_246e61c7-0c14-473b-b64b-9123effc47a7/kube-rbac-proxy-web/0.log"
Jul 29 13:30:19.422898 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.422858    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5596f46cc-x4s2f_246e61c7-0c14-473b-b64b-9123effc47a7/kube-rbac-proxy/0.log"
Jul 29 13:30:19.451676 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.451591    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5596f46cc-x4s2f_246e61c7-0c14-473b-b64b-9123effc47a7/prom-label-proxy/0.log"
Jul 29 13:30:19.474517 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.474487    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5596f46cc-x4s2f_246e61c7-0c14-473b-b64b-9123effc47a7/kube-rbac-proxy-rules/0.log"
Jul 29 13:30:19.498735 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:19.498700    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5596f46cc-x4s2f_246e61c7-0c14-473b-b64b-9123effc47a7/kube-rbac-proxy-metrics/0.log"
Jul 29 13:30:21.319755 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.319721    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:30:21.327251 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.327224    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/2.log"
Jul 29 13:30:21.375753 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.375714    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"]
Jul 29 13:30:21.383521 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.383496    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.387374 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.387342    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"]
Jul 29 13:30:21.518348 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.518299    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-podres\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.518533 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.518447    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-sys\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.518533 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.518497    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-lib-modules\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.518632 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.518547    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jfsv\" (UniqueName: \"kubernetes.io/projected/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-kube-api-access-7jfsv\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.518681 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.518626    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-proc\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.619537 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.619440    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-sys\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.619921 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.619901    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-lib-modules\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.620236 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.620222    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jfsv\" (UniqueName: \"kubernetes.io/projected/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-kube-api-access-7jfsv\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.620520 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.620158    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-lib-modules\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.620719 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.619825    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-sys\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.620825 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.620668    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-proc\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.620989 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.620478    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-proc\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.621288 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.621272    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-podres\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.621700 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.621511    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-podres\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.646330 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.643429    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jfsv\" (UniqueName: \"kubernetes.io/projected/5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45-kube-api-access-7jfsv\") pod \"perf-node-gather-daemonset-m6btx\" (UID: \"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45\") " pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.697339 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.697271    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:21.880486 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:21.880449    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"]
Jul 29 13:30:21.882880 ip-10-0-142-162 kubenswrapper[2549]: W0729 13:30:21.882207    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5b4d58fc_3626_4fa1_b9bb_6ceb6b691f45.slice/crio-5a790e5813fa4efa640482619d476d6d87c638d9600432a2b0580ebe31120b9b WatchSource:0}: Error finding container 5a790e5813fa4efa640482619d476d6d87c638d9600432a2b0580ebe31120b9b: Status 404 returned error can't find the container with id 5a790e5813fa4efa640482619d476d6d87c638d9600432a2b0580ebe31120b9b
Jul 29 13:30:22.330203 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:22.330160    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx" event={"ID":"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45","Type":"ContainerStarted","Data":"f32ce9347e4fd148d854c73c0df3c8c82cbc83c9b25c55dc8929aacab804de19"}
Jul 29 13:30:22.330738 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:22.330223    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx" event={"ID":"5b4d58fc-3626-4fa1-b9bb-6ceb6b691f45","Type":"ContainerStarted","Data":"5a790e5813fa4efa640482619d476d6d87c638d9600432a2b0580ebe31120b9b"}
Jul 29 13:30:22.330738 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:22.330387    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:22.644794 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:22.644706    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-wdqht_1a263c2b-6636-42fe-8da8-4fb2bfcc80e7/volume-data-source-validator/0.log"
Jul 29 13:30:23.641586 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:23.641557    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9j7j9_a5f6429a-1594-466d-b5ba-5313e55d8eab/dns/0.log"
Jul 29 13:30:23.664560 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:23.664523    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9j7j9_a5f6429a-1594-466d-b5ba-5313e55d8eab/kube-rbac-proxy/0.log"
Jul 29 13:30:23.805813 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:23.805785    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjzlq_cdc6a98e-ba32-4e69-a42e-a7384d0608be/dns-node-resolver/0.log"
Jul 29 13:30:23.936933 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:23.936847    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:30:23.943100 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:23.943073    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:30:23.945690 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:23.944284    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rwhd5_69de03dc-f10f-4862-99d2-dace592aa3d1/console-operator/1.log"
Jul 29 13:30:23.950964 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:23.950520    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq99x_9af8fcd6-a294-4c89-ad11-6d36b32a0a52/ovn-acl-logging/0.log"
Jul 29 13:30:24.366437 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:24.366407    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57656bb7cb-xfmz9_5fa5a823-e7bf-4e95-9714-6dcb00498307/registry/0.log"
Jul 29 13:30:24.459995 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:24.459959    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8r7n_38bd4376-7d36-4d25-974d-6fbc3fd5b574/node-ca/0.log"
Jul 29 13:30:25.537755 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:25.537714    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bb9c5fc49-6h4sq_896a5175-d6b1-4e6d-96a4-01d8f255b98d/kube-auth-proxy/0.log"
Jul 29 13:30:25.741159 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:25.741131    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6999b477-zzhch_a8a6840f-d7d1-47b6-951f-a8f9b222e3db/router/0.log"
Jul 29 13:30:26.550905 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:26.550863    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sb5c9_09f20c1e-764a-425d-a975-99e9fb8fa8d6/serve-healthcheck-canary/0.log"
Jul 29 13:30:27.030494 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:27.030450    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-4x8mj_2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778/insights-operator/0.log"
Jul 29 13:30:27.031532 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:27.031503    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-4x8mj_2d2ccb9b-6c4e-49cb-84e6-f9e47fea9778/insights-operator/1.log"
Jul 29 13:30:27.115277 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:27.115245    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nctz_fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca/kube-rbac-proxy/0.log"
Jul 29 13:30:27.135581 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:27.135550    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nctz_fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca/exporter/0.log"
Jul 29 13:30:27.155574 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:27.155538    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nctz_fd30cfc1-17ab-4fc9-96d4-07c74c98a9ca/extractor/0.log"
Jul 29 13:30:28.359321 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:28.359275    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx"
Jul 29 13:30:28.377236 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:28.377179    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gv8zd/perf-node-gather-daemonset-m6btx" podStartSLOduration=7.377157052 podStartE2EDuration="7.377157052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 13:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 13:30:22.347625877 +0000 UTC m=+3899.167676667" watchObservedRunningTime="2026-07-29 13:30:28.377157052 +0000 UTC m=+3905.197207830"
Jul 29 13:30:30.157500 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:30.157421    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556f8bf875-z5plj_8ab25446-1663-4c1b-b280-96ddc45eb9d7/manager/0.log"
Jul 29 13:30:30.186368 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:30.186339    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-556f8bf875-z5plj_8ab25446-1663-4c1b-b280-96ddc45eb9d7/copy-manifests/0.log"
Jul 29 13:30:31.595842 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:31.595808    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69d46b4769-nzh54_9d61e964-4d9d-44e0-be23-e005f89e0aa9/manager/0.log"
Jul 29 13:30:31.766055 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:31.766026    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bb9c5fc49-6h4sq_896a5175-d6b1-4e6d-96a4-01d8f255b98d/kube-auth-proxy/0.log"
Jul 29 13:30:31.930541 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:31.930463    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6999b477-zzhch_a8a6840f-d7d1-47b6-951f-a8f9b222e3db/router/0.log"
Jul 29 13:30:33.451186 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:33.451155    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bb9c5fc49-6h4sq_896a5175-d6b1-4e6d-96a4-01d8f255b98d/kube-auth-proxy/0.log"
Jul 29 13:30:33.613590 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:33.613560    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6999b477-zzhch_a8a6840f-d7d1-47b6-951f-a8f9b222e3db/router/0.log"
Jul 29 13:30:37.938857 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:37.938827    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-28jlg_37ed631f-96d3-47ae-a9c2-bb78aca48e33/kube-multus/0.log"
Jul 29 13:30:38.134736 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:38.134705    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72zgr_71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1/kube-multus-additional-cni-plugins/0.log"
Jul 29 13:30:38.158743 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:38.158717    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72zgr_71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1/egress-router-binary-copy/0.log"
Jul 29 13:30:38.183194 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:38.183166    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72zgr_71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1/cni-plugins/0.log"
Jul 29 13:30:38.204042 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:38.203977    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72zgr_71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1/bond-cni-plugin/0.log"
Jul 29 13:30:38.225236 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:38.225208    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72zgr_71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1/routeoverride-cni/0.log"
Jul 29 13:30:38.248202 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:38.248178    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72zgr_71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1/whereabouts-cni-bincopy/0.log"
Jul 29 13:30:38.271143 ip-10-0-142-162 kubenswrapper[2549]: I0729 13:30:38.271120    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72zgr_71f9ca64-4026-4c01-a62e-cf4e3a8fc7b1/whereabouts-cni/0.log"