Jul 07 18:50:35.134921 ip-10-0-132-202 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 18:50:35.587351 ip-10-0-132-202 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:35.587351 ip-10-0-132-202 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 18:50:35.587351 ip-10-0-132-202 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:35.587351 ip-10-0-132-202 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 18:50:35.587351 ip-10-0-132-202 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:35.588106 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.587392    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 18:50:35.591599 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591582    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:35.591599 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591598    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591602    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591605    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591608    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591611    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591614    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591617    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591622    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591626    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591629    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591632    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591635    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591638    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591641    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591658    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591661    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591664    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591667    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591670    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591673    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:35.591683 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591675    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591678    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591682    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591684    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591687    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591693    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591698    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591702    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591705    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591708    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591711    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591714    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591717    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591719    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591722    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591725    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591727    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591730    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591732    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:35.592151 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591735    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591737    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591740    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591742    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591744    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591747    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591749    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591752    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591754    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591757    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591759    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591761    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591764    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591766    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591769    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591772    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591775    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591777    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591780    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591782    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:35.592614 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591785    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591789    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591793    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591796    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591798    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591801    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591803    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591805    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591807    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591810    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591812    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591815    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591817    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591820    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591822    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591825    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591827    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591829    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591832    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:35.593105 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591834    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591836    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591839    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591841    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591843    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591846    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591849    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591851    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591854    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591857    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591860    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591862    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591865    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591867    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591869    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591872    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591874    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591877    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591879    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:35.593595 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.591882    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592582    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592588    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592590    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592606    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592610    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592613    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592616    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592619    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592622    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592625    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592628    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592631    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592634    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592637    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592640    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592661    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592664    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592667    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:35.594083 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592670    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592674    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592679    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592682    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592686    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592689    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592692    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592694    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592697    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592699    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592703    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592705    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592707    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592710    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592712    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592715    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592717    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592720    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592722    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:35.594561 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592725    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592727    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592729    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592732    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592734    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592737    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592740    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592743    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592745    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592748    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592751    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592753    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592755    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592758    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592761    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592764    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592767    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592769    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592771    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592774    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:35.595136 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592776    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592779    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592782    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592784    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592786    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592789    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592791    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592794    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592796    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592799    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592801    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592804    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592806    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592809    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592811    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592814    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592817    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592820    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592822    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592824    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:35.595631 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592827    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592829    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592832    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592835    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592837    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592840    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592842    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592846    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592848    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592851    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592853    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592855    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592858    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592861    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592863    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592865    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592868    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592870    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592872    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592875    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:35.596139 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592877    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.592881    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593238    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593243    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593246    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593249    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593251    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593254    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593256    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593259    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593262    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593265    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593268    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593270    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593273    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593276    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593278    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593281    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593284    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593286    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:35.596627 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593289    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593291    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593294    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593296    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593299    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593301    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593304    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593306    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593309    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593311    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593314    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593316    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593319    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593321    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593324    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593326    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593329    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593331    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593333    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593336    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:35.597127 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593338    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593341    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593343    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593346    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593349    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593352    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593354    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593357    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593360    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593362    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593365    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593367    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593370    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593372    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593375    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593377    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593380    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593382    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593385    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593387    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:35.597611 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593390    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593392    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593394    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593397    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593399    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593401    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593404    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593406    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593409    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593411    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593414    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593416    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593418    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593421    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593423    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593427    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593430    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593433    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593438    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:35.598145 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593442    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593445    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593449    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593453    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593456    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593458    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593462    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593465    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593468    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593470    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593473    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593476    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593478    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593481    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593483    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593486    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593488    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593490    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593493    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:35.598621 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593495    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593498    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.593500    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593570    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593577    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593583    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593592    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593598    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593603    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593610    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593616    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593621    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593625    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593628    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593631    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593634    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593640    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593656    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593660    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593662    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593665    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593669    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593672    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593675    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 18:50:35.599094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593678    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593681    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593685    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593688    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593691    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593694    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593697    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593700    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593703    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593705    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593709    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593713    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593716    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593719    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593723    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593726    2562 flags.go:64] FLAG: --enable-server="true"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593729    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593734    2562 flags.go:64] FLAG: --event-burst="100"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593737    2562 flags.go:64] FLAG: --event-qps="50"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593740    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593743    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593746    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593749    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593752    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593755    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 18:50:35.599689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593764    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593767    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593770    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593773    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593776    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593778    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593781    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593783    2562 flags.go:64] FLAG: --feature-gates=""
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593787    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593790    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593792    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593795    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593798    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593801    2562 flags.go:64] FLAG: --help="false"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593803    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593806    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593812    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593815    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593818    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593821    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593824    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593828    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593831    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 18:50:35.600292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593834    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593837    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593840    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593842    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593845    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593848    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593851    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593853    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593856    2562 flags.go:64] FLAG: --lock-file=""
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593858    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593867    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593870    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593875    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593878    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593880    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593883    2562 flags.go:64] FLAG: --logging-format="text"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593886    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593889    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593891    2562 flags.go:64] FLAG: --manifest-url=""
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593894    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593898    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593901    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593905    2562 flags.go:64] FLAG: --max-pods="110"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593908    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593910    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 18:50:35.601246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593915    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593917    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593920    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593926    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593929    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593936    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593938    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593941    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593944    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593947    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593952    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593955    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593958    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593960    2562 flags.go:64] FLAG: --port="10250"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593963    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593966    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b694126f80eb56e2"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593969    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593972    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593976    2562 flags.go:64] FLAG: --register-node="true"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593979    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593983    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593985    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593988    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593991    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593994    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 18:50:35.602315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.593997    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594000    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594002    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594005    2562 flags.go:64] FLAG: --runonce="false"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594008    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594011    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594014    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594016    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594021    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594024    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594027    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594030    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594033    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594036    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594039    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594042    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594045    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594048    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594050    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594055    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594058    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594061    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594067    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594070    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594072    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 18:50:35.603444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594075    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594078    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594081    2562 flags.go:64] FLAG: --v="2"
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594085    2562 flags.go:64] FLAG: --version="false"
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594089    2562 flags.go:64] FLAG: --vmodule=""
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594093    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594096    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594221    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594225    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594228    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594231    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594233    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594236    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594239    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594242    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594246    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594249    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594251    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594254    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594257    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594260    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:35.604531 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594262    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594265    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594267    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594270    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594272    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594274    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594277    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594280    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594283    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594285    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594288    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594290    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594293    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594296    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594299    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594301    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594304    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594306    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594309    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:35.605168 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594312    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594314    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594317    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594319    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594321    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594324    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594326    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594330    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594332    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594335    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594337    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594341    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594343    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594345    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594348    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594350    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594353    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594356    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594360    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594363    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:35.605808 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594365    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594368    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594370    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594373    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594375    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594377    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594380    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594382    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594385    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594387    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594390    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594393    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594395    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594398    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594400    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594402    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594404    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594407    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594409    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594413    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:35.606669 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594417    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594420    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594423    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594427    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594429    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594432    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594435    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594437    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594440    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594443    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594445    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594447    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594451    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594454    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594457    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594459    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594462    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594464    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594467    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594469    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:35.607305 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594472    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594475    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594477    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594479    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594482    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.594484    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.594493    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.603157    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.603181    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.603204    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.603213    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603301    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603309    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603314    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603318    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:35.607920 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603323    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603327    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603331    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603336    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603340    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603344    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603348    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603352    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603356    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603360    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603364    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603369    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603373    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603377    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603381    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603386    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603390    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603394    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603398    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603403    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:35.608320 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603407    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603411    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603418    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603423    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603428    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603441    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603445    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603448    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603452    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603456    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603460    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603464    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603467    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603471    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603475    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603479    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603483    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603487    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603492    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:35.608945 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603496    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603500    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603504    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603508    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603512    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603516    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603521    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603526    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603529    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603533    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603537    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603542    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603545    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603549    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603553    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603558    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603564    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603568    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603573    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603585    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:35.609419 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603590    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603594    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603598    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603602    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603606    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603610    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603614    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603618    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603622    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603626    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603630    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603634    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603638    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603661    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603665    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603669    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603673    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603677    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603682    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603687    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:35.610033 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603691    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603695    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603699    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603703    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603707    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603711    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603717    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603722    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603726    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603730    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603734    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603738    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603750    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603755    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603759    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:35.610560 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603763    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.603771    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603991    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.603999    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604004    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604008    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604013    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604017    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604022    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604027    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604031    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604035    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604039    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604043    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:35.610986 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604047    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604052    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604055    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604059    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604063    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604067    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604071    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604075    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604079    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604083    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604088    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604092    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604096    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604100    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604104    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604109    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604121    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604125    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604129    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604133    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:35.611338 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604137    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604141    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604145    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604149    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604153    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604157    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604161    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604165    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604169    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604173    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604177    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604181    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604185    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604189    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604193    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604197    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604202    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604206    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604210    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:35.611902 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604216    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604221    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604226    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604230    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604234    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604238    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604242    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604246    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604250    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604254    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604266    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604270    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604277    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604281    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604286    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604291    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604295    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604300    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604314    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604319    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:35.612387 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604323    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604328    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604332    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604336    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604340    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604344    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604348    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604352    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604357    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604361    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604365    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604369    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604372    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604378    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604384    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604388    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604392    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604396    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604400    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604404    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:35.612912 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604409    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604414    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604417    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604429    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604434    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604438    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604441    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:35.604445    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.604453    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.604625    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.608708    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.610523    2562 server.go:1019] "Starting client certificate rotation"
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.610664    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:50:35.613583 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.611380    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:50:35.614199 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.613878    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:50:35.620324 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.620294    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:50:35.633875 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.633855    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 07 18:50:35.636211 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.636197    2562 log.go:25] "Validated CRI v1 image API"
Jul 07 18:50:35.637030 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.637014    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 18:50:35.642234 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.642202    2562 fs.go:135] Filesystem UUIDs: map[354d1823-d9d6-4a39-aa0f-3e88e52589cb:/dev/nvme0n1p4 3b6f72f2-e232-4810-b1c2-34dd90dbd98b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 07 18:50:35.642292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.642235    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 18:50:35.647772 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.647667    2562 manager.go:216] Machine: {Timestamp:2026-07-07 18:50:35.646264863 +0000 UTC m=+0.383357864 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093227 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d00a7a6d593d42af1af66b97cc907 SystemUUID:ec2d00a7-a6d5-93d4-2af1-af66b97cc907 BootID:8f9c1f03-aeac-40c1-af26-365a7e676324 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:a0:8c:4d:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:a0:8c:4d:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:a8:42:ec:91:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 18:50:35.647772 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.647767    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 18:50:35.647870 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.647849    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 18:50:35.651397 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.651371    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 18:50:35.651537 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.651401    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 18:50:35.652235 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.652225    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 18:50:35.652267 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.652237    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 18:50:35.652267 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.652246    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:50:35.652621 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.652607    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:50:35.653108 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.653095    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:50:35.654991 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.654980    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 18:50:35.659628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.659616    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:50:35.659792 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.659782    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 18:50:35.659830 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.659818    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 18:50:35.659861 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.659835    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 18:50:35.659861 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.659847    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 18:50:35.659861 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.659857    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 07 18:50:35.659991 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.659866    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 18:50:35.660356 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.660344    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:50:35.660398 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.660371    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:50:35.664212 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.664193    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 18:50:35.666425 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.666411    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 18:50:35.666490 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.666441    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 18:50:35.667855 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667841    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667859    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667865    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667870    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667878    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667884    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667892    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667899    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 18:50:35.667906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667906    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 18:50:35.668130 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667911    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 18:50:35.668130 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667921    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 18:50:35.668130 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.667928    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 18:50:35.668986 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.668968    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 18:50:35.669066 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.668996    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 18:50:35.673729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.673711    2562 server.go:1268] "Started kubelet"
Jul 07 18:50:35.673826 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.673774    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 18:50:35.673875 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.673808    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 18:50:35.673911 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.673874    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 18:50:35.674225 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.674180    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 18:50:35.674668 ip-10-0-132-202 systemd[1]: Started Kubernetes Kubelet.
Jul 07 18:50:35.675861 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.675849    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 18:50:35.677452 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.677413    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 18:50:35.679887 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.679869    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 18:50:35.681139 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.681120    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 18:50:35.682155 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.682138    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 18:50:35.682220 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.681099    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18c0168a4beaa8ae  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:ip-10-0-132-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-07-07 18:50:35.673684142 +0000 UTC m=+0.410777143,LastTimestamp:2026-07-07 18:50:35.673684142 +0000 UTC m=+0.410777143,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Jul 07 18:50:35.686160 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.686140    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 18:50:35.686253 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.686169    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 18:50:35.686315 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.686292    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:35.686980 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.686964    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 18:50:35.686980 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.686981    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 18:50:35.687125 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.686964    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 18:50:35.687125 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687060    2562 factory.go:55] Registering systemd factory
Jul 07 18:50:35.687125 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687090    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 18:50:35.687125 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687097    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 07 18:50:35.687125 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687101    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 18:50:35.687364 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687349    2562 factory.go:153] Registering CRI-O factory
Jul 07 18:50:35.687418 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687369    2562 factory.go:223] Registration of the crio container factory successfully
Jul 07 18:50:35.687418 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687415    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 18:50:35.687488 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687462    2562 factory.go:103] Registering Raw factory
Jul 07 18:50:35.687488 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.687479    2562 manager.go:1196] Started watching for new ooms in manager
Jul 07 18:50:35.688068 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.688055    2562 manager.go:349] Starting recovery of all containers
Jul 07 18:50:35.692368 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.692326    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 18:50:35.693401 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.693375    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 18:50:35.696083 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.696055    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 18:50:35.701434 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.701257    2562 manager.go:354] Recovery completed
Jul 07 18:50:35.705779 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.705765    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:35.707727 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.707699    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:35.707792 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.707742    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:35.707792 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.707753    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:35.708290 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.708275    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 18:50:35.708290 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.708289    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 18:50:35.708402 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.708307    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:50:35.708402 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.708321    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:35.709014 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.709000    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:35.709063 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.709027    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:35.709063 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.709040    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:35.710359 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.710261    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18c0168a4df21e85  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:ip-10-0-132-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-07-07 18:50:35.707727493 +0000 UTC m=+0.444820493,LastTimestamp:2026-07-07 18:50:35.707727493 +0000 UTC m=+0.444820493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Jul 07 18:50:35.710499 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.710486    2562 policy_none.go:49] "None policy: Start"
Jul 07 18:50:35.710534 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.710507    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 18:50:35.710534 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.710519    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 18:50:35.712527 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.712516    2562 policy_none.go:47] "Start"
Jul 07 18:50:35.719968 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.719902    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18c0168a4df269ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:ip-10-0-132-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-202.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-07-07 18:50:35.707746746 +0000 UTC m=+0.444839746,LastTimestamp:2026-07-07 18:50:35.707746746 +0000 UTC m=+0.444839746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Jul 07 18:50:35.720174 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.720154    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8wvhb"
Jul 07 18:50:35.729759 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.729744    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8wvhb"
Jul 07 18:50:35.731873 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.731782    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-202.ec2.internal.18c0168a4df291ad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-202.ec2.internal,UID:ip-10-0-132-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-202.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-202.ec2.internal,},FirstTimestamp:2026-07-07 18:50:35.707756973 +0000 UTC m=+0.444849974,LastTimestamp:2026-07-07 18:50:35.707756973 +0000 UTC m=+0.444849974,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-202.ec2.internal,}"
Jul 07 18:50:35.754280 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.754263    2562 manager.go:337] "Starting Device Plugin manager"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.754300    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.754314    2562 server.go:87] "Starting device plugin registration server"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.754548    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.754560    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.754749    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.754829    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.754837    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.755624    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.755694    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.765284    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.765318    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.765338    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.765367    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 18:50:35.774997 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.767435    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:35.855584 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.855505    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:35.856612 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.856597    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:35.856689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.856627    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:35.856689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.856636    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:35.856689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.856678    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.865741 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.865720    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"]
Jul 07 18:50:35.865798 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.865781    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:35.867371 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.867356    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:35.867444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.867381    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:35.867444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.867391    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:35.869027 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.869013    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.869076 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.869033    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-202.ec2.internal\": node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:35.869792 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.869778    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:35.869890 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.869876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.869925 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.869906    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:35.874444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.874425    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:35.874531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.874452    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:35.874531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.874467    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:35.874768 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.874752    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:35.874828 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.874778    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:35.874828 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.874791    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:35.876839 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.876821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.876939 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.876855    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:35.878020 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.878003    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:35.878101 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.878035    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:35.878101 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.878050    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:35.888312 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.888297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/befb3c720b7a301ec6a4df2b8708f226-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"befb3c720b7a301ec6a4df2b8708f226\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.888375 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.888320    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/befb3c720b7a301ec6a4df2b8708f226-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"befb3c720b7a301ec6a4df2b8708f226\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.888375 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.888335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8245c94532bb8528f3a95f6fc7b39d2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"c8245c94532bb8528f3a95f6fc7b39d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.901252 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.901234    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-202.ec2.internal\" not found" node="ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.905593 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.905578    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-202.ec2.internal\" not found" node="ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.919437 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:35.919422    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:35.989075 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.989045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8245c94532bb8528f3a95f6fc7b39d2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"c8245c94532bb8528f3a95f6fc7b39d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.989227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.989081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/befb3c720b7a301ec6a4df2b8708f226-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"befb3c720b7a301ec6a4df2b8708f226\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.989227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.989098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/befb3c720b7a301ec6a4df2b8708f226-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"befb3c720b7a301ec6a4df2b8708f226\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.989227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.989126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/befb3c720b7a301ec6a4df2b8708f226-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"befb3c720b7a301ec6a4df2b8708f226\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.989227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.989154    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/befb3c720b7a301ec6a4df2b8708f226-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal\" (UID: \"befb3c720b7a301ec6a4df2b8708f226\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:35.989227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:35.989154    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8245c94532bb8528f3a95f6fc7b39d2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-202.ec2.internal\" (UID: \"c8245c94532bb8528f3a95f6fc7b39d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:36.019936 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.019901    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.120246 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.120167    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.205806 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.205774    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:36.209927 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.209906    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:36.220251 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.220229    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.320784 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.320750    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.421374 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.421303    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.498098 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.498066    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:36.521784 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.521758    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.609423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.609395    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 18:50:36.609993 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.609525    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:50:36.609993 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.609578    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:50:36.622694 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.622672    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.723829 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:36.723766    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-202.ec2.internal\" not found"
Jul 07 18:50:36.732958 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.732920    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:45:37 +0000 UTC" deadline="2028-03-24 22:49:57.635840694 +0000 UTC"
Jul 07 18:50:36.732958 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.732957    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15027h59m20.902888244s"
Jul 07 18:50:36.764239 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.764222    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:36.765725 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.765701    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:36.765822 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.765746    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:36.765822 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.765764    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:36.803423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.803401    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:36.886538 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.886520    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:36.897246 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:36.897212    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8245c94532bb8528f3a95f6fc7b39d2.slice/crio-438c69d9d5d42a3c890242eab8b081f1f4a937db3d7c2ce714a6baa3a58a7172 WatchSource:0}: Error finding container 438c69d9d5d42a3c890242eab8b081f1f4a937db3d7c2ce714a6baa3a58a7172: Status 404 returned error can't find the container with id 438c69d9d5d42a3c890242eab8b081f1f4a937db3d7c2ce714a6baa3a58a7172
Jul 07 18:50:36.897708 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:36.897686    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbefb3c720b7a301ec6a4df2b8708f226.slice/crio-0a8231833f5f64e57c9bc5c0520cc66f62ded3886c94d16d6c6609b7b22049fe WatchSource:0}: Error finding container 0a8231833f5f64e57c9bc5c0520cc66f62ded3886c94d16d6c6609b7b22049fe: Status 404 returned error can't find the container with id 0a8231833f5f64e57c9bc5c0520cc66f62ded3886c94d16d6c6609b7b22049fe
Jul 07 18:50:36.904474 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.904453    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:50:36.907996 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.907980    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:50:36.909975 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.909959    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal"
Jul 07 18:50:36.919869 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:36.919854    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:50:37.008318 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:37.008231    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:39.335100 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.335014    2562 apiserver.go:52] "Watching apiserver"
Jul 07 18:50:39.342021 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.341988    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 18:50:39.342452 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.342425    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-j2nh7","openshift-multus/multus-qtf2s","openshift-network-operator/iptables-alerter-mfv7p","openshift-ovn-kubernetes/ovnkube-node-rvks2","kube-system/global-pull-secret-syncer-5825v","kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55","openshift-cluster-node-tuning-operator/tuned-2hjq4","openshift-dns/node-resolver-4v245","openshift-image-registry/node-ca-7kgjv","openshift-multus/network-metrics-daemon-jgw7m","openshift-network-diagnostics/network-check-target-8fhf5","kube-system/konnectivity-agent-jhrk5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal"]
Jul 07 18:50:39.345241 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.345217    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.347255 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.347234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.347759 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.347741    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.347865 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.347813    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.348059 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.348033    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 18:50:39.348119 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.348088    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8cqg4\""
Jul 07 18:50:39.349217 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.349198    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h6vqb\""
Jul 07 18:50:39.349503 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.349487    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 18:50:39.349829 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.349808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.350732 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.350715    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 18:50:39.351729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.351673    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.352791 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.352052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tnmks\""
Jul 07 18:50:39.352791 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.352430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.352791 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.352453    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 18:50:39.352791 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.352655    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.354278 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.354243    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 18:50:39.354562 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.354547    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 18:50:39.354740 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.354725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.354813 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.354791    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:39.355088 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.355069    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f8dwq\""
Jul 07 18:50:39.355088 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.355084    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.356255 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.356233    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.356944 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.356340    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 18:50:39.357099 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.356422    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 18:50:39.357375 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.356773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.359224 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.359202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.360428 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.360196    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.360428 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.360305    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.360556 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.360488    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tvp4h\""
Jul 07 18:50:39.361001 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.360985    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 18:50:39.361596 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.361579    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.361867 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.361850    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7gw4z\""
Jul 07 18:50:39.362871 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.362732    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.364699 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.364530    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.368323 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.367509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.368323 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.367924    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 18:50:39.368323 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.368089    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 18:50:39.370468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.368551    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.370468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.368748    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.370468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.369083    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q5q46\""
Jul 07 18:50:39.370468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.369463    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 18:50:39.370468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.369676    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pdhkf\""
Jul 07 18:50:39.371604 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87f6027c-6f68-4d54-bce3-fabd01651d7c-tmp-dir\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.371700 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovnkube-script-lib\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.371700 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67wwj\" (UniqueName: \"kubernetes.io/projected/87f6027c-6f68-4d54-bce3-fabd01651d7c-kube-api-access-67wwj\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.371700 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0afc186c-a129-4603-8e41-a82b5015ab5d-agent-certs\") pod \"konnectivity-agent-jhrk5\" (UID: \"0afc186c-a129-4603-8e41-a82b5015ab5d\") " pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.371856 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa182a1-163e-474f-a336-fd278f564914-dbus\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.371856 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-tuned\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.371856 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqj8\" (UniqueName: \"kubernetes.io/projected/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-kube-api-access-mvqj8\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.371856 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovnkube-config\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.371856 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysctl-d\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.371856 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-socket-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.372138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-ovn\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371885    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 18:50:39.372138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-cnibin\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.372138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.371942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-sys\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-var-lib-kubelet\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.372138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-host\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-systemd-units\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-node-log\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jnpp\" (UniqueName: \"kubernetes.io/projected/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-kube-api-access-2jnpp\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-cni-netd\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hssqw\" (UniqueName: \"kubernetes.io/projected/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-kube-api-access-hssqw\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-lib-modules\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.372473 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q5s5\" (UniqueName: \"kubernetes.io/projected/8a183b32-9436-497b-9c94-e29ebaefb4e7-kube-api-access-9q5s5\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-cni-bin\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-tmp\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-kubelet\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-var-lib-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-log-socket\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0afc186c-a129-4603-8e41-a82b5015ab5d-konnectivity-ca\") pod \"konnectivity-agent-jhrk5\" (UID: \"0afc186c-a129-4603-8e41-a82b5015ab5d\") " pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysconfig\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa182a1-163e-474f-a336-fd278f564914-kubelet-config\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-modprobe-d\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysctl-conf\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksgm9\" (UniqueName: \"kubernetes.io/projected/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-kube-api-access-ksgm9\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-device-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.372979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-slash\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-systemd\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-kubernetes\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.372983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-etc-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-env-overrides\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87f6027c-6f68-4d54-bce3-fabd01651d7c-hosts-file\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovn-node-metrics-cert\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-iptables-alerter-script\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-systemd\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-sys-fs\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-system-cni-dir\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-os-release\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.373656 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-registration-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.374465 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-run-netns\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.374465 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-host-slash\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.374465 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.373357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-run\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.374465 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.374341    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x42jt\""
Jul 07 18:50:39.374642 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.374471    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 18:50:39.374690 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.374658    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 18:50:39.374758 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.374741    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:39.374833 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.374813    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:39.374966 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.374948    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 18:50:39.376730 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.376708    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:39.376894 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.376773    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:39.376985 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.376926    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:50:39.419500 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.419472    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l4h4p"
Jul 07 18:50:39.427931 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.427899    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l4h4p"
Jul 07 18:50:39.444742 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.444695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"befb3c720b7a301ec6a4df2b8708f226","Type":"ContainerStarted","Data":"0a8231833f5f64e57c9bc5c0520cc66f62ded3886c94d16d6c6609b7b22049fe"}
Jul 07 18:50:39.446128 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.446101    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" event={"ID":"c8245c94532bb8528f3a95f6fc7b39d2","Type":"ContainerStarted","Data":"438c69d9d5d42a3c890242eab8b081f1f4a937db3d7c2ce714a6baa3a58a7172"}
Jul 07 18:50:39.462748 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.462723    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 18:50:39.473844 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.473815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovnkube-script-lib\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.473975 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.473855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67wwj\" (UniqueName: \"kubernetes.io/projected/87f6027c-6f68-4d54-bce3-fabd01651d7c-kube-api-access-67wwj\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.473975 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.473883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0afc186c-a129-4603-8e41-a82b5015ab5d-agent-certs\") pod \"konnectivity-agent-jhrk5\" (UID: \"0afc186c-a129-4603-8e41-a82b5015ab5d\") " pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.473975 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.473905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa182a1-163e-474f-a336-fd278f564914-dbus\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.474141 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa182a1-163e-474f-a336-fd278f564914-dbus\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.474196 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-tuned\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.474252 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-cnibin\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.474252 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-hostroot\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.474252 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqj8\" (UniqueName: \"kubernetes.io/projected/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-kube-api-access-mvqj8\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.474423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovnkube-config\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.474423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-cni-multus\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.474423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjjrz\" (UniqueName: \"kubernetes.io/projected/d2712c79-9a77-4a8f-b23f-bff6bf19a602-kube-api-access-vjjrz\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.474423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysctl-d\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.474423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-socket-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.474423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474417    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 18:50:39.474628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-socket-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.474628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovnkube-script-lib\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.474728 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474661    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysctl-d\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.474781 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-ovn\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.474832 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-cnibin\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.474883 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovnkube-config\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.474883 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-sys\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.474883 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-var-lib-kubelet\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.474883 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474881    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-cnibin\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-host\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-var-lib-kubelet\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-sys\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-systemd-units\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474847    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-ovn\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-node-log\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474948    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-systemd-units\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474972    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-node-log\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.474983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gqv8\" (UniqueName: \"kubernetes.io/projected/e38a176c-b277-4f30-8a72-770c49b6cd02-kube-api-access-7gqv8\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475004    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-host\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxbbl\" (UniqueName: \"kubernetes.io/projected/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-kube-api-access-qxbbl\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:39.475071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jnpp\" (UniqueName: \"kubernetes.io/projected/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-kube-api-access-2jnpp\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-cni-netd\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-cni-netd\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475302    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-cni-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-os-release\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hssqw\" (UniqueName: \"kubernetes.io/projected/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-kube-api-access-hssqw\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-conf-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475440    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-daemon-config\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-lib-modules\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q5s5\" (UniqueName: \"kubernetes.io/projected/8a183b32-9436-497b-9c94-e29ebaefb4e7-kube-api-access-9q5s5\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-kubelet\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.475658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-cni-bin\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.476468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-tmp\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.476468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-lib-modules\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.476468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-kubelet\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.476468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-var-lib-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.476468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.475673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-log-socket\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.481099 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.481219 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.481219 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e38a176c-b277-4f30-8a72-770c49b6cd02-host\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.481363 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:39.481363 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0afc186c-a129-4603-8e41-a82b5015ab5d-konnectivity-ca\") pod \"konnectivity-agent-jhrk5\" (UID: \"0afc186c-a129-4603-8e41-a82b5015ab5d\") " pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.481471 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysconfig\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.481471 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.481580 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.481580 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-system-cni-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.481723 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-k8s-cni-cncf-io\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.481770 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481742    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa182a1-163e-474f-a336-fd278f564914-kubelet-config\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.481849 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-modprobe-d\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.481923 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysctl-conf\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.481980 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksgm9\" (UniqueName: \"kubernetes.io/projected/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-kube-api-access-ksgm9\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.481980 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-device-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.482074 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.481996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.482132 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-slash\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482132 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-systemd\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482225 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.482225 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-kubernetes\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.482352 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-etc-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482352 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-cni-bin\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482352 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482497 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-env-overrides\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482497 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482399    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-var-lib-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482497 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87f6027c-6f68-4d54-bce3-fabd01651d7c-hosts-file\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.482497 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.482837 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-env-overrides\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482896 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-socket-dir-parent\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.482947 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovn-node-metrics-cert\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.482947 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e38a176c-b277-4f30-8a72-770c49b6cd02-serviceca\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.483056 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-netns\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.483056 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.483056 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.482980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-iptables-alerter-script\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.483056 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-kubelet\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.483234 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-systemd\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.483234 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-sys-fs\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.483234 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-system-cni-dir\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.483234 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-os-release\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.483234 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-multus-certs\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.483234 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-etc-kubernetes\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-registration-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-run-netns\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-cni-bin\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-host-slash\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-run\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87f6027c-6f68-4d54-bce3-fabd01651d7c-tmp-dir\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483459    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-iptables-alerter-script\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2712c79-9a77-4a8f-b23f-bff6bf19a602-cni-binary-copy\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.483577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483580    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87f6027c-6f68-4d54-bce3-fabd01651d7c-hosts-file\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-systemd\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483677    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-sys-fs\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483726    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-system-cni-dir\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483781    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-os-release\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483859    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-registration-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-run-netns\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483952    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-host-slash\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483979    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0afc186c-a129-4603-8e41-a82b5015ab5d-konnectivity-ca\") pod \"konnectivity-agent-jhrk5\" (UID: \"0afc186c-a129-4603-8e41-a82b5015ab5d\") " pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.484009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.483999    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-run\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484039    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysconfig\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484091    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484217    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a183b32-9436-497b-9c94-e29ebaefb4e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484284    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87f6027c-6f68-4d54-bce3-fabd01651d7c-tmp-dir\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484303    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa182a1-163e-474f-a336-fd278f564914-kubelet-config\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484380    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-log-socket\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-modprobe-d\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.484454 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-kubernetes\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.484854 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484516    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-sysctl-conf\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.484854 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.484526    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:39.484854 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.484617    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret podName:2fa182a1-163e-474f-a336-fd278f564914 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:39.984580957 +0000 UTC m=+3.048057655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret") pod "global-pull-secret-syncer-5825v" (UID: "2fa182a1-163e-474f-a336-fd278f564914") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:39.484854 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484757    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-etc-openvswitch\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.484854 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.485117 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.485117 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.484968    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-host-slash\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.485117 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.485100    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-run-systemd\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.485351 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.485157    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-device-dir\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.485633 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.485614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a183b32-9436-497b-9c94-e29ebaefb4e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.489571 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.489543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-ovn-node-metrics-cert\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.492279 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.492247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-etc-tuned\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.493707 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.493682    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0afc186c-a129-4603-8e41-a82b5015ab5d-agent-certs\") pod \"konnectivity-agent-jhrk5\" (UID: \"0afc186c-a129-4603-8e41-a82b5015ab5d\") " pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.493866 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.493839    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67wwj\" (UniqueName: \"kubernetes.io/projected/87f6027c-6f68-4d54-bce3-fabd01651d7c-kube-api-access-67wwj\") pod \"node-resolver-4v245\" (UID: \"87f6027c-6f68-4d54-bce3-fabd01651d7c\") " pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.494347 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.494326    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hssqw\" (UniqueName: \"kubernetes.io/projected/75c86c11-7f9d-4c9f-96e0-094cfb07d1fd-kube-api-access-hssqw\") pod \"ovnkube-node-rvks2\" (UID: \"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.495405 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.495389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jnpp\" (UniqueName: \"kubernetes.io/projected/dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc-kube-api-access-2jnpp\") pod \"aws-ebs-csi-driver-node-twn55\" (UID: \"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.498427 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.498402    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqj8\" (UniqueName: \"kubernetes.io/projected/1d084b97-b5e3-44cf-92b3-9fe3f27d8254-kube-api-access-mvqj8\") pod \"iptables-alerter-mfv7p\" (UID: \"1d084b97-b5e3-44cf-92b3-9fe3f27d8254\") " pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.499508 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.499489    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksgm9\" (UniqueName: \"kubernetes.io/projected/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-kube-api-access-ksgm9\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.500988 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.500966    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q5s5\" (UniqueName: \"kubernetes.io/projected/8a183b32-9436-497b-9c94-e29ebaefb4e7-kube-api-access-9q5s5\") pod \"multus-additional-cni-plugins-j2nh7\" (UID: \"8a183b32-9436-497b-9c94-e29ebaefb4e7\") " pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.502686 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.502664    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ecde8e-5384-4a1a-af6a-12c5fa179f13-tmp\") pod \"tuned-2hjq4\" (UID: \"b5ecde8e-5384-4a1a-af6a-12c5fa179f13\") " pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.584392 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gqv8\" (UniqueName: \"kubernetes.io/projected/e38a176c-b277-4f30-8a72-770c49b6cd02-kube-api-access-7gqv8\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.584392 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxbbl\" (UniqueName: \"kubernetes.io/projected/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-kube-api-access-qxbbl\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-cni-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-os-release\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-conf-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-daemon-config\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-kubelet\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e38a176c-b277-4f30-8a72-770c49b6cd02-host\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584598    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-system-cni-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584632 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-k8s-cni-cncf-io\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584923 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-socket-dir-parent\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.584923 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.584670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e38a176c-b277-4f30-8a72-770c49b6cd02-serviceca\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.585060 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585043    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e38a176c-b277-4f30-8a72-770c49b6cd02-serviceca\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.585133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585101    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-kubelet\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585170 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585145    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e38a176c-b277-4f30-8a72-770c49b6cd02-host\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.585281 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585243    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-daemon-config\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585325 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-netns\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585361 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-multus-certs\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585397 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-etc-kubernetes\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585429 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-cni-bin\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585429 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585403    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-system-cni-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585490 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-k8s-cni-cncf-io\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585490 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2712c79-9a77-4a8f-b23f-bff6bf19a602-cni-binary-copy\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585490 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-cnibin\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585490 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-hostroot\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585639 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-cni-multus\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585639 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjjrz\" (UniqueName: \"kubernetes.io/projected/d2712c79-9a77-4a8f-b23f-bff6bf19a602-kube-api-access-vjjrz\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585728 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585702    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-socket-dir-parent\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585764 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585751    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-cnibin\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585797 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-hostroot\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585828 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585795    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-cni-multus\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585828 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585818    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-conf-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585897 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585879    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2712c79-9a77-4a8f-b23f-bff6bf19a602-cni-binary-copy\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.585989 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585972    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-etc-kubernetes\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.586024 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585979    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-os-release\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.586024 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.586003    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:39.586024 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.585997    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-var-lib-cni-bin\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.586106 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.586032    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-multus-certs\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.586106 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.586049    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-multus-cni-dir\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.586106 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.586071    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:40.086053949 +0000 UTC m=+3.149530634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:39.586210 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.586109    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2712c79-9a77-4a8f-b23f-bff6bf19a602-host-run-netns\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.591093 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.591070    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:39.595165 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.595142    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxbbl\" (UniqueName: \"kubernetes.io/projected/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-kube-api-access-qxbbl\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:39.595447 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.595419    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:39.595447 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.595445    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:39.595603 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.595460    2562 projected.go:196] Error preparing data for projected volume kube-api-access-klx9v for pod openshift-network-diagnostics/network-check-target-8fhf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:39.595603 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.595547    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v podName:336b2b41-a2b7-4f16-84d7-ce024f88a001 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:40.095528834 +0000 UTC m=+3.159005514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-klx9v" (UniqueName: "kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v") pod "network-check-target-8fhf5" (UID: "336b2b41-a2b7-4f16-84d7-ce024f88a001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:39.595891 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.595873    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjjrz\" (UniqueName: \"kubernetes.io/projected/d2712c79-9a77-4a8f-b23f-bff6bf19a602-kube-api-access-vjjrz\") pod \"multus-qtf2s\" (UID: \"d2712c79-9a77-4a8f-b23f-bff6bf19a602\") " pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.596094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.596077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gqv8\" (UniqueName: \"kubernetes.io/projected/e38a176c-b277-4f30-8a72-770c49b6cd02-kube-api-access-7gqv8\") pod \"node-ca-7kgjv\" (UID: \"e38a176c-b277-4f30-8a72-770c49b6cd02\") " pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.663708 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.663455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55"
Jul 07 18:50:39.673104 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.673079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:50:39.684870 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.684847    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mfv7p"
Jul 07 18:50:39.693694 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.693669    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:50:39.701373 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.701342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hjq4"
Jul 07 18:50:39.714996 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.714965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4v245"
Jul 07 18:50:39.724766 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.724742    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j2nh7"
Jul 07 18:50:39.731374 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.731354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qtf2s"
Jul 07 18:50:39.738962 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.738946    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7kgjv"
Jul 07 18:50:39.988582 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:39.988493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:39.988734 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.988670    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:39.988799 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:39.988750    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret podName:2fa182a1-163e-474f-a336-fd278f564914 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:40.988728521 +0000 UTC m=+4.052205213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret") pod "global-pull-secret-syncer-5825v" (UID: "2fa182a1-163e-474f-a336-fd278f564914") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:40.088825 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:40.088789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:40.088967 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.088936    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:40.089017 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.089000    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:41.088985777 +0000 UTC m=+4.152462456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:40.189835 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:40.189779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:40.190020 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.189933    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:40.190020 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.189953    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:40.190020 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.189965    2562 projected.go:196] Error preparing data for projected volume kube-api-access-klx9v for pod openshift-network-diagnostics/network-check-target-8fhf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:40.190186 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.190023    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v podName:336b2b41-a2b7-4f16-84d7-ce024f88a001 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:41.190006486 +0000 UTC m=+4.253483188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-klx9v" (UniqueName: "kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v") pod "network-check-target-8fhf5" (UID: "336b2b41-a2b7-4f16-84d7-ce024f88a001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:40.431864 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:40.431771    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:45:39 +0000 UTC" deadline="2028-02-20 17:38:14.015783742 +0000 UTC"
Jul 07 18:50:40.431864 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:40.431800    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14230h47m33.583986896s"
Jul 07 18:50:40.440085 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:40.440057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:40.440222 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.440190    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:40.538064 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:40.538031    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:40.644504 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:40.644462    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2712c79_9a77_4a8f_b23f_bff6bf19a602.slice/crio-fa08d93dde5a73aa12ad1f7e8fb147c8400e5b9abf78a3154b0415bc39d37239 WatchSource:0}: Error finding container fa08d93dde5a73aa12ad1f7e8fb147c8400e5b9abf78a3154b0415bc39d37239: Status 404 returned error can't find the container with id fa08d93dde5a73aa12ad1f7e8fb147c8400e5b9abf78a3154b0415bc39d37239
Jul 07 18:50:40.647098 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:40.646934    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc13ab05_3aa3_4d7a_91e4_8838df3f7fbc.slice/crio-5c6e76f6aebfa985fce4be53c6bdd4e45bdddf96c9efd7da71ce9d53431b889d WatchSource:0}: Error finding container 5c6e76f6aebfa985fce4be53c6bdd4e45bdddf96c9efd7da71ce9d53431b889d: Status 404 returned error can't find the container with id 5c6e76f6aebfa985fce4be53c6bdd4e45bdddf96c9efd7da71ce9d53431b889d
Jul 07 18:50:40.649978 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:40.649955    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f6027c_6f68_4d54_bce3_fabd01651d7c.slice/crio-cb210e48d7d6f9795bafd8c539a52e5ed8bd2ab2b991d02067492bc2548324ca WatchSource:0}: Error finding container cb210e48d7d6f9795bafd8c539a52e5ed8bd2ab2b991d02067492bc2548324ca: Status 404 returned error can't find the container with id cb210e48d7d6f9795bafd8c539a52e5ed8bd2ab2b991d02067492bc2548324ca
Jul 07 18:50:40.650755 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:40.650688    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38a176c_b277_4f30_8a72_770c49b6cd02.slice/crio-67b0ca91f228a740e98a6ba5e6bac121ed483d97b2706cd6f0c84579b77d5cf4 WatchSource:0}: Error finding container 67b0ca91f228a740e98a6ba5e6bac121ed483d97b2706cd6f0c84579b77d5cf4: Status 404 returned error can't find the container with id 67b0ca91f228a740e98a6ba5e6bac121ed483d97b2706cd6f0c84579b77d5cf4
Jul 07 18:50:40.652644 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:40.652619    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d084b97_b5e3_44cf_92b3_9fe3f27d8254.slice/crio-ddebdc8969249a4712955008292a2b9a0948a45fe28bddc7f885ccfd903007db WatchSource:0}: Error finding container ddebdc8969249a4712955008292a2b9a0948a45fe28bddc7f885ccfd903007db: Status 404 returned error can't find the container with id ddebdc8969249a4712955008292a2b9a0948a45fe28bddc7f885ccfd903007db
Jul 07 18:50:40.652956 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:40.652866    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ecde8e_5384_4a1a_af6a_12c5fa179f13.slice/crio-3c72111b073fa5ffbb4bf1745c49bc5911e86f1fff5fa75510b50f22b1ee917e WatchSource:0}: Error finding container 3c72111b073fa5ffbb4bf1745c49bc5911e86f1fff5fa75510b50f22b1ee917e: Status 404 returned error can't find the container with id 3c72111b073fa5ffbb4bf1745c49bc5911e86f1fff5fa75510b50f22b1ee917e
Jul 07 18:50:40.657509 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:50:40.657476    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a183b32_9436_497b_9c94_e29ebaefb4e7.slice/crio-d77ff0de49dc894f8294a1eb0c8c6149a79770ee6e81a74997d3f53ec5a4a6ec WatchSource:0}: Error finding container d77ff0de49dc894f8294a1eb0c8c6149a79770ee6e81a74997d3f53ec5a4a6ec: Status 404 returned error can't find the container with id d77ff0de49dc894f8294a1eb0c8c6149a79770ee6e81a74997d3f53ec5a4a6ec
Jul 07 18:50:40.998336 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:40.996983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:40.998336 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.997436    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:40.998336 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:40.997529    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret podName:2fa182a1-163e-474f-a336-fd278f564914 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:42.997506849 +0000 UTC m=+6.060983544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret") pod "global-pull-secret-syncer-5825v" (UID: "2fa182a1-163e-474f-a336-fd278f564914") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:41.098513 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.098469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:41.098676 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.098617    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:41.098676 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.098670    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:43.098656311 +0000 UTC m=+6.162132989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:41.199375 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.199335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:41.199547 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.199503    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:41.199547 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.199525    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:41.199547 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.199537    2562 projected.go:196] Error preparing data for projected volume kube-api-access-klx9v for pod openshift-network-diagnostics/network-check-target-8fhf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:41.199697 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.199598    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v podName:336b2b41-a2b7-4f16-84d7-ce024f88a001 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:43.199579223 +0000 UTC m=+6.263055921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-klx9v" (UniqueName: "kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v") pod "network-check-target-8fhf5" (UID: "336b2b41-a2b7-4f16-84d7-ce024f88a001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:41.432902 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.432780    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:45:39 +0000 UTC" deadline="2028-04-12 11:05:23.372211442 +0000 UTC"
Jul 07 18:50:41.432902 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.432845    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15472h14m41.939370417s"
Jul 07 18:50:41.441823 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.441795    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:41.441969 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.441923    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:41.442564 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.442537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:41.442653 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:41.442638    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:41.480652 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.480615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7kgjv" event={"ID":"e38a176c-b277-4f30-8a72-770c49b6cd02","Type":"ContainerStarted","Data":"67b0ca91f228a740e98a6ba5e6bac121ed483d97b2706cd6f0c84579b77d5cf4"}
Jul 07 18:50:41.486597 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.486570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4v245" event={"ID":"87f6027c-6f68-4d54-bce3-fabd01651d7c","Type":"ContainerStarted","Data":"cb210e48d7d6f9795bafd8c539a52e5ed8bd2ab2b991d02067492bc2548324ca"}
Jul 07 18:50:41.492391 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.492340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55" event={"ID":"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc","Type":"ContainerStarted","Data":"5c6e76f6aebfa985fce4be53c6bdd4e45bdddf96c9efd7da71ce9d53431b889d"}
Jul 07 18:50:41.494706 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.494679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qtf2s" event={"ID":"d2712c79-9a77-4a8f-b23f-bff6bf19a602","Type":"ContainerStarted","Data":"fa08d93dde5a73aa12ad1f7e8fb147c8400e5b9abf78a3154b0415bc39d37239"}
Jul 07 18:50:41.498152 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.498124    2562 generic.go:356] "Generic (PLEG): container finished" podID="befb3c720b7a301ec6a4df2b8708f226" containerID="2777f7588d69573cfdc19e5a5ec3e6b69537a9ff9952e9a05a5dc1c60f4053b9" exitCode=0
Jul 07 18:50:41.498246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.498203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"befb3c720b7a301ec6a4df2b8708f226","Type":"ContainerDied","Data":"2777f7588d69573cfdc19e5a5ec3e6b69537a9ff9952e9a05a5dc1c60f4053b9"}
Jul 07 18:50:41.502321 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.502275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerStarted","Data":"d77ff0de49dc894f8294a1eb0c8c6149a79770ee6e81a74997d3f53ec5a4a6ec"}
Jul 07 18:50:41.514809 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.514778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhrk5" event={"ID":"0afc186c-a129-4603-8e41-a82b5015ab5d","Type":"ContainerStarted","Data":"036128530a23311504f9db96e65d54deb899fa17b1d8fa9d7ecf1f20ae551051"}
Jul 07 18:50:41.521527 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.521495    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mfv7p" event={"ID":"1d084b97-b5e3-44cf-92b3-9fe3f27d8254","Type":"ContainerStarted","Data":"ddebdc8969249a4712955008292a2b9a0948a45fe28bddc7f885ccfd903007db"}
Jul 07 18:50:41.526839 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.526733    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" event={"ID":"c8245c94532bb8528f3a95f6fc7b39d2","Type":"ContainerStarted","Data":"d13e2bce53423fda5fd21d7f3781d8654484541bd98e9ead5a61b97af54e9a61"}
Jul 07 18:50:41.548298 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.544516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"ef1e82123a1595a4232e1c4d23c1e7786f2cb7ae27244fb4ba3c4f33d721daf4"}
Jul 07 18:50:41.551005 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:41.550978    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hjq4" event={"ID":"b5ecde8e-5384-4a1a-af6a-12c5fa179f13","Type":"ContainerStarted","Data":"3c72111b073fa5ffbb4bf1745c49bc5911e86f1fff5fa75510b50f22b1ee917e"}
Jul 07 18:50:42.440114 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:42.439618    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:42.440114 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:42.439763    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:42.560020 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:42.559764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" event={"ID":"befb3c720b7a301ec6a4df2b8708f226","Type":"ContainerStarted","Data":"90102790edaa82c4fb1bca9d414c641ed887edea4f1f296693d117afa55fdb9f"}
Jul 07 18:50:42.575333 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:42.574865    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-202.ec2.internal" podStartSLOduration=4.5748423240000005 podStartE2EDuration="4.574842324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:41.542836963 +0000 UTC m=+4.606313665" watchObservedRunningTime="2026-07-07 18:50:42.574842324 +0000 UTC m=+5.638319026"
Jul 07 18:50:43.015741 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:43.015640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:43.015942 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.015796    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:43.015942 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.015881    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret podName:2fa182a1-163e-474f-a336-fd278f564914 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:47.015861398 +0000 UTC m=+10.079338090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret") pod "global-pull-secret-syncer-5825v" (UID: "2fa182a1-163e-474f-a336-fd278f564914") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:43.116060 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:43.116020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:43.116222 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.116158    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:43.116222 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.116208    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:47.116193835 +0000 UTC m=+10.179670513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:43.216646 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:43.216600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:43.216873 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.216798    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:43.216873 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.216822    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:43.216873 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.216837    2562 projected.go:196] Error preparing data for projected volume kube-api-access-klx9v for pod openshift-network-diagnostics/network-check-target-8fhf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:43.217033 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.216895    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v podName:336b2b41-a2b7-4f16-84d7-ce024f88a001 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:47.216876511 +0000 UTC m=+10.280353208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-klx9v" (UniqueName: "kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v") pod "network-check-target-8fhf5" (UID: "336b2b41-a2b7-4f16-84d7-ce024f88a001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:43.440642 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:43.440533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:43.441071 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.440673    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:43.441071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:43.440724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:43.441071 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:43.440798    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:44.440172 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:44.440135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:44.440379 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:44.440300    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:45.440421 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:45.440386    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:45.440864 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:45.440521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:45.441055 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:45.440917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:45.441055 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:45.441011    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:46.439979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:46.439947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:46.440145 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:46.440069    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:47.049449 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:47.049402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:47.049907 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.049602    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:47.049907 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.049679    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret podName:2fa182a1-163e-474f-a336-fd278f564914 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:55.049663135 +0000 UTC m=+18.113139829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret") pod "global-pull-secret-syncer-5825v" (UID: "2fa182a1-163e-474f-a336-fd278f564914") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:47.150416 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:47.150383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:47.150593 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.150560    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:47.150992 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.150641    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:55.150620176 +0000 UTC m=+18.214096857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:47.250842 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:47.250803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:47.251047 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.250999    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:47.251047 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.251023    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:47.251047 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.251034    2562 projected.go:196] Error preparing data for projected volume kube-api-access-klx9v for pod openshift-network-diagnostics/network-check-target-8fhf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:47.251205 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.251081    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v podName:336b2b41-a2b7-4f16-84d7-ce024f88a001 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:55.251068522 +0000 UTC m=+18.314545203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-klx9v" (UniqueName: "kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v") pod "network-check-target-8fhf5" (UID: "336b2b41-a2b7-4f16-84d7-ce024f88a001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:47.443140 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:47.443066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:47.443299 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.443172    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:47.443634 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:47.443472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:47.443634 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:47.443593    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:48.439932 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:48.439896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:48.440445 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:48.440034    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:49.441245 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:49.441209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:49.441686 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:49.441362    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:49.441686 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:49.441411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:49.441686 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:49.441510    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:50.439288 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:50.439238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:50.439442 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:50.439367    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:51.439739 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:51.439655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:51.440134 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:51.439790    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:51.440221 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:51.440197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:51.440355 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:51.440318    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:52.439723 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:52.439685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:52.439901 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:52.439812    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:53.439927 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:53.439887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:53.440359 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:53.439997    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:53.440359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:53.440066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:53.440359 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:53.440175    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:54.439526 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:54.439441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:54.439717 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:54.439578    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:55.105278 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:55.105232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:55.105676 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.105387    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:55.105676 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.105455    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret podName:2fa182a1-163e-474f-a336-fd278f564914 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:11.10543585 +0000 UTC m=+34.168912531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret") pod "global-pull-secret-syncer-5825v" (UID: "2fa182a1-163e-474f-a336-fd278f564914") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:55.206453 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:55.206415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:55.206619 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.206597    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:55.206690 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.206678    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:11.206655719 +0000 UTC m=+34.270132414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:55.307848 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:55.307798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:55.308023 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.307965    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:55.308023 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.307991    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:55.308023 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.308001    2562 projected.go:196] Error preparing data for projected volume kube-api-access-klx9v for pod openshift-network-diagnostics/network-check-target-8fhf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:55.308139 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.308061    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v podName:336b2b41-a2b7-4f16-84d7-ce024f88a001 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:11.308044198 +0000 UTC m=+34.371520894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-klx9v" (UniqueName: "kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v") pod "network-check-target-8fhf5" (UID: "336b2b41-a2b7-4f16-84d7-ce024f88a001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:55.442194 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:55.442112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:55.442354 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.442215    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:55.442410 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:55.442362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:55.442519 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:55.442472    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:56.439133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:56.439102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:56.439592 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:56.439237    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:57.440808 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:57.440773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:57.441235 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:57.440909    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:50:57.441235 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:57.440967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:57.441235 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:57.441076    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:58.439970 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:58.439932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:50:58.440120 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:58.440059    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:50:59.440044 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:59.440013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:50:59.440442 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:59.440121    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:50:59.440442 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:50:59.440171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:50:59.440442 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:50:59.440249    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:00.439293 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.439098    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:00.439407 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:00.439382    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:00.597554 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.597530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 18:51:00.598359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.597912    2562 generic.go:356] "Generic (PLEG): container finished" podID="75c86c11-7f9d-4c9f-96e0-094cfb07d1fd" containerID="72971907bc12ff590f796c97a0dd9caa91769c23fff506596742e1720a37a225" exitCode=1
Jul 07 18:51:00.598359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.597995    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"e2c804417fe5a967d7e9c6c3335b4d56efe8ef9f91b96b45b88b5e5c717cf0b9"}
Jul 07 18:51:00.598359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.598085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"476585c0d1266124dab66df28c5276ba12c85934b3f8226d40560edcbc145b24"}
Jul 07 18:51:00.598359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.598139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"9f16b0178ad7f81ec7c907cf71d4174641261252780ef8dcf6f91c010acd5f67"}
Jul 07 18:51:00.598359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.598190    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"68a010011a7b2570556a40aa3df15db025f8dfa3a772ff526d4e8b00a1b44dcd"}
Jul 07 18:51:00.598359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.598235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerDied","Data":"72971907bc12ff590f796c97a0dd9caa91769c23fff506596742e1720a37a225"}
Jul 07 18:51:00.598359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.598309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"2fc1d8129046e811ac3317fa6c8e653a475da162982801ab3939bbecb18c3946"}
Jul 07 18:51:00.600171 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.600147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hjq4" event={"ID":"b5ecde8e-5384-4a1a-af6a-12c5fa179f13","Type":"ContainerStarted","Data":"9e48659c9163ae128dc05d75369f139675b4e8d6d4a82e9d7a24049743f70568"}
Jul 07 18:51:00.602089 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.602041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7kgjv" event={"ID":"e38a176c-b277-4f30-8a72-770c49b6cd02","Type":"ContainerStarted","Data":"7a6e2e8c655969a5027420e5b3c91a6dce67a79bfc04ea0cf8f4e0f39b057b69"}
Jul 07 18:51:00.604307 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.604283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4v245" event={"ID":"87f6027c-6f68-4d54-bce3-fabd01651d7c","Type":"ContainerStarted","Data":"cfc8878a91e711967e79766f90fcc4cba588ec6d26136c21c337a9d24530412b"}
Jul 07 18:51:00.606225 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.606188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55" event={"ID":"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc","Type":"ContainerStarted","Data":"a821ecc734316c8002db2e766a12c8255e3ba78d8b67f8a7dba08cbe18993547"}
Jul 07 18:51:00.608353 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.608332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qtf2s" event={"ID":"d2712c79-9a77-4a8f-b23f-bff6bf19a602","Type":"ContainerStarted","Data":"4ac7e7e58e8ae0b02763bace7df95200682be0b2c0a77dd3b075e40912ed277c"}
Jul 07 18:51:00.610248 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.610223    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a183b32-9436-497b-9c94-e29ebaefb4e7" containerID="dad04f7f2fa790e07195b1542bdc93c8bb97ae8876564125c5bbba398ce699ec" exitCode=0
Jul 07 18:51:00.610352 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.610283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerDied","Data":"dad04f7f2fa790e07195b1542bdc93c8bb97ae8876564125c5bbba398ce699ec"}
Jul 07 18:51:00.612854 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.612830    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhrk5" event={"ID":"0afc186c-a129-4603-8e41-a82b5015ab5d","Type":"ContainerStarted","Data":"63ccc221a610dc72dbfbd7f92139d5c48fa1f4b50cd0dc2968edf3163fc60b41"}
Jul 07 18:51:00.621225 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.621137    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2hjq4" podStartSLOduration=4.602744924 podStartE2EDuration="23.621120785s" totalImagesPullingTime="19.018375861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:00.620577541 +0000 UTC m=+23.684054242" watchObservedRunningTime="2026-07-07 18:51:00.621120785 +0000 UTC m=+23.684597488"
Jul 07 18:51:00.621558 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.621527    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-202.ec2.internal" podStartSLOduration=22.621519403 podStartE2EDuration="22.621519403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:42.575246399 +0000 UTC m=+5.638723099" watchObservedRunningTime="2026-07-07 18:51:00.621519403 +0000 UTC m=+23.684996103"
Jul 07 18:51:00.635220 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.635177    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jhrk5" podStartSLOduration=13.268769838 podStartE2EDuration="23.635164363s" totalImagesPullingTime="10.366394525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:00.634800905 +0000 UTC m=+23.698277606" watchObservedRunningTime="2026-07-07 18:51:00.635164363 +0000 UTC m=+23.698641289"
Jul 07 18:51:00.693168 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.693124    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4v245" podStartSLOduration=4.692308913 podStartE2EDuration="23.693109146s" totalImagesPullingTime="19.000800233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:00.657973214 +0000 UTC m=+23.721449915" watchObservedRunningTime="2026-07-07 18:51:00.693109146 +0000 UTC m=+23.756585846"
Jul 07 18:51:00.730567 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.730515    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7kgjv" podStartSLOduration=4.710739066 podStartE2EDuration="23.73049958s" totalImagesPullingTime="19.019760514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:00.730396527 +0000 UTC m=+23.793873227" watchObservedRunningTime="2026-07-07 18:51:00.73049958 +0000 UTC m=+23.793976281"
Jul 07 18:51:00.730776 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:00.730757    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qtf2s" podStartSLOduration=4.676244308 podStartE2EDuration="23.730751931s" totalImagesPullingTime="19.054507623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:00.711413209 +0000 UTC m=+23.774889910" watchObservedRunningTime="2026-07-07 18:51:00.730751931 +0000 UTC m=+23.794228631"
Jul 07 18:51:01.268064 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.268022    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 18:51:01.438979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.438840    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:51:01.268046165Z","UUID":"c157cf6a-7a79-4c89-8630-33e766e3890c","Handler":null,"Name":"","Endpoint":""}
Jul 07 18:51:01.439223 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.439197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:01.439358 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:01.439324    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:01.439413 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.439387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:01.439503 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:01.439479    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:51:01.440440 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.440425    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 18:51:01.440547 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.440464    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 18:51:01.616896 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.616866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55" event={"ID":"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc","Type":"ContainerStarted","Data":"a03807d1a4c69b39f7a5b14d9934168e5ba95cf007c502f4e76c522daa7fd7c7"}
Jul 07 18:51:01.618292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.618251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mfv7p" event={"ID":"1d084b97-b5e3-44cf-92b3-9fe3f27d8254","Type":"ContainerStarted","Data":"164ea226de84da67d0ebe13322ef3ec58032c49c5a80ad694b152d2dc9fe7bef"}
Jul 07 18:51:01.633749 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:01.633704    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mfv7p" podStartSLOduration=5.885425688 podStartE2EDuration="24.633691641s" totalImagesPullingTime="18.748265953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:01.633411935 +0000 UTC m=+24.696888634" watchObservedRunningTime="2026-07-07 18:51:01.633691641 +0000 UTC m=+24.697168340"
Jul 07 18:51:02.439774 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:02.439749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:02.439912 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:02.439855    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:02.623966 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:02.623945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 18:51:02.624426 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:02.624404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"677c6e849f3f6b9a94d5ff106abde46ea4c036f75303267c5f1f2c838367fdd1"}
Jul 07 18:51:02.626583 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:02.626545    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55" event={"ID":"dc13ab05-3aa3-4d7a-91e4-8838df3f7fbc","Type":"ContainerStarted","Data":"153db6b4bed408e32e2b6253f6dc65d8b65faece0a11545bb813df30eeb7bb01"}
Jul 07 18:51:02.651866 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:02.651817    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twn55" podStartSLOduration=4.344689789 podStartE2EDuration="25.65178791s" totalImagesPullingTime="21.307098121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:02.646603113 +0000 UTC m=+25.710079814" watchObservedRunningTime="2026-07-07 18:51:02.65178791 +0000 UTC m=+25.715264612"
Jul 07 18:51:03.440084 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:03.439908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:03.440300 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:03.439978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:03.440300 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:03.440155    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:03.440300 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:03.440228    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:51:04.439535 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:04.439502    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:04.439996 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:04.439611    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:04.840555 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:04.840383    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:51:04.841037 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:04.841017    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:51:05.439685 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:05.439650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:05.440342 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:05.439779    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:05.440342 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:05.439835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:05.440342 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:05.439920    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:51:05.635664 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:05.635638    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 18:51:05.636031 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:05.636000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"c1d7c13aa19fcdc6d84e4519ef54695d05bb32143aa325934d21758bb7ccf8ac"}
Jul 07 18:51:05.636278 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:05.636239    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:51:05.636476 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:05.636459    2562 scope.go:117] "RemoveContainer" containerID="72971907bc12ff590f796c97a0dd9caa91769c23fff506596742e1720a37a225"
Jul 07 18:51:05.636695 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:05.636678    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jhrk5"
Jul 07 18:51:06.440247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.440213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:06.440769 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:06.440346    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:06.643338 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.643309    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 18:51:06.643746 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.643713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" event={"ID":"75c86c11-7f9d-4c9f-96e0-094cfb07d1fd","Type":"ContainerStarted","Data":"1a22d19d4cba748b34d7156ef327e292bdcd62213516ec8b4558717a446fca35"}
Jul 07 18:51:06.643988 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.643968    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:51:06.644203 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.644186    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:51:06.644293 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.644282    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:51:06.663753 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.663728    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:51:06.663890 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.663871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:51:06.680565 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.680523    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2" podStartSLOduration=10.592196599 podStartE2EDuration="29.680506176s" totalImagesPullingTime="19.088309577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:06.680205208 +0000 UTC m=+29.743681911" watchObservedRunningTime="2026-07-07 18:51:06.680506176 +0000 UTC m=+29.743982875"
Jul 07 18:51:06.920642 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.920601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5825v"]
Jul 07 18:51:06.920790 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.920728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:06.920858 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:06.920834    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:51:06.926790 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.926743    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jgw7m"]
Jul 07 18:51:06.926994 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.926892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:06.927054 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:06.927009    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:06.927546 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.927519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fhf5"]
Jul 07 18:51:06.927664 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:06.927617    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:06.927719 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:06.927700    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:08.440136 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:08.440108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:08.440561 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:08.440211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:08.440561 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:08.440223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:08.440561 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:08.440217    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:08.440561 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:08.440320    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:08.440561 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:08.440392    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:51:08.650390 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:08.650355    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a183b32-9436-497b-9c94-e29ebaefb4e7" containerID="8a9219c15fd83b519305bc9a53918bd54d3c99bb99fc2c302ab9aa54945b9e88" exitCode=0
Jul 07 18:51:08.650525 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:08.650447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerDied","Data":"8a9219c15fd83b519305bc9a53918bd54d3c99bb99fc2c302ab9aa54945b9e88"}
Jul 07 18:51:09.654709 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:09.654529    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a183b32-9436-497b-9c94-e29ebaefb4e7" containerID="6386fbb135b52d945a4c52c82afc876d1e93d0fb70b0417d48f9cb48dd2008a8" exitCode=0
Jul 07 18:51:09.654709 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:09.654609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerDied","Data":"6386fbb135b52d945a4c52c82afc876d1e93d0fb70b0417d48f9cb48dd2008a8"}
Jul 07 18:51:10.439730 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:10.439694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:10.440015 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:10.439695    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:10.440015 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:10.439811    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:10.440015 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:10.439826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:10.440015 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:10.439918    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:51:10.440015 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:10.440005    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:10.659544 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:10.659515    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a183b32-9436-497b-9c94-e29ebaefb4e7" containerID="15989cc7ff338392950594ca927a2aaff6bf0d26d003c9f920dd16edd666761c" exitCode=0
Jul 07 18:51:10.660040 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:10.659552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerDied","Data":"15989cc7ff338392950594ca927a2aaff6bf0d26d003c9f920dd16edd666761c"}
Jul 07 18:51:11.134939 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:11.134859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:11.135078 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.134972    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:11.135078 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.135025    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret podName:2fa182a1-163e-474f-a336-fd278f564914 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:43.135012125 +0000 UTC m=+66.198488804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret") pod "global-pull-secret-syncer-5825v" (UID: "2fa182a1-163e-474f-a336-fd278f564914") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:11.235942 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:11.235912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:11.236101 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.236070    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:11.236155 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.236137    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:43.236121154 +0000 UTC m=+66.299597832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:11.336895 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:11.336855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:11.337078 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.337034    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:51:11.337078 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.337055    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:51:11.337078 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.337065    2562 projected.go:196] Error preparing data for projected volume kube-api-access-klx9v for pod openshift-network-diagnostics/network-check-target-8fhf5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:11.337218 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:11.337118    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v podName:336b2b41-a2b7-4f16-84d7-ce024f88a001 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:43.337104607 +0000 UTC m=+66.400581285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-klx9v" (UniqueName: "kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v") pod "network-check-target-8fhf5" (UID: "336b2b41-a2b7-4f16-84d7-ce024f88a001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:12.439478 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.439435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:12.439478 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.439473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:12.440095 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.439453    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:12.440095 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.439563    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgw7m" podUID="2ab0ffc3-9c02-4a8b-9555-84da21ad5f26"
Jul 07 18:51:12.440095 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.439674    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5825v" podUID="2fa182a1-163e-474f-a336-fd278f564914"
Jul 07 18:51:12.440095 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.439748    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhf5" podUID="336b2b41-a2b7-4f16-84d7-ce024f88a001"
Jul 07 18:51:12.697720 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.697691    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-202.ec2.internal" event="NodeReady"
Jul 07 18:51:12.697882 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.697833    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 18:51:12.730778 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.730750    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c9595fff9-htn96"]
Jul 07 18:51:12.732520 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.732505    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.734452 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.734428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 18:51:12.734576 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.734533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rtr89\""
Jul 07 18:51:12.734755 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.734739    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 18:51:12.734821 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.734797    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 18:51:12.743672 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.743651    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 18:51:12.746435 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.746413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c9595fff9-htn96"]
Jul 07 18:51:12.749623 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.749590    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b7n7x"]
Jul 07 18:51:12.751507 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.751490    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8fdgx"]
Jul 07 18:51:12.751629 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.751614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.753521 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.753498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:12.753617 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.753535    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 18:51:12.753684 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.753561    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crmbz\""
Jul 07 18:51:12.753924 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.753909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 18:51:12.755722 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.755705    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zsh2j\""
Jul 07 18:51:12.756770 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.756748    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 18:51:12.757088 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.757062    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 18:51:12.757170 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.757129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 18:51:12.765051 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.765029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fdgx"]
Jul 07 18:51:12.765652 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.765630    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b7n7x"]
Jul 07 18:51:12.847228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-bound-sa-token\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46abbced-4c33-43e0-b8f4-2bcdf4464edf-cert\") pod \"ingress-canary-8fdgx\" (UID: \"46abbced-4c33-43e0-b8f4-2bcdf4464edf\") " pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:12.847464 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-trusted-ca\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847464 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-image-registry-private-configuration\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847464 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-certificates\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847464 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847464 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847440    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-ca-trust-extracted\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847464 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.847729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-config-volume\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.847729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7zr6\" (UniqueName: \"kubernetes.io/projected/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-kube-api-access-k7zr6\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.847729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-installation-pull-secrets\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f57lk\" (UniqueName: \"kubernetes.io/projected/46abbced-4c33-43e0-b8f4-2bcdf4464edf-kube-api-access-f57lk\") pod \"ingress-canary-8fdgx\" (UID: \"46abbced-4c33-43e0-b8f4-2bcdf4464edf\") " pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:12.847729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpj9s\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-kube-api-access-bpj9s\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.847729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.847676    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-tmp-dir\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.948002 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.947929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-bound-sa-token\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948002 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.947961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46abbced-4c33-43e0-b8f4-2bcdf4464edf-cert\") pod \"ingress-canary-8fdgx\" (UID: \"46abbced-4c33-43e0-b8f4-2bcdf4464edf\") " pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:12.948002 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.947991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-trusted-ca\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-image-registry-private-configuration\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-certificates\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-ca-trust-extracted\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-config-volume\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7zr6\" (UniqueName: \"kubernetes.io/projected/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-kube-api-access-k7zr6\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-installation-pull-secrets\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f57lk\" (UniqueName: \"kubernetes.io/projected/46abbced-4c33-43e0-b8f4-2bcdf4464edf-kube-api-access-f57lk\") pod \"ingress-canary-8fdgx\" (UID: \"46abbced-4c33-43e0-b8f4-2bcdf4464edf\") " pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.948213    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:12.948247 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.948234    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9595fff9-htn96: secret "image-registry-tls" not found
Jul 07 18:51:12.948809 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.948319    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls podName:f9bc6c87-1433-4af2-b6b4-9587c15aeb2c nodeName:}" failed. No retries permitted until 2026-07-07 18:51:13.448297292 +0000 UTC m=+36.511773991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls") pod "image-registry-5c9595fff9-htn96" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c") : secret "image-registry-tls" not found
Jul 07 18:51:12.948809 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpj9s\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-kube-api-access-bpj9s\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948809 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-tmp-dir\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.948809 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948686    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-tmp-dir\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.948809 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.948350    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:12.948809 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-ca-trust-extracted\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.948809 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:12.948771    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls podName:b72e3ba1-083d-49bb-9362-c0dbd9928bc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:13.44875438 +0000 UTC m=+36.512231057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls") pod "dns-default-b7n7x" (UID: "b72e3ba1-083d-49bb-9362-c0dbd9928bc6") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:12.949154 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.948854    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-config-volume\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.949154 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.949089    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-trusted-ca\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.949320 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.949234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-certificates\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.952203 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.952173    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-installation-pull-secrets\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.952310 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.952173    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-image-registry-private-configuration\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.952310 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.952177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46abbced-4c33-43e0-b8f4-2bcdf4464edf-cert\") pod \"ingress-canary-8fdgx\" (UID: \"46abbced-4c33-43e0-b8f4-2bcdf4464edf\") " pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:12.956946 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.956926    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpj9s\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-kube-api-access-bpj9s\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.957216 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.957187    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-bound-sa-token\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:12.957608 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.957580    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7zr6\" (UniqueName: \"kubernetes.io/projected/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-kube-api-access-k7zr6\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:12.958127 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:12.958105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f57lk\" (UniqueName: \"kubernetes.io/projected/46abbced-4c33-43e0-b8f4-2bcdf4464edf-kube-api-access-f57lk\") pod \"ingress-canary-8fdgx\" (UID: \"46abbced-4c33-43e0-b8f4-2bcdf4464edf\") " pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:13.067596 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:13.067557    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fdgx"
Jul 07 18:51:13.232021 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:13.231704    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fdgx"]
Jul 07 18:51:13.236111 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:13.236079    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46abbced_4c33_43e0_b8f4_2bcdf4464edf.slice/crio-ec3f0da48d7a4510f5c8e74199c422457d9fc2050043bd35ce900bfe6db65d95 WatchSource:0}: Error finding container ec3f0da48d7a4510f5c8e74199c422457d9fc2050043bd35ce900bfe6db65d95: Status 404 returned error can't find the container with id ec3f0da48d7a4510f5c8e74199c422457d9fc2050043bd35ce900bfe6db65d95
Jul 07 18:51:13.452612 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:13.452573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:13.452612 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:13.452613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:13.453232 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:13.452724    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:13.453232 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:13.452728    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:13.453232 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:13.452743    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9595fff9-htn96: secret "image-registry-tls" not found
Jul 07 18:51:13.453232 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:13.452787    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls podName:f9bc6c87-1433-4af2-b6b4-9587c15aeb2c nodeName:}" failed. No retries permitted until 2026-07-07 18:51:14.45276979 +0000 UTC m=+37.516246485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls") pod "image-registry-5c9595fff9-htn96" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c") : secret "image-registry-tls" not found
Jul 07 18:51:13.453232 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:13.452801    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls podName:b72e3ba1-083d-49bb-9362-c0dbd9928bc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:14.452793785 +0000 UTC m=+37.516270463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls") pod "dns-default-b7n7x" (UID: "b72e3ba1-083d-49bb-9362-c0dbd9928bc6") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:13.667993 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:13.667912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fdgx" event={"ID":"46abbced-4c33-43e0-b8f4-2bcdf4464edf","Type":"ContainerStarted","Data":"ec3f0da48d7a4510f5c8e74199c422457d9fc2050043bd35ce900bfe6db65d95"}
Jul 07 18:51:14.440075 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.440039    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:14.440291 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.440041    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:14.440291 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.440050    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:14.442520 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.442485    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:51:14.442953 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.442934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:51:14.443066 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.442957    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9524g\""
Jul 07 18:51:14.443066 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.442992    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:51:14.443066 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.442941    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:51:14.443332 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.443315    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nk7wp\""
Jul 07 18:51:14.461898 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.461876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:14.462253 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:14.461915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:14.462253 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:14.462026    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:14.462253 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:14.462044    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9595fff9-htn96: secret "image-registry-tls" not found
Jul 07 18:51:14.462253 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:14.462082    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:14.462253 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:14.462104    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls podName:f9bc6c87-1433-4af2-b6b4-9587c15aeb2c nodeName:}" failed. No retries permitted until 2026-07-07 18:51:16.462083497 +0000 UTC m=+39.525560178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls") pod "image-registry-5c9595fff9-htn96" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c") : secret "image-registry-tls" not found
Jul 07 18:51:14.462253 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:14.462121    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls podName:b72e3ba1-083d-49bb-9362-c0dbd9928bc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:16.462111073 +0000 UTC m=+39.525587786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls") pod "dns-default-b7n7x" (UID: "b72e3ba1-083d-49bb-9362-c0dbd9928bc6") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:16.479417 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:16.479379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:16.479417 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:16.479422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:16.479953 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:16.479561    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:16.479953 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:16.479574    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9595fff9-htn96: secret "image-registry-tls" not found
Jul 07 18:51:16.479953 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:16.479579    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:16.479953 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:16.479637    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls podName:f9bc6c87-1433-4af2-b6b4-9587c15aeb2c nodeName:}" failed. No retries permitted until 2026-07-07 18:51:20.479616875 +0000 UTC m=+43.543093576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls") pod "image-registry-5c9595fff9-htn96" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c") : secret "image-registry-tls" not found
Jul 07 18:51:16.479953 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:16.479664    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls podName:b72e3ba1-083d-49bb-9362-c0dbd9928bc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:20.479644607 +0000 UTC m=+43.543121298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls") pod "dns-default-b7n7x" (UID: "b72e3ba1-083d-49bb-9362-c0dbd9928bc6") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:18.682843 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:18.682630    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a183b32-9436-497b-9c94-e29ebaefb4e7" containerID="c8e95c33e0a94687a4126edc80dc077969e79eaac1453e4a280f3fdbb3acc645" exitCode=0
Jul 07 18:51:18.683251 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:18.682723    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerDied","Data":"c8e95c33e0a94687a4126edc80dc077969e79eaac1453e4a280f3fdbb3acc645"}
Jul 07 18:51:18.684401 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:18.684378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fdgx" event={"ID":"46abbced-4c33-43e0-b8f4-2bcdf4464edf","Type":"ContainerStarted","Data":"5990a48810a68cd41f7ff58415863988b528648c868bb619c515addad03eb937"}
Jul 07 18:51:18.720942 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:18.720900    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8fdgx" podStartSLOduration=2.345033753 podStartE2EDuration="6.720883996s" totalImagesPullingTime="4.375850243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:18.720303243 +0000 UTC m=+41.783779944" watchObservedRunningTime="2026-07-07 18:51:18.720883996 +0000 UTC m=+41.784360696"
Jul 07 18:51:19.690196 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:19.690159    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a183b32-9436-497b-9c94-e29ebaefb4e7" containerID="2a69fcfc17885ba637e728354f295fd1923ac8a5acd92187eda730e07c37576e" exitCode=0
Jul 07 18:51:19.690575 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:19.690244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerDied","Data":"2a69fcfc17885ba637e728354f295fd1923ac8a5acd92187eda730e07c37576e"}
Jul 07 18:51:20.508325 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:20.508289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:20.508325 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:20.508325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:20.508544 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:20.508424    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:20.508544 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:20.508435    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:20.508544 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:20.508461    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9595fff9-htn96: secret "image-registry-tls" not found
Jul 07 18:51:20.508544 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:20.508475    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls podName:b72e3ba1-083d-49bb-9362-c0dbd9928bc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:28.508462284 +0000 UTC m=+51.571938962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls") pod "dns-default-b7n7x" (UID: "b72e3ba1-083d-49bb-9362-c0dbd9928bc6") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:20.508544 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:20.508510    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls podName:f9bc6c87-1433-4af2-b6b4-9587c15aeb2c nodeName:}" failed. No retries permitted until 2026-07-07 18:51:28.508497741 +0000 UTC m=+51.571974419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls") pod "image-registry-5c9595fff9-htn96" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c") : secret "image-registry-tls" not found
Jul 07 18:51:20.695770 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:20.695734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" event={"ID":"8a183b32-9436-497b-9c94-e29ebaefb4e7","Type":"ContainerStarted","Data":"5600a47dd33941f33e7f6efbbc905088f0204a2283c38dc71bd1bde1021e238c"}
Jul 07 18:51:20.723075 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:20.723025    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j2nh7" podStartSLOduration=8.902612607 podStartE2EDuration="43.723010278s" totalImagesPullingTime="34.820397671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:20.722189667 +0000 UTC m=+43.785666367" watchObservedRunningTime="2026-07-07 18:51:20.723010278 +0000 UTC m=+43.786486977"
Jul 07 18:51:26.704148 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.704114    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"]
Jul 07 18:51:26.713393 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.713372    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"]
Jul 07 18:51:26.713518 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.713495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.715490 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.715453    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.716122 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.716101    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.716637 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.716387    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 18:51:26.716806 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.716785    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 18:51:26.716922 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.716826    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cff2n\""
Jul 07 18:51:26.724295 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.724253    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"]
Jul 07 18:51:26.724412 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.724356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"
Jul 07 18:51:26.726162 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.726140    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.726378 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.726210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8m699\""
Jul 07 18:51:26.726444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.726378    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.739069 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.739048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"]
Jul 07 18:51:26.739183 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.739087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"]
Jul 07 18:51:26.739183 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.739153    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.739960 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.739941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"]
Jul 07 18:51:26.741543 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.741517    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 18:51:26.741762 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.741740    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.742076 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.741839    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rl9tp\""
Jul 07 18:51:26.742076 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.741752    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 18:51:26.742221 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.742091    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.754603 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.754581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5588527f-2b7a-47e2-95d3-0f10164a6c5f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.754699 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.754614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntnlv\" (UniqueName: \"kubernetes.io/projected/5588527f-2b7a-47e2-95d3-0f10164a6c5f-kube-api-access-ntnlv\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.754699 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.754678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5588527f-2b7a-47e2-95d3-0f10164a6c5f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.754773 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.754699    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smtc\" (UniqueName: \"kubernetes.io/projected/c1b50a37-3900-431f-83ae-e7997ca3ed3b-kube-api-access-6smtc\") pod \"volume-data-source-validator-5d456fdbcd-t4cv2\" (UID: \"c1b50a37-3900-431f-83ae-e7997ca3ed3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"
Jul 07 18:51:26.754806 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.754766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.754838 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.754817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2f643423-faf7-4ab2-9a74-f2e47ae97560-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.754872 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.754838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n868\" (UniqueName: \"kubernetes.io/projected/2f643423-faf7-4ab2-9a74-f2e47ae97560-kube-api-access-4n868\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.807049 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.807016    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"]
Jul 07 18:51:26.821253 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.821227    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"]
Jul 07 18:51:26.821402 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.821356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"
Jul 07 18:51:26.824061 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.824039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wj6s8\""
Jul 07 18:51:26.830429 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.830407    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tgmzp"]
Jul 07 18:51:26.830577 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.830528    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:26.833684 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.833661    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.833684 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.833676    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.833862 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.833681    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lxzdr\""
Jul 07 18:51:26.833862 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.833661    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 18:51:26.842831 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.842813    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hz6b4"]
Jul 07 18:51:26.842930 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.842916    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:26.849147 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.849128    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.849242 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.849229    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 18:51:26.849324 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.849244    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-j9zcd\""
Jul 07 18:51:26.849416 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.849400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 18:51:26.849450 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.849438    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.854024 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.854004    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 18:51:26.855758 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855742    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.855834 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2f643423-faf7-4ab2-9a74-f2e47ae97560-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.855834 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n868\" (UniqueName: \"kubernetes.io/projected/2f643423-faf7-4ab2-9a74-f2e47ae97560-kube-api-access-4n868\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.855903 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5588527f-2b7a-47e2-95d3-0f10164a6c5f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.855903 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n7vl\" (UniqueName: \"kubernetes.io/projected/3bab02b7-8112-467f-9598-8d21ae922500-kube-api-access-8n7vl\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:26.855903 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntnlv\" (UniqueName: \"kubernetes.io/projected/5588527f-2b7a-47e2-95d3-0f10164a6c5f-kube-api-access-ntnlv\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.855903 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:26.855894    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:26.856073 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w8lc\" (UniqueName: \"kubernetes.io/projected/55bf9dfa-bd56-47d3-ab40-42a2b56610cd-kube-api-access-6w8lc\") pod \"network-check-source-989f8b8dc-jt9g6\" (UID: \"55bf9dfa-bd56-47d3-ab40-42a2b56610cd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"
Jul 07 18:51:26.856073 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.855925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:26.856073 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:26.855981    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls podName:2f643423-faf7-4ab2-9a74-f2e47ae97560 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:27.355943524 +0000 UTC m=+50.419420223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dxk88" (UID: "2f643423-faf7-4ab2-9a74-f2e47ae97560") : secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:26.856073 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.856052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5588527f-2b7a-47e2-95d3-0f10164a6c5f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.856296 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.856085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smtc\" (UniqueName: \"kubernetes.io/projected/c1b50a37-3900-431f-83ae-e7997ca3ed3b-kube-api-access-6smtc\") pod \"volume-data-source-validator-5d456fdbcd-t4cv2\" (UID: \"c1b50a37-3900-431f-83ae-e7997ca3ed3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"
Jul 07 18:51:26.856471 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.856454    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5588527f-2b7a-47e2-95d3-0f10164a6c5f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.856517 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.856472    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2f643423-faf7-4ab2-9a74-f2e47ae97560-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.857727 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.857709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"]
Jul 07 18:51:26.857727 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.857736    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"]
Jul 07 18:51:26.857873 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.857754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tgmzp"]
Jul 07 18:51:26.857873 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.857770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hz6b4"]
Jul 07 18:51:26.857873 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.857811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:26.859629 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.859610    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.859629 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.859623    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 18:51:26.859749 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.859661    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 18:51:26.859749 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.859680    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dprgz\""
Jul 07 18:51:26.859996 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.859979    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.860297 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.860281    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5588527f-2b7a-47e2-95d3-0f10164a6c5f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.866580 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.866559    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 18:51:26.867198 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.867178    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n868\" (UniqueName: \"kubernetes.io/projected/2f643423-faf7-4ab2-9a74-f2e47ae97560-kube-api-access-4n868\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:26.868130 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.868112    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntnlv\" (UniqueName: \"kubernetes.io/projected/5588527f-2b7a-47e2-95d3-0f10164a6c5f-kube-api-access-ntnlv\") pod \"kube-storage-version-migrator-operator-846bf668f7-m68sl\" (UID: \"5588527f-2b7a-47e2-95d3-0f10164a6c5f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:26.868386 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.868367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smtc\" (UniqueName: \"kubernetes.io/projected/c1b50a37-3900-431f-83ae-e7997ca3ed3b-kube-api-access-6smtc\") pod \"volume-data-source-validator-5d456fdbcd-t4cv2\" (UID: \"c1b50a37-3900-431f-83ae-e7997ca3ed3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"
Jul 07 18:51:26.913126 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.913095    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"]
Jul 07 18:51:26.932023 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.931949    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8647695769-hvrjk"]
Jul 07 18:51:26.932217 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.932197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:26.934180 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.934159    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.934317 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.934228    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 18:51:26.934317 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.934162    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 18:51:26.934317 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.934299    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hjj68\""
Jul 07 18:51:26.934635 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.934620    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.944417 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.944398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"]
Jul 07 18:51:26.944486 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.944427    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8647695769-hvrjk"]
Jul 07 18:51:26.944528 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.944504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:26.946469 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.946450    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 18:51:26.946650 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.946611    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 18:51:26.946761 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.946612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 18:51:26.946761 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.946689    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hc79r\""
Jul 07 18:51:26.946761 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.946715    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 18:51:26.946957 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.946830    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 18:51:26.946957 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.946864    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 18:51:26.956780 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.956736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0ee4d04-87c0-4489-89ee-b85237a6398a-snapshots\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:26.956780 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.956765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w8lc\" (UniqueName: \"kubernetes.io/projected/55bf9dfa-bd56-47d3-ab40-42a2b56610cd-kube-api-access-6w8lc\") pod \"network-check-source-989f8b8dc-jt9g6\" (UID: \"55bf9dfa-bd56-47d3-ab40-42a2b56610cd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"
Jul 07 18:51:26.956897 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.956805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ee4d04-87c0-4489-89ee-b85237a6398a-serving-cert\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:26.956897 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.956844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbgqx\" (UniqueName: \"kubernetes.io/projected/c0ee4d04-87c0-4489-89ee-b85237a6398a-kube-api-access-sbgqx\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:26.956897 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.956874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djlc\" (UniqueName: \"kubernetes.io/projected/66912b97-5b97-4e57-aa13-6338876cc559-kube-api-access-7djlc\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:26.956897 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.956915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee4d04-87c0-4489-89ee-b85237a6398a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:26.957094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.956955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:26.957094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957006    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66912b97-5b97-4e57-aa13-6338876cc559-serving-cert\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:26.957094 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:26.957032    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:51:26.957094 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gppmx\" (UniqueName: \"kubernetes.io/projected/1b335854-7808-48ae-a80b-27712097ba11-kube-api-access-gppmx\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:26.957094 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:26.957088    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls podName:3bab02b7-8112-467f-9598-8d21ae922500 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:27.457075537 +0000 UTC m=+50.520552215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-km4cx" (UID: "3bab02b7-8112-467f-9598-8d21ae922500") : secret "samples-operator-tls" not found
Jul 07 18:51:26.957372 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66912b97-5b97-4e57-aa13-6338876cc559-config\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:26.957372 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66912b97-5b97-4e57-aa13-6338876cc559-trusted-ca\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:26.957372 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee4d04-87c0-4489-89ee-b85237a6398a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:26.957508 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b335854-7808-48ae-a80b-27712097ba11-config\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:26.957508 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b335854-7808-48ae-a80b-27712097ba11-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:26.957508 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n7vl\" (UniqueName: \"kubernetes.io/projected/3bab02b7-8112-467f-9598-8d21ae922500-kube-api-access-8n7vl\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:26.957508 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.957504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ee4d04-87c0-4489-89ee-b85237a6398a-tmp\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:26.967600 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.967575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w8lc\" (UniqueName: \"kubernetes.io/projected/55bf9dfa-bd56-47d3-ab40-42a2b56610cd-kube-api-access-6w8lc\") pod \"network-check-source-989f8b8dc-jt9g6\" (UID: \"55bf9dfa-bd56-47d3-ab40-42a2b56610cd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"
Jul 07 18:51:26.968051 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:26.968030    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n7vl\" (UniqueName: \"kubernetes.io/projected/3bab02b7-8112-467f-9598-8d21ae922500-kube-api-access-8n7vl\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:27.024086 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.024060    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"
Jul 07 18:51:27.032192 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.032171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"
Jul 07 18:51:27.058593 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0ee4d04-87c0-4489-89ee-b85237a6398a-snapshots\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.058684 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ee4d04-87c0-4489-89ee-b85237a6398a-serving-cert\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.058684 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q4gm\" (UniqueName: \"kubernetes.io/projected/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-kube-api-access-5q4gm\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.058785 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbgqx\" (UniqueName: \"kubernetes.io/projected/c0ee4d04-87c0-4489-89ee-b85237a6398a-kube-api-access-sbgqx\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.058785 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.058880 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.058880 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djlc\" (UniqueName: \"kubernetes.io/projected/66912b97-5b97-4e57-aa13-6338876cc559-kube-api-access-7djlc\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.058979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-default-certificate\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.058979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee4d04-87c0-4489-89ee-b85237a6398a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.058979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.058970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66912b97-5b97-4e57-aa13-6338876cc559-serving-cert\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.059121 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppmx\" (UniqueName: \"kubernetes.io/projected/1b335854-7808-48ae-a80b-27712097ba11-kube-api-access-gppmx\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:27.059121 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66912b97-5b97-4e57-aa13-6338876cc559-config\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.059121 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66912b97-5b97-4e57-aa13-6338876cc559-trusted-ca\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.059282 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee4d04-87c0-4489-89ee-b85237a6398a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.059282 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-stats-auth\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.059282 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b335854-7808-48ae-a80b-27712097ba11-config\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:27.059423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b335854-7808-48ae-a80b-27712097ba11-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:27.059423 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059412    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0ee4d04-87c0-4489-89ee-b85237a6398a-snapshots\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.059533 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ee4d04-87c0-4489-89ee-b85237a6398a-tmp\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.059673 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059619    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee4d04-87c0-4489-89ee-b85237a6398a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.059911 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059889    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ee4d04-87c0-4489-89ee-b85237a6398a-tmp\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.060008 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.059981    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b335854-7808-48ae-a80b-27712097ba11-config\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:27.060172 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.060144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee4d04-87c0-4489-89ee-b85237a6398a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.060581 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.060554    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66912b97-5b97-4e57-aa13-6338876cc559-config\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.060794 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.060776    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66912b97-5b97-4e57-aa13-6338876cc559-trusted-ca\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.061292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.061251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ee4d04-87c0-4489-89ee-b85237a6398a-serving-cert\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.062195 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.062179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66912b97-5b97-4e57-aa13-6338876cc559-serving-cert\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.062254 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.062222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b335854-7808-48ae-a80b-27712097ba11-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:27.068327 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.068295    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gppmx\" (UniqueName: \"kubernetes.io/projected/1b335854-7808-48ae-a80b-27712097ba11-kube-api-access-gppmx\") pod \"service-ca-operator-5d46d9ffd4-7d6x9\" (UID: \"1b335854-7808-48ae-a80b-27712097ba11\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:27.068396 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.068311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbgqx\" (UniqueName: \"kubernetes.io/projected/c0ee4d04-87c0-4489-89ee-b85237a6398a-kube-api-access-sbgqx\") pod \"insights-operator-5c847dcfc4-hz6b4\" (UID: \"c0ee4d04-87c0-4489-89ee-b85237a6398a\") " pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.069220 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.069202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djlc\" (UniqueName: \"kubernetes.io/projected/66912b97-5b97-4e57-aa13-6338876cc559-kube-api-access-7djlc\") pod \"console-operator-68b757fb67-tgmzp\" (UID: \"66912b97-5b97-4e57-aa13-6338876cc559\") " pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.131763 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.131422    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"
Jul 07 18:51:27.151245 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.151208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:27.160884 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.160740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-default-certificate\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.160884 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.160823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-stats-auth\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.161081 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.160904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q4gm\" (UniqueName: \"kubernetes.io/projected/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-kube-api-access-5q4gm\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.161081 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.160981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.161081 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.161025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.161228 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.161165    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:27.661145883 +0000 UTC m=+50.724622580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : configmap references non-existent config key: service-ca.crt
Jul 07 18:51:27.161358 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.161338    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:51:27.161419 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.161409    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:27.661391274 +0000 UTC m=+50.724867951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : secret "router-metrics-certs-default" not found
Jul 07 18:51:27.163979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.163932    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-default-certificate\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.164121 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.164099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-stats-auth\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.171427 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.171401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q4gm\" (UniqueName: \"kubernetes.io/projected/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-kube-api-access-5q4gm\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.180212 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.180192    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4"
Jul 07 18:51:27.190403 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.190377    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl"]
Jul 07 18:51:27.194035 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:27.194009    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5588527f_2b7a_47e2_95d3_0f10164a6c5f.slice/crio-caef3d5f4e69ecf888d416180e32072f3d725593187d311977003b681d0413f3 WatchSource:0}: Error finding container caef3d5f4e69ecf888d416180e32072f3d725593187d311977003b681d0413f3: Status 404 returned error can't find the container with id caef3d5f4e69ecf888d416180e32072f3d725593187d311977003b681d0413f3
Jul 07 18:51:27.208292 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.208215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2"]
Jul 07 18:51:27.212450 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:27.212419    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b50a37_3900_431f_83ae_e7997ca3ed3b.slice/crio-3e051016bf977ec49e34616cc995929d3430cd9b93f4f52307f972531113503e WatchSource:0}: Error finding container 3e051016bf977ec49e34616cc995929d3430cd9b93f4f52307f972531113503e: Status 404 returned error can't find the container with id 3e051016bf977ec49e34616cc995929d3430cd9b93f4f52307f972531113503e
Jul 07 18:51:27.241416 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.241178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"
Jul 07 18:51:27.317378 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.317297    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6"]
Jul 07 18:51:27.323379 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:27.323330    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bf9dfa_bd56_47d3_ab40_42a2b56610cd.slice/crio-f42ecad38e372feae3c465865cbab4b968ede97c81fbc08458cf3992e7bfd5b2 WatchSource:0}: Error finding container f42ecad38e372feae3c465865cbab4b968ede97c81fbc08458cf3992e7bfd5b2: Status 404 returned error can't find the container with id f42ecad38e372feae3c465865cbab4b968ede97c81fbc08458cf3992e7bfd5b2
Jul 07 18:51:27.348362 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.348290    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tgmzp"]
Jul 07 18:51:27.358361 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:27.358317    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66912b97_5b97_4e57_aa13_6338876cc559.slice/crio-1ca62f65b2b81309afffdb7978741895340659d72c2223715009c3f2e3997384 WatchSource:0}: Error finding container 1ca62f65b2b81309afffdb7978741895340659d72c2223715009c3f2e3997384: Status 404 returned error can't find the container with id 1ca62f65b2b81309afffdb7978741895340659d72c2223715009c3f2e3997384
Jul 07 18:51:27.364607 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.364471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:27.364720 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.364610    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:27.364720 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.364677    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls podName:2f643423-faf7-4ab2-9a74-f2e47ae97560 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:28.364655326 +0000 UTC m=+51.428132005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dxk88" (UID: "2f643423-faf7-4ab2-9a74-f2e47ae97560") : secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:27.397585 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.397558    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hz6b4"]
Jul 07 18:51:27.400149 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:27.400121    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ee4d04_87c0_4489_89ee_b85237a6398a.slice/crio-f29e8713bbe830456b6ee2173b5c241d64e6718e5b683859deec64457ff2126b WatchSource:0}: Error finding container f29e8713bbe830456b6ee2173b5c241d64e6718e5b683859deec64457ff2126b: Status 404 returned error can't find the container with id f29e8713bbe830456b6ee2173b5c241d64e6718e5b683859deec64457ff2126b
Jul 07 18:51:27.415682 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.415655    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9"]
Jul 07 18:51:27.418931 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:27.418910    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b335854_7808_48ae_a80b_27712097ba11.slice/crio-10ec69696abe26a4f9769fbc9f7120c16eb17185b1df78932877c68b9b2077f1 WatchSource:0}: Error finding container 10ec69696abe26a4f9769fbc9f7120c16eb17185b1df78932877c68b9b2077f1: Status 404 returned error can't find the container with id 10ec69696abe26a4f9769fbc9f7120c16eb17185b1df78932877c68b9b2077f1
Jul 07 18:51:27.465301 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.465227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:27.465459 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.465365    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:51:27.465459 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.465421    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls podName:3bab02b7-8112-467f-9598-8d21ae922500 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:28.465406894 +0000 UTC m=+51.528883572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-km4cx" (UID: "3bab02b7-8112-467f-9598-8d21ae922500") : secret "samples-operator-tls" not found
Jul 07 18:51:27.667064 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.667020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.667238 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.667077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:27.667238 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.667209    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:51:27.667377 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.667256    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:28.667237685 +0000 UTC m=+51.730714383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : configmap references non-existent config key: service-ca.crt
Jul 07 18:51:27.667377 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:27.667300    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:28.667289382 +0000 UTC m=+51.730766063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : secret "router-metrics-certs-default" not found
Jul 07 18:51:27.714086 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.714046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4" event={"ID":"c0ee4d04-87c0-4489-89ee-b85237a6398a","Type":"ContainerStarted","Data":"f29e8713bbe830456b6ee2173b5c241d64e6718e5b683859deec64457ff2126b"}
Jul 07 18:51:27.715580 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.715500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6" event={"ID":"55bf9dfa-bd56-47d3-ab40-42a2b56610cd","Type":"ContainerStarted","Data":"f42ecad38e372feae3c465865cbab4b968ede97c81fbc08458cf3992e7bfd5b2"}
Jul 07 18:51:27.716859 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.716804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" event={"ID":"66912b97-5b97-4e57-aa13-6338876cc559","Type":"ContainerStarted","Data":"1ca62f65b2b81309afffdb7978741895340659d72c2223715009c3f2e3997384"}
Jul 07 18:51:27.718156 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.718127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2" event={"ID":"c1b50a37-3900-431f-83ae-e7997ca3ed3b","Type":"ContainerStarted","Data":"3e051016bf977ec49e34616cc995929d3430cd9b93f4f52307f972531113503e"}
Jul 07 18:51:27.719327 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.719303    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl" event={"ID":"5588527f-2b7a-47e2-95d3-0f10164a6c5f","Type":"ContainerStarted","Data":"caef3d5f4e69ecf888d416180e32072f3d725593187d311977003b681d0413f3"}
Jul 07 18:51:27.720484 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:27.720460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9" event={"ID":"1b335854-7808-48ae-a80b-27712097ba11","Type":"ContainerStarted","Data":"10ec69696abe26a4f9769fbc9f7120c16eb17185b1df78932877c68b9b2077f1"}
Jul 07 18:51:28.373843 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:28.373737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:28.374000 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.373883    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:28.374000 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.373945    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls podName:2f643423-faf7-4ab2-9a74-f2e47ae97560 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:30.373926449 +0000 UTC m=+53.437403144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dxk88" (UID: "2f643423-faf7-4ab2-9a74-f2e47ae97560") : secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:28.475336 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:28.475297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:28.475503 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.475485    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:51:28.475563 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.475558    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls podName:3bab02b7-8112-467f-9598-8d21ae922500 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:30.475541183 +0000 UTC m=+53.539017882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-km4cx" (UID: "3bab02b7-8112-467f-9598-8d21ae922500") : secret "samples-operator-tls" not found
Jul 07 18:51:28.576528 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:28.576487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:28.576703 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:28.576539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:28.576788 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.576755    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:28.576855 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.576822    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls podName:b72e3ba1-083d-49bb-9362-c0dbd9928bc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:44.576803317 +0000 UTC m=+67.640280020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls") pod "dns-default-b7n7x" (UID: "b72e3ba1-083d-49bb-9362-c0dbd9928bc6") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:28.577254 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.577230    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:28.577254 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.577254    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9595fff9-htn96: secret "image-registry-tls" not found
Jul 07 18:51:28.577456 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.577316    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls podName:f9bc6c87-1433-4af2-b6b4-9587c15aeb2c nodeName:}" failed. No retries permitted until 2026-07-07 18:51:44.577301766 +0000 UTC m=+67.640778445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls") pod "image-registry-5c9595fff9-htn96" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c") : secret "image-registry-tls" not found
Jul 07 18:51:28.678178 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:28.678139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:28.678370 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:28.678198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:28.678370 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.678356    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:30.678337257 +0000 UTC m=+53.741813938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : configmap references non-existent config key: service-ca.crt
Jul 07 18:51:28.678782 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.678759    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:51:28.678892 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:28.678816    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:30.678800632 +0000 UTC m=+53.742277315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : secret "router-metrics-certs-default" not found
Jul 07 18:51:30.395304 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:30.395253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:30.395763 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:30.395400    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:30.395763 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:30.395465    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls podName:2f643423-faf7-4ab2-9a74-f2e47ae97560 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.395450046 +0000 UTC m=+57.458926725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dxk88" (UID: "2f643423-faf7-4ab2-9a74-f2e47ae97560") : secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:30.495676 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:30.495641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:30.496004 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:30.495824    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:51:30.496004 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:30.495900    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls podName:3bab02b7-8112-467f-9598-8d21ae922500 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.495880006 +0000 UTC m=+57.559356683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-km4cx" (UID: "3bab02b7-8112-467f-9598-8d21ae922500") : secret "samples-operator-tls" not found
Jul 07 18:51:30.697777 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:30.697747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:30.697948 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:30.697793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:30.697948 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:30.697919    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:51:30.698048 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:30.697952    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.6979359 +0000 UTC m=+57.761412599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : configmap references non-existent config key: service-ca.crt
Jul 07 18:51:30.698048 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:30.697981    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.697962055 +0000 UTC m=+57.761438735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : secret "router-metrics-certs-default" not found
Jul 07 18:51:32.740810 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:32.739197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4" event={"ID":"c0ee4d04-87c0-4489-89ee-b85237a6398a","Type":"ContainerStarted","Data":"59818cb583fa25ec9a96a56d857f1e0a90f347b9e3e38050e694b01ba7686584"}
Jul 07 18:51:32.742403 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:32.742323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" event={"ID":"66912b97-5b97-4e57-aa13-6338876cc559","Type":"ContainerStarted","Data":"b0e9b2475f7b9ba8caf1ca4c13a75947285987db4e40abd8814feb0641079bbb"}
Jul 07 18:51:32.750164 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:32.750085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl" event={"ID":"5588527f-2b7a-47e2-95d3-0f10164a6c5f","Type":"ContainerStarted","Data":"9099cd26c7c55f74fda50cf85a316eb27ede464b7f1f79b8ea670b6c0bccab5f"}
Jul 07 18:51:33.757908 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.757868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9" event={"ID":"1b335854-7808-48ae-a80b-27712097ba11","Type":"ContainerStarted","Data":"ee5382784df656d334544a1c83f7e28a5e197aadaf0841935c4ce82f3db59dd6"}
Jul 07 18:51:33.759625 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.759595    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6" event={"ID":"55bf9dfa-bd56-47d3-ab40-42a2b56610cd","Type":"ContainerStarted","Data":"51eeb99b63fd1a7e6911e4b748b5e7d17be9f7cc0dffbc4402c9e1be252e379e"}
Jul 07 18:51:33.761755 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.761733    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/0.log"
Jul 07 18:51:33.761883 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.761770    2562 generic.go:356] "Generic (PLEG): container finished" podID="66912b97-5b97-4e57-aa13-6338876cc559" containerID="b0e9b2475f7b9ba8caf1ca4c13a75947285987db4e40abd8814feb0641079bbb" exitCode=255
Jul 07 18:51:33.761883 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.761843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" event={"ID":"66912b97-5b97-4e57-aa13-6338876cc559","Type":"ContainerDied","Data":"b0e9b2475f7b9ba8caf1ca4c13a75947285987db4e40abd8814feb0641079bbb"}
Jul 07 18:51:33.762077 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.762052    2562 scope.go:117] "RemoveContainer" containerID="b0e9b2475f7b9ba8caf1ca4c13a75947285987db4e40abd8814feb0641079bbb"
Jul 07 18:51:33.764604 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.764570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2" event={"ID":"c1b50a37-3900-431f-83ae-e7997ca3ed3b","Type":"ContainerStarted","Data":"ee61a05950d9311e900eabc8261e1a936186ecd23378e8c00456e61692fbb937"}
Jul 07 18:51:33.775122 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.775073    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl" podStartSLOduration=2.346968843 podStartE2EDuration="7.775055033s" totalImagesPullingTime="5.42808619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:32.767328505 +0000 UTC m=+55.830805205" watchObservedRunningTime="2026-07-07 18:51:33.775055033 +0000 UTC m=+56.838531714"
Jul 07 18:51:33.789699 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.789646    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9" podStartSLOduration=2.580985376 podStartE2EDuration="7.78962586s" totalImagesPullingTime="5.208640484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:33.775430453 +0000 UTC m=+56.838907165" watchObservedRunningTime="2026-07-07 18:51:33.78962586 +0000 UTC m=+56.853102562"
Jul 07 18:51:33.790890 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.790854    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4cv2" podStartSLOduration=2.38946652 podStartE2EDuration="7.790841784s" totalImagesPullingTime="5.401375264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:33.789850128 +0000 UTC m=+56.853326830" watchObservedRunningTime="2026-07-07 18:51:33.790841784 +0000 UTC m=+56.854318485"
Jul 07 18:51:33.808338 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.808257    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4" podStartSLOduration=2.584544061 podStartE2EDuration="7.808233731s" totalImagesPullingTime="5.22368967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:33.807534622 +0000 UTC m=+56.871011334" watchObservedRunningTime="2026-07-07 18:51:33.808233731 +0000 UTC m=+56.871710434"
Jul 07 18:51:33.825681 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:33.825624    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jt9g6" podStartSLOduration=2.508383343 podStartE2EDuration="7.825602385s" totalImagesPullingTime="5.317219042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:33.825020751 +0000 UTC m=+56.888497449" watchObservedRunningTime="2026-07-07 18:51:33.825602385 +0000 UTC m=+56.889079087"
Jul 07 18:51:34.288843 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.288812    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6jbws"]
Jul 07 18:51:34.291875 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.291858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.293798 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.293773    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 18:51:34.293968 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.293951    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 18:51:34.294403 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.294386    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkh4b\""
Jul 07 18:51:34.314043 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.314005    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jbws"]
Jul 07 18:51:34.435564 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.435532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.435741 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.435586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:34.435741 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.435683    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:34.435741 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.435719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hgzp\" (UniqueName: \"kubernetes.io/projected/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-api-access-9hgzp\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.435741 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.435733    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls podName:2f643423-faf7-4ab2-9a74-f2e47ae97560 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.435719459 +0000 UTC m=+65.499196137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dxk88" (UID: "2f643423-faf7-4ab2-9a74-f2e47ae97560") : secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:34.435887 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.435765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-crio-socket\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.435887 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.435792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.435887 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.435871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-data-volume\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.536591 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.536546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-data-volume\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.536758 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.536603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:34.536758 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.536649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.536830 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.536759    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:34.536830 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.536785    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:51:34.536830 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.536822    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:35.036802961 +0000 UTC m=+58.100279639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:34.536924 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.536894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hgzp\" (UniqueName: \"kubernetes.io/projected/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-api-access-9hgzp\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.536958 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.536940    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls podName:3bab02b7-8112-467f-9598-8d21ae922500 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.536916792 +0000 UTC m=+65.600393474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-km4cx" (UID: "3bab02b7-8112-467f-9598-8d21ae922500") : secret "samples-operator-tls" not found
Jul 07 18:51:34.536994 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.536942    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-data-volume\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.536994 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.536972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-crio-socket\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.537054 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.537011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.537054 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.537033    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-crio-socket\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.537120 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.537094    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:34.537160 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.537126    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:35.037116863 +0000 UTC m=+58.100593541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:34.545345 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.545293    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hgzp\" (UniqueName: \"kubernetes.io/projected/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-api-access-9hgzp\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:34.738660 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.738631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:34.738840 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.738760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:34.738840 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.738818    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.738796608 +0000 UTC m=+65.802273323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : configmap references non-existent config key: service-ca.crt
Jul 07 18:51:34.738974 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.738843    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:51:34.738974 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.738879    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.738868152 +0000 UTC m=+65.802344829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : secret "router-metrics-certs-default" not found
Jul 07 18:51:34.769404 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.769375    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/1.log"
Jul 07 18:51:34.769761 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.769706    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/0.log"
Jul 07 18:51:34.769761 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.769737    2562 generic.go:356] "Generic (PLEG): container finished" podID="66912b97-5b97-4e57-aa13-6338876cc559" containerID="95e10b88f298e0d45f7ea63ae99c40ae2be000ed809478168ed2b14983225d8b" exitCode=255
Jul 07 18:51:34.769832 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.769765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" event={"ID":"66912b97-5b97-4e57-aa13-6338876cc559","Type":"ContainerDied","Data":"95e10b88f298e0d45f7ea63ae99c40ae2be000ed809478168ed2b14983225d8b"}
Jul 07 18:51:34.769864 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.769843    2562 scope.go:117] "RemoveContainer" containerID="b0e9b2475f7b9ba8caf1ca4c13a75947285987db4e40abd8814feb0641079bbb"
Jul 07 18:51:34.770072 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:34.770054    2562 scope.go:117] "RemoveContainer" containerID="95e10b88f298e0d45f7ea63ae99c40ae2be000ed809478168ed2b14983225d8b"
Jul 07 18:51:34.770249 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:34.770229    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tgmzp_openshift-console-operator(66912b97-5b97-4e57-aa13-6338876cc559)\"" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" podUID="66912b97-5b97-4e57-aa13-6338876cc559"
Jul 07 18:51:35.040847 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:35.040815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:35.041027 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:35.040908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:35.041027 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:35.040986    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:35.041027 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:35.041022    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:35.041128 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:35.041084    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:36.041061901 +0000 UTC m=+59.104538579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:35.041128 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:35.041101    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:36.041093004 +0000 UTC m=+59.104569687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:35.679907 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:35.679880    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4v245_87f6027c-6f68-4d54-bce3-fabd01651d7c/dns-node-resolver/0.log"
Jul 07 18:51:35.775148 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:35.775119    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/1.log"
Jul 07 18:51:35.775649 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:35.775565    2562 scope.go:117] "RemoveContainer" containerID="95e10b88f298e0d45f7ea63ae99c40ae2be000ed809478168ed2b14983225d8b"
Jul 07 18:51:35.775790 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:35.775767    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tgmzp_openshift-console-operator(66912b97-5b97-4e57-aa13-6338876cc559)\"" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" podUID="66912b97-5b97-4e57-aa13-6338876cc559"
Jul 07 18:51:36.051692 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:36.051598    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:36.051692 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:36.051679    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:36.051921 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:36.051751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:36.051921 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:36.051848    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:36.051921 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:36.051861    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:38.051837109 +0000 UTC m=+61.115313790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:36.051921 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:36.051916    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:38.051899721 +0000 UTC m=+61.115376417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:36.677697 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:36.677667    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7kgjv_e38a176c-b277-4f30-8a72-770c49b6cd02/node-ca/0.log"
Jul 07 18:51:37.152231 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:37.152145    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:37.152231 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:37.152199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:37.152629 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:37.152510    2562 scope.go:117] "RemoveContainer" containerID="95e10b88f298e0d45f7ea63ae99c40ae2be000ed809478168ed2b14983225d8b"
Jul 07 18:51:37.152677 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:37.152662    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tgmzp_openshift-console-operator(66912b97-5b97-4e57-aa13-6338876cc559)\"" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" podUID="66912b97-5b97-4e57-aa13-6338876cc559"
Jul 07 18:51:37.694198 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:37.694151    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8fdgx_46abbced-4c33-43e0-b8f4-2bcdf4464edf/serve-healthcheck-canary/0.log"
Jul 07 18:51:38.066327 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:38.066224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:38.066478 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:38.066338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:38.066478 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:38.066383    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:38.066478 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:38.066446    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.066432213 +0000 UTC m=+65.129908892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:38.066478 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:38.066460    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:38.066642 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:38.066507    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.066492673 +0000 UTC m=+65.129969350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:38.662557 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:38.662525    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvks2"
Jul 07 18:51:42.099915 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:42.099880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:42.100322 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:42.099951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:42.100322 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.100015    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:42.100322 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.100029    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:42.100322 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.100084    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:50.10006826 +0000 UTC m=+73.163544941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:42.100322 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.100099    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:51:50.100093149 +0000 UTC m=+73.163569827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:42.503109 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:42.503075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:42.503309 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.503228    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:42.503364 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.503316    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls podName:2f643423-faf7-4ab2-9a74-f2e47ae97560 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:58.503301858 +0000 UTC m=+81.566778536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dxk88" (UID: "2f643423-faf7-4ab2-9a74-f2e47ae97560") : secret "cluster-monitoring-operator-tls" not found
Jul 07 18:51:42.604451 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:42.604415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:42.604584 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.604562    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:51:42.604642 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.604632    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls podName:3bab02b7-8112-467f-9598-8d21ae922500 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:58.604613781 +0000 UTC m=+81.668090459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-km4cx" (UID: "3bab02b7-8112-467f-9598-8d21ae922500") : secret "samples-operator-tls" not found
Jul 07 18:51:42.806081 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:42.806003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:42.806081 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:42.806045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:42.806300 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.806148    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:58.806135689 +0000 UTC m=+81.869612367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : configmap references non-existent config key: service-ca.crt
Jul 07 18:51:42.806300 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.806149    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:51:42.806300 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:42.806203    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs podName:9bbc5329-2bf0-4743-bf87-1b24d0edbe3e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:58.806187563 +0000 UTC m=+81.869664255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs") pod "router-default-8647695769-hvrjk" (UID: "9bbc5329-2bf0-4743-bf87-1b24d0edbe3e") : secret "router-metrics-certs-default" not found
Jul 07 18:51:43.210787 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.210752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:43.212938 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.212919    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:51:43.223716 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.223695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa182a1-163e-474f-a336-fd278f564914-original-pull-secret\") pod \"global-pull-secret-syncer-5825v\" (UID: \"2fa182a1-163e-474f-a336-fd278f564914\") " pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:43.253031 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.253004    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5825v"
Jul 07 18:51:43.311808 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.311767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:51:43.314527 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.314254    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:51:43.323022 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:43.322990    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 18:51:43.323136 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:43.323057    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs podName:2ab0ffc3-9c02-4a8b-9555-84da21ad5f26 nodeName:}" failed. No retries permitted until 2026-07-07 18:52:47.323041594 +0000 UTC m=+130.386518271 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs") pod "network-metrics-daemon-jgw7m" (UID: "2ab0ffc3-9c02-4a8b-9555-84da21ad5f26") : secret "metrics-daemon-secret" not found
Jul 07 18:51:43.383358 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.383329    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5825v"]
Jul 07 18:51:43.386905 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:43.386863    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa182a1_163e_474f_a336_fd278f564914.slice/crio-bbe44504daa31c25318b88336cc9a545052f0e660f14650829512247975fef79 WatchSource:0}: Error finding container bbe44504daa31c25318b88336cc9a545052f0e660f14650829512247975fef79: Status 404 returned error can't find the container with id bbe44504daa31c25318b88336cc9a545052f0e660f14650829512247975fef79
Jul 07 18:51:43.413119 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.413092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:43.415761 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.415739    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klx9v\" (UniqueName: \"kubernetes.io/projected/336b2b41-a2b7-4f16-84d7-ce024f88a001-kube-api-access-klx9v\") pod \"network-check-target-8fhf5\" (UID: \"336b2b41-a2b7-4f16-84d7-ce024f88a001\") " pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:43.562898 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.562825    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9524g\""
Jul 07 18:51:43.570796 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.570771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:43.695611 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.695581    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fhf5"]
Jul 07 18:51:43.698612 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:43.698576    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336b2b41_a2b7_4f16_84d7_ce024f88a001.slice/crio-f93acbc37aa0912935f544eb8d83985102b1c511b60b8de8576c7a5de4831234 WatchSource:0}: Error finding container f93acbc37aa0912935f544eb8d83985102b1c511b60b8de8576c7a5de4831234: Status 404 returned error can't find the container with id f93acbc37aa0912935f544eb8d83985102b1c511b60b8de8576c7a5de4831234
Jul 07 18:51:43.799559 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.799510    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fhf5" event={"ID":"336b2b41-a2b7-4f16-84d7-ce024f88a001","Type":"ContainerStarted","Data":"1aaf35f1e1db0afb87a4791d35ec00c5b8bb23b2e07de1720ff0e156e07971e9"}
Jul 07 18:51:43.799722 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.799572    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:51:43.799722 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.799589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fhf5" event={"ID":"336b2b41-a2b7-4f16-84d7-ce024f88a001","Type":"ContainerStarted","Data":"f93acbc37aa0912935f544eb8d83985102b1c511b60b8de8576c7a5de4831234"}
Jul 07 18:51:43.800633 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.800612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5825v" event={"ID":"2fa182a1-163e-474f-a336-fd278f564914","Type":"ContainerStarted","Data":"bbe44504daa31c25318b88336cc9a545052f0e660f14650829512247975fef79"}
Jul 07 18:51:43.815129 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:43.815036    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8fhf5" podStartSLOduration=66.815021272 podStartE2EDuration="1m6.815021272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:43.813892358 +0000 UTC m=+66.877369069" watchObservedRunningTime="2026-07-07 18:51:43.815021272 +0000 UTC m=+66.878497973"
Jul 07 18:51:44.624867 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:44.624833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:51:44.624867 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:44.624877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:51:44.625395 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:44.624991    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:44.625395 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:44.624998    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:44.625395 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:44.625019    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9595fff9-htn96: secret "image-registry-tls" not found
Jul 07 18:51:44.625395 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:44.625050    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls podName:b72e3ba1-083d-49bb-9362-c0dbd9928bc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:52:16.625031496 +0000 UTC m=+99.688508180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls") pod "dns-default-b7n7x" (UID: "b72e3ba1-083d-49bb-9362-c0dbd9928bc6") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:44.625395 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:44.625077    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls podName:f9bc6c87-1433-4af2-b6b4-9587c15aeb2c nodeName:}" failed. No retries permitted until 2026-07-07 18:52:16.625057423 +0000 UTC m=+99.688534126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls") pod "image-registry-5c9595fff9-htn96" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c") : secret "image-registry-tls" not found
Jul 07 18:51:47.816269 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:47.816229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5825v" event={"ID":"2fa182a1-163e-474f-a336-fd278f564914","Type":"ContainerStarted","Data":"fb15c469ef83d9c851d7963f5f9c4ff998eceb5c204a22d9b9eb3d461e6fa78a"}
Jul 07 18:51:47.836549 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:47.836487    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5825v" podStartSLOduration=66.613658831 podStartE2EDuration="1m10.836465735s" totalImagesPullingTime="4.222806904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:47.835068347 +0000 UTC m=+70.898545049" watchObservedRunningTime="2026-07-07 18:51:47.836465735 +0000 UTC m=+70.899942438"
Jul 07 18:51:50.175628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.175584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:50.176102 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.175679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:50.176102 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:50.175731    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:50.176102 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:50.175797    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls podName:6b91fee1-1f10-40f8-b3a9-94bb8bbe854b nodeName:}" failed. No retries permitted until 2026-07-07 18:52:06.175781408 +0000 UTC m=+89.239258086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jbws" (UID: "6b91fee1-1f10-40f8-b3a9-94bb8bbe854b") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:50.176335 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.176313    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:51:50.440403 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.440329    2562 scope.go:117] "RemoveContainer" containerID="95e10b88f298e0d45f7ea63ae99c40ae2be000ed809478168ed2b14983225d8b"
Jul 07 18:51:50.827110 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.827037    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 18:51:50.827530 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.827514    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/1.log"
Jul 07 18:51:50.827614 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.827548    2562 generic.go:356] "Generic (PLEG): container finished" podID="66912b97-5b97-4e57-aa13-6338876cc559" containerID="46e74375f5347b21c28070d0f0c093f5492ca1b552c626a1f7a263afa098d7a2" exitCode=255
Jul 07 18:51:50.827614 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.827581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" event={"ID":"66912b97-5b97-4e57-aa13-6338876cc559","Type":"ContainerDied","Data":"46e74375f5347b21c28070d0f0c093f5492ca1b552c626a1f7a263afa098d7a2"}
Jul 07 18:51:50.827697 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.827678    2562 scope.go:117] "RemoveContainer" containerID="95e10b88f298e0d45f7ea63ae99c40ae2be000ed809478168ed2b14983225d8b"
Jul 07 18:51:50.827979 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:50.827945    2562 scope.go:117] "RemoveContainer" containerID="46e74375f5347b21c28070d0f0c093f5492ca1b552c626a1f7a263afa098d7a2"
Jul 07 18:51:50.828206 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:50.828182    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-tgmzp_openshift-console-operator(66912b97-5b97-4e57-aa13-6338876cc559)\"" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" podUID="66912b97-5b97-4e57-aa13-6338876cc559"
Jul 07 18:51:51.832543 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:51.832513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 18:51:57.151728 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:57.151692    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:57.152235 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:57.151791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:51:57.152235 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:57.152180    2562 scope.go:117] "RemoveContainer" containerID="46e74375f5347b21c28070d0f0c093f5492ca1b552c626a1f7a263afa098d7a2"
Jul 07 18:51:57.152436 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:51:57.152412    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-tgmzp_openshift-console-operator(66912b97-5b97-4e57-aa13-6338876cc559)\"" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" podUID="66912b97-5b97-4e57-aa13-6338876cc559"
Jul 07 18:51:58.547353 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.547203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:58.549873 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.549848    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f643423-faf7-4ab2-9a74-f2e47ae97560-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dxk88\" (UID: \"2f643423-faf7-4ab2-9a74-f2e47ae97560\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:58.554517 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.554488    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rl9tp\""
Jul 07 18:51:58.562952 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.562937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"
Jul 07 18:51:58.647959 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.647930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:58.650534 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.650502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bab02b7-8112-467f-9598-8d21ae922500-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-km4cx\" (UID: \"3bab02b7-8112-467f-9598-8d21ae922500\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:58.688837 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.688807    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88"]
Jul 07 18:51:58.692068 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:58.692040    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f643423_faf7_4ab2_9a74_f2e47ae97560.slice/crio-8125d1717139dc8c01c2b1840d016b5e61a9ec145f873845940a1f784305a625 WatchSource:0}: Error finding container 8125d1717139dc8c01c2b1840d016b5e61a9ec145f873845940a1f784305a625: Status 404 returned error can't find the container with id 8125d1717139dc8c01c2b1840d016b5e61a9ec145f873845940a1f784305a625
Jul 07 18:51:58.849909 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.849823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:58.849909 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.849868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:58.850517 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.850456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-service-ca-bundle\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:58.852295 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.852255    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bbc5329-2bf0-4743-bf87-1b24d0edbe3e-metrics-certs\") pod \"router-default-8647695769-hvrjk\" (UID: \"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e\") " pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:58.857126 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.857093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88" event={"ID":"2f643423-faf7-4ab2-9a74-f2e47ae97560","Type":"ContainerStarted","Data":"8125d1717139dc8c01c2b1840d016b5e61a9ec145f873845940a1f784305a625"}
Jul 07 18:51:58.942231 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.942204    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lxzdr\""
Jul 07 18:51:58.950939 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:58.950911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"
Jul 07 18:51:59.054668 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.054642    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hc79r\""
Jul 07 18:51:59.063368 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.063336    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:51:59.077221 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.077195    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx"]
Jul 07 18:51:59.198596 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.198562    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8647695769-hvrjk"]
Jul 07 18:51:59.201764 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:51:59.201738    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbc5329_2bf0_4743_bf87_1b24d0edbe3e.slice/crio-0d9cacf9e42e3308da91ad524c78f22db0449b1e460faa4e812bcc894a888240 WatchSource:0}: Error finding container 0d9cacf9e42e3308da91ad524c78f22db0449b1e460faa4e812bcc894a888240: Status 404 returned error can't find the container with id 0d9cacf9e42e3308da91ad524c78f22db0449b1e460faa4e812bcc894a888240
Jul 07 18:51:59.863252 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.862742    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8647695769-hvrjk" event={"ID":"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e","Type":"ContainerStarted","Data":"270949c7bc362461fa7be0535fbe09fdc6a72c5013e0b75f7cab32079117bc8d"}
Jul 07 18:51:59.863252 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.862798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8647695769-hvrjk" event={"ID":"9bbc5329-2bf0-4743-bf87-1b24d0edbe3e","Type":"ContainerStarted","Data":"0d9cacf9e42e3308da91ad524c78f22db0449b1e460faa4e812bcc894a888240"}
Jul 07 18:51:59.864067 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.864032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx" event={"ID":"3bab02b7-8112-467f-9598-8d21ae922500","Type":"ContainerStarted","Data":"7a72a35ca6d90f887ab8b2d03a046d0ea105dea0f2e10a59ed6b9c24bf5e9689"}
Jul 07 18:51:59.889315 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:51:59.889242    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8647695769-hvrjk" podStartSLOduration=33.889221509 podStartE2EDuration="33.889221509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:59.888415227 +0000 UTC m=+82.951892129" watchObservedRunningTime="2026-07-07 18:51:59.889221509 +0000 UTC m=+82.952698210"
Jul 07 18:52:00.064120 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:00.064086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:52:00.066904 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:00.066881    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:52:00.867657 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:00.867619    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:52:00.868947 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:00.868921    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8647695769-hvrjk"
Jul 07 18:52:01.872638 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:01.872594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88" event={"ID":"2f643423-faf7-4ab2-9a74-f2e47ae97560","Type":"ContainerStarted","Data":"2f1fcf8d88a78d7f1ae91c96e97aa3b95c18d280cdd7c90117f3ae4460215f96"}
Jul 07 18:52:01.874745 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:01.874721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx" event={"ID":"3bab02b7-8112-467f-9598-8d21ae922500","Type":"ContainerStarted","Data":"4f77026921b704e269a5c4e46dbc9d73684bc5fc8b0fe3fde51860fe2dda42cb"}
Jul 07 18:52:01.874865 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:01.874773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx" event={"ID":"3bab02b7-8112-467f-9598-8d21ae922500","Type":"ContainerStarted","Data":"b4cb9f5831288f5d769448b03f8f6e79b1cf2583691c39f9f0c807ab7646da96"}
Jul 07 18:52:01.906542 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:01.906487    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dxk88" podStartSLOduration=33.380419881 podStartE2EDuration="35.906467801s" totalImagesPullingTime="2.52604792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:01.904855806 +0000 UTC m=+84.968332510" watchObservedRunningTime="2026-07-07 18:52:01.906467801 +0000 UTC m=+84.969944482"
Jul 07 18:52:01.939950 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:01.939885    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-km4cx" podStartSLOduration=33.833483858 podStartE2EDuration="35.939866087s" totalImagesPullingTime="2.106382229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:01.939320943 +0000 UTC m=+85.002797642" watchObservedRunningTime="2026-07-07 18:52:01.939866087 +0000 UTC m=+85.003342788"
Jul 07 18:52:05.962898 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:05.962865    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"]
Jul 07 18:52:05.997199 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:05.997171    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"]
Jul 07 18:52:05.997383 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:05.997277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.001233 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.001209    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2hw8c\""
Jul 07 18:52:06.001233 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.001209    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 18:52:06.001439 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.001252    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 18:52:06.001565 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.001552    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 18:52:06.010899 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.010877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.011030 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.010932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.011030 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.010951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd368f4e-5d49-4121-9228-ffa9e590a4d6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.011143 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.011040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5847\" (UniqueName: \"kubernetes.io/projected/bd368f4e-5d49-4121-9228-ffa9e590a4d6-kube-api-access-d5847\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.112419 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.112387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.112419 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.112423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd368f4e-5d49-4121-9228-ffa9e590a4d6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.112674 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.112457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5847\" (UniqueName: \"kubernetes.io/projected/bd368f4e-5d49-4121-9228-ffa9e590a4d6-kube-api-access-d5847\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.112674 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.112564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.112744 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:06.112673    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 18:52:06.112744 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:06.112726    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-tls podName:bd368f4e-5d49-4121-9228-ffa9e590a4d6 nodeName:}" failed. No retries permitted until 2026-07-07 18:52:06.612712081 +0000 UTC m=+89.676188760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-xlbgz" (UID: "bd368f4e-5d49-4121-9228-ffa9e590a4d6") : secret "prometheus-operator-tls" not found
Jul 07 18:52:06.113162 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.113140    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd368f4e-5d49-4121-9228-ffa9e590a4d6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.114971 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.114949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.130302 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.130277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5847\" (UniqueName: \"kubernetes.io/projected/bd368f4e-5d49-4121-9228-ffa9e590a4d6-kube-api-access-d5847\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.213027 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.212956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:52:06.215390 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.215368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b91fee1-1f10-40f8-b3a9-94bb8bbe854b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jbws\" (UID: \"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b\") " pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:52:06.407616 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.407579    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkh4b\""
Jul 07 18:52:06.412767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.412750    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jbws"
Jul 07 18:52:06.569823 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.569750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jbws"]
Jul 07 18:52:06.572422 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:52:06.572394    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b91fee1_1f10_40f8_b3a9_94bb8bbe854b.slice/crio-d4bb9c5e6e138e2de9dad45ad352a2e28f65f2efcb3c96eeaa979066b56dbdf0 WatchSource:0}: Error finding container d4bb9c5e6e138e2de9dad45ad352a2e28f65f2efcb3c96eeaa979066b56dbdf0: Status 404 returned error can't find the container with id d4bb9c5e6e138e2de9dad45ad352a2e28f65f2efcb3c96eeaa979066b56dbdf0
Jul 07 18:52:06.615828 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.615795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.618176 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.618155    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd368f4e-5d49-4121-9228-ffa9e590a4d6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xlbgz\" (UID: \"bd368f4e-5d49-4121-9228-ffa9e590a4d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:06.890805 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.890719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jbws" event={"ID":"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b","Type":"ContainerStarted","Data":"d4bb9c5e6e138e2de9dad45ad352a2e28f65f2efcb3c96eeaa979066b56dbdf0"}
Jul 07 18:52:06.906531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:06.906511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"
Jul 07 18:52:07.099069 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:07.099032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz"]
Jul 07 18:52:07.104183 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:52:07.104144    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd368f4e_5d49_4121_9228_ffa9e590a4d6.slice/crio-953908face0c99e73776311c44c9ff33bed5b31d293baae0e576a9fdec063205 WatchSource:0}: Error finding container 953908face0c99e73776311c44c9ff33bed5b31d293baae0e576a9fdec063205: Status 404 returned error can't find the container with id 953908face0c99e73776311c44c9ff33bed5b31d293baae0e576a9fdec063205
Jul 07 18:52:07.896561 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:07.896519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz" event={"ID":"bd368f4e-5d49-4121-9228-ffa9e590a4d6","Type":"ContainerStarted","Data":"953908face0c99e73776311c44c9ff33bed5b31d293baae0e576a9fdec063205"}
Jul 07 18:52:10.439689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:10.439657    2562 scope.go:117] "RemoveContainer" containerID="46e74375f5347b21c28070d0f0c093f5492ca1b552c626a1f7a263afa098d7a2"
Jul 07 18:52:10.440087 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:10.439863    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-tgmzp_openshift-console-operator(66912b97-5b97-4e57-aa13-6338876cc559)\"" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" podUID="66912b97-5b97-4e57-aa13-6338876cc559"
Jul 07 18:52:10.910120 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:10.910033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz" event={"ID":"bd368f4e-5d49-4121-9228-ffa9e590a4d6","Type":"ContainerStarted","Data":"16cd6c5925df2bcebc778095c8465bf5c6859b2ff31739e5d62aa1092601d63b"}
Jul 07 18:52:10.910120 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:10.910092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz" event={"ID":"bd368f4e-5d49-4121-9228-ffa9e590a4d6","Type":"ContainerStarted","Data":"07be561d5801d4f35af37d399f3ff44c1ee6c765111ee06480708d49634f9324"}
Jul 07 18:52:10.911333 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:10.911307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jbws" event={"ID":"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b","Type":"ContainerStarted","Data":"82119f7ce467ac9f02e928d3c02f003e4421c0efc32a1cfc7756cd37cbb9b948"}
Jul 07 18:52:10.929245 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:10.929200    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xlbgz" podStartSLOduration=2.5041319140000002 podStartE2EDuration="5.929181284s" totalImagesPullingTime="3.42504937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:10.928776759 +0000 UTC m=+93.992253459" watchObservedRunningTime="2026-07-07 18:52:10.929181284 +0000 UTC m=+93.992657985"
Jul 07 18:52:11.917883 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:11.917831    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jbws" event={"ID":"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b","Type":"ContainerStarted","Data":"c011e873339a57409a45fb92c68b371397abc3ea718f2df9477b10eba3f3a21a"}
Jul 07 18:52:13.406870 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.406837    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"]
Jul 07 18:52:13.415393 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.415349    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.419558 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.419163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 18:52:13.419558 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.419335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 18:52:13.419836 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.419701    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cqm9q\""
Jul 07 18:52:13.420066 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.420047    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 18:52:13.426159 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.425942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"]
Jul 07 18:52:13.427617 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.427595    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8cw8d"]
Jul 07 18:52:13.431101 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.431079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.433603 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.433573    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 18:52:13.433714 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.433574    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 18:52:13.434149 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.434131    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5s2bl\""
Jul 07 18:52:13.434249 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.434219    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 18:52:13.473118 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-wtmp\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473316 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvnmh\" (UniqueName: \"kubernetes.io/projected/ac246d33-36de-4f01-8c54-4732880fe614-kube-api-access-fvnmh\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.473316 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ac246d33-36de-4f01-8c54-4732880fe614-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.473316 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.473316 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-metrics-client-ca\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473486 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5xxn\" (UniqueName: \"kubernetes.io/projected/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-kube-api-access-q5xxn\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473486 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.473486 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473486 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-tls\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473664 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac246d33-36de-4f01-8c54-4732880fe614-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.473664 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-root\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473664 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-textfile\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473664 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-sys\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473795 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.473795 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.473707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.574534 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.574477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.574713 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.574540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.574713 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.574584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-tls\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.574713 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:13.574677    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 18:52:13.575002 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:13.574738    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-tls podName:0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a nodeName:}" failed. No retries permitted until 2026-07-07 18:52:14.074717159 +0000 UTC m=+97.138193856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-tls") pod "node-exporter-8cw8d" (UID: "0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a") : secret "node-exporter-tls" not found
Jul 07 18:52:13.575002 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.574992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac246d33-36de-4f01-8c54-4732880fe614-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.575125 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-root\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575125 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-textfile\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-sys\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-root\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.575455 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-wtmp\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575455 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:13.575301    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 18:52:13.575455 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvnmh\" (UniqueName: \"kubernetes.io/projected/ac246d33-36de-4f01-8c54-4732880fe614-kube-api-access-fvnmh\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.575455 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ac246d33-36de-4f01-8c54-4732880fe614-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.575455 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:13.575348    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-tls podName:ac246d33-36de-4f01-8c54-4732880fe614 nodeName:}" failed. No retries permitted until 2026-07-07 18:52:14.0753323 +0000 UTC m=+97.138808979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-xrtgf" (UID: "ac246d33-36de-4f01-8c54-4732880fe614") : secret "kube-state-metrics-tls" not found
Jul 07 18:52:13.575455 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.575455 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575411    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-metrics-client-ca\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575810 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5xxn\" (UniqueName: \"kubernetes.io/projected/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-kube-api-access-q5xxn\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575810 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575474    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-wtmp\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575810 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-sys\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.575810 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575737    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac246d33-36de-4f01-8c54-4732880fe614-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.575810 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575762    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ac246d33-36de-4f01-8c54-4732880fe614-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.575810 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.575780    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-textfile\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.576202 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.576179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.576297 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.576187    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-metrics-client-ca\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.576461 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.576441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.578769 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.578723    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:13.579143 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.579121    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.599751 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.599715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvnmh\" (UniqueName: \"kubernetes.io/projected/ac246d33-36de-4f01-8c54-4732880fe614-kube-api-access-fvnmh\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:13.604174 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:13.604151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5xxn\" (UniqueName: \"kubernetes.io/projected/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-kube-api-access-q5xxn\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:14.080140 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.080113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-tls\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:14.080248 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.080213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:14.082658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.082630    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a-node-exporter-tls\") pod \"node-exporter-8cw8d\" (UID: \"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a\") " pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:14.082942 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.082919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac246d33-36de-4f01-8c54-4732880fe614-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xrtgf\" (UID: \"ac246d33-36de-4f01-8c54-4732880fe614\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:14.328228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.328149    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"
Jul 07 18:52:14.341983 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.341961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8cw8d"
Jul 07 18:52:14.353812 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:52:14.353778    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffd3fd9_e8e9_4dbc_bc47_902043a8f98a.slice/crio-5c31a11dbe1db3f2072fc047e5afefb877157cd81c8ab6be4e620ee8b459ff22 WatchSource:0}: Error finding container 5c31a11dbe1db3f2072fc047e5afefb877157cd81c8ab6be4e620ee8b459ff22: Status 404 returned error can't find the container with id 5c31a11dbe1db3f2072fc047e5afefb877157cd81c8ab6be4e620ee8b459ff22
Jul 07 18:52:14.488073 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.487662    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf"]
Jul 07 18:52:14.492398 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:52:14.492371    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac246d33_36de_4f01_8c54_4732880fe614.slice/crio-595d0d11a3c19073cb5e18f39e5b8fbfaa94ce3b3f240604b7bbed15a95cc5e7 WatchSource:0}: Error finding container 595d0d11a3c19073cb5e18f39e5b8fbfaa94ce3b3f240604b7bbed15a95cc5e7: Status 404 returned error can't find the container with id 595d0d11a3c19073cb5e18f39e5b8fbfaa94ce3b3f240604b7bbed15a95cc5e7
Jul 07 18:52:14.805415 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.805387    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8fhf5"
Jul 07 18:52:14.934878 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.934840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cw8d" event={"ID":"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a","Type":"ContainerStarted","Data":"5c31a11dbe1db3f2072fc047e5afefb877157cd81c8ab6be4e620ee8b459ff22"}
Jul 07 18:52:14.936969 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.936945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jbws" event={"ID":"6b91fee1-1f10-40f8-b3a9-94bb8bbe854b","Type":"ContainerStarted","Data":"fdfcaa833a9f36523782f67cfc5dd6201cbf55f6bfe77ff8d52d79f25c090777"}
Jul 07 18:52:14.938159 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.938136    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf" event={"ID":"ac246d33-36de-4f01-8c54-4732880fe614","Type":"ContainerStarted","Data":"595d0d11a3c19073cb5e18f39e5b8fbfaa94ce3b3f240604b7bbed15a95cc5e7"}
Jul 07 18:52:14.954982 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:14.954925    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6jbws" podStartSLOduration=33.593354213 podStartE2EDuration="40.954910983s" totalImagesPullingTime="7.36155677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:51:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:14.954084731 +0000 UTC m=+98.017561430" watchObservedRunningTime="2026-07-07 18:52:14.954910983 +0000 UTC m=+98.018387683"
Jul 07 18:52:15.943323 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:15.943294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf" event={"ID":"ac246d33-36de-4f01-8c54-4732880fe614","Type":"ContainerStarted","Data":"83d640866d3ad559b179edde34002c7eb6ed0ff678c3860d6b821987c379ec28"}
Jul 07 18:52:15.945251 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:15.945208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cw8d" event={"ID":"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a","Type":"ContainerStarted","Data":"12df27b6c8fc8cd2e78407a1df2aeee15914ea25bfbdd3577f079365bcdcc883"}
Jul 07 18:52:16.704372 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.704332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:52:16.704372 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.704377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:52:16.706725 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.706696    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b72e3ba1-083d-49bb-9362-c0dbd9928bc6-metrics-tls\") pod \"dns-default-b7n7x\" (UID: \"b72e3ba1-083d-49bb-9362-c0dbd9928bc6\") " pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:52:16.706826 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.706736    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"image-registry-5c9595fff9-htn96\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") " pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:52:16.947231 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.947193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rtr89\""
Jul 07 18:52:16.950149 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.950113    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf" event={"ID":"ac246d33-36de-4f01-8c54-4732880fe614","Type":"ContainerStarted","Data":"f70926824b2dca9ffb340f22784f669be7cb26f56e507243362bdcbf715d2170"}
Jul 07 18:52:16.950307 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.950168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf" event={"ID":"ac246d33-36de-4f01-8c54-4732880fe614","Type":"ContainerStarted","Data":"cf24ce6461787b602f510a772c6b586a9a5f09c0e2708934db14fb5ee0f135ec"}
Jul 07 18:52:16.951557 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.951528    2562 generic.go:356] "Generic (PLEG): container finished" podID="0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a" containerID="12df27b6c8fc8cd2e78407a1df2aeee15914ea25bfbdd3577f079365bcdcc883" exitCode=0
Jul 07 18:52:16.951655 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.951607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cw8d" event={"ID":"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a","Type":"ContainerDied","Data":"12df27b6c8fc8cd2e78407a1df2aeee15914ea25bfbdd3577f079365bcdcc883"}
Jul 07 18:52:16.955133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.955087    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:52:16.962834 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.962818    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crmbz\""
Jul 07 18:52:16.971527 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.971498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:52:16.973822 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:16.973724    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xrtgf" podStartSLOduration=2.600119988 podStartE2EDuration="3.973703443s" totalImagesPullingTime="1.373583455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:16.971740713 +0000 UTC m=+100.035217420" watchObservedRunningTime="2026-07-07 18:52:16.973703443 +0000 UTC m=+100.037180144"
Jul 07 18:52:17.129255 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.129221    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c9595fff9-htn96"]
Jul 07 18:52:17.133255 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:52:17.133224    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bc6c87_1433_4af2_b6b4_9587c15aeb2c.slice/crio-ec0bf38033f835f09906cf5a49fc87cb0da8e2bc5641292e4a225aeb7411763f WatchSource:0}: Error finding container ec0bf38033f835f09906cf5a49fc87cb0da8e2bc5641292e4a225aeb7411763f: Status 404 returned error can't find the container with id ec0bf38033f835f09906cf5a49fc87cb0da8e2bc5641292e4a225aeb7411763f
Jul 07 18:52:17.152528 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.152507    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b7n7x"]
Jul 07 18:52:17.167446 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:52:17.167417    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72e3ba1_083d_49bb_9362_c0dbd9928bc6.slice/crio-a19d596da2b20b5ac2635f3f12dc167556b724813537af56d4be64d3e0968402 WatchSource:0}: Error finding container a19d596da2b20b5ac2635f3f12dc167556b724813537af56d4be64d3e0968402: Status 404 returned error can't find the container with id a19d596da2b20b5ac2635f3f12dc167556b724813537af56d4be64d3e0968402
Jul 07 18:52:17.957494 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.957449    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b7n7x" event={"ID":"b72e3ba1-083d-49bb-9362-c0dbd9928bc6","Type":"ContainerStarted","Data":"a19d596da2b20b5ac2635f3f12dc167556b724813537af56d4be64d3e0968402"}
Jul 07 18:52:17.959825 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.959791    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cw8d" event={"ID":"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a","Type":"ContainerStarted","Data":"dd4746a040b73e900a0243740c3c0cf89103a0edae4b521088d56057d9acf9f1"}
Jul 07 18:52:17.959978 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.959852    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8cw8d" event={"ID":"0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a","Type":"ContainerStarted","Data":"42a5f023edf3ff664aab1da54a5bbd694ef6cb6f0f5a68380383e49772fbb054"}
Jul 07 18:52:17.961582 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.961552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9595fff9-htn96" event={"ID":"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c","Type":"ContainerStarted","Data":"a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3"}
Jul 07 18:52:17.961706 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.961601    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9595fff9-htn96" event={"ID":"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c","Type":"ContainerStarted","Data":"ec0bf38033f835f09906cf5a49fc87cb0da8e2bc5641292e4a225aeb7411763f"}
Jul 07 18:52:17.979996 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.979439    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8cw8d" podStartSLOduration=3.376381205 podStartE2EDuration="4.979420472s" totalImagesPullingTime="1.50948666s" totalInitContainerRuntime="93.552607ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:17.978607714 +0000 UTC m=+101.042084416" watchObservedRunningTime="2026-07-07 18:52:17.979420472 +0000 UTC m=+101.042897173"
Jul 07 18:52:17.998570 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:17.998521    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c9595fff9-htn96" podStartSLOduration=99.998510491 podStartE2EDuration="1m39.998510491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:17.997652608 +0000 UTC m=+101.061129309" watchObservedRunningTime="2026-07-07 18:52:17.998510491 +0000 UTC m=+101.061987203"
Jul 07 18:52:18.969420 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:18.969384    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:52:19.975425 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:19.975386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b7n7x" event={"ID":"b72e3ba1-083d-49bb-9362-c0dbd9928bc6","Type":"ContainerStarted","Data":"d4438e7b872a922a3241d946637e36076e819b511f1fe0518b3427eb1068e5e7"}
Jul 07 18:52:19.975936 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:19.975449    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b7n7x" event={"ID":"b72e3ba1-083d-49bb-9362-c0dbd9928bc6","Type":"ContainerStarted","Data":"2bf4f4a662f47b3ca713ec53eba1c20db5bd5b7a5697e3b0f7d31d9bc65cfdde"}
Jul 07 18:52:19.975936 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:19.975481    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:52:20.015106 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:20.015042    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b7n7x" podStartSLOduration=65.565239098 podStartE2EDuration="1m8.015017631s" totalImagesPullingTime="2.449778533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:20.014960944 +0000 UTC m=+103.078437673" watchObservedRunningTime="2026-07-07 18:52:20.015017631 +0000 UTC m=+103.078494329"
Jul 07 18:52:23.267470 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:23.267432    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c9595fff9-htn96"]
Jul 07 18:52:25.440039 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:25.440006    2562 scope.go:117] "RemoveContainer" containerID="46e74375f5347b21c28070d0f0c093f5492ca1b552c626a1f7a263afa098d7a2"
Jul 07 18:52:26.000302 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:26.000250    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 18:52:26.000445 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:26.000365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" event={"ID":"66912b97-5b97-4e57-aa13-6338876cc559","Type":"ContainerStarted","Data":"6a7ac70cd44438253d2148441dcf12d8c89e43b35fa9dfd49a1ad951e3e89f7b"}
Jul 07 18:52:26.000635 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:26.000608    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:52:26.005249 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:26.005231    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp"
Jul 07 18:52:26.026463 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:26.026420    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-tgmzp" podStartSLOduration=54.765138684 podStartE2EDuration="1m0.026405288s" totalImagesPullingTime="5.261266604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:26.024858269 +0000 UTC m=+109.088334969" watchObservedRunningTime="2026-07-07 18:52:26.026405288 +0000 UTC m=+109.089881988"
Jul 07 18:52:29.981832 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:29.981800    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b7n7x"
Jul 07 18:52:33.273348 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:33.273320    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:52:44.073744 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:44.073709    2562 generic.go:356] "Generic (PLEG): container finished" podID="1b335854-7808-48ae-a80b-27712097ba11" containerID="ee5382784df656d334544a1c83f7e28a5e197aadaf0841935c4ce82f3db59dd6" exitCode=0
Jul 07 18:52:44.074164 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:44.073784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9" event={"ID":"1b335854-7808-48ae-a80b-27712097ba11","Type":"ContainerDied","Data":"ee5382784df656d334544a1c83f7e28a5e197aadaf0841935c4ce82f3db59dd6"}
Jul 07 18:52:44.074164 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:44.074119    2562 scope.go:117] "RemoveContainer" containerID="ee5382784df656d334544a1c83f7e28a5e197aadaf0841935c4ce82f3db59dd6"
Jul 07 18:52:45.079360 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:45.079324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7d6x9" event={"ID":"1b335854-7808-48ae-a80b-27712097ba11","Type":"ContainerStarted","Data":"89979eb5f772a3ed786e2bae157fcef8a6b51b2ea404e208795683f79a80cb9c"}
Jul 07 18:52:47.370591 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:47.370552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:52:47.372966 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:47.372944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab0ffc3-9c02-4a8b-9555-84da21ad5f26-metrics-certs\") pod \"network-metrics-daemon-jgw7m\" (UID: \"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26\") " pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:52:47.470367 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:47.470328    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nk7wp\""
Jul 07 18:52:47.477903 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:47.477878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgw7m"
Jul 07 18:52:47.612941 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:47.612907    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jgw7m"]
Jul 07 18:52:47.616159 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:52:47.616115    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab0ffc3_9c02_4a8b_9555_84da21ad5f26.slice/crio-07a71c299ba6152eb73108bb720e76b350a54b0a3183974252b685b1c94a4a92 WatchSource:0}: Error finding container 07a71c299ba6152eb73108bb720e76b350a54b0a3183974252b685b1c94a4a92: Status 404 returned error can't find the container with id 07a71c299ba6152eb73108bb720e76b350a54b0a3183974252b685b1c94a4a92
Jul 07 18:52:48.093618 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.093586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jgw7m" event={"ID":"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26","Type":"ContainerStarted","Data":"07a71c299ba6152eb73108bb720e76b350a54b0a3183974252b685b1c94a4a92"}
Jul 07 18:52:48.288062 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.287990    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c9595fff9-htn96" podUID="f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" containerName="registry" containerID="cri-o://a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3" gracePeriod=30
Jul 07 18:52:48.755197 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.755177    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:52:48.785282 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785241    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpj9s\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-kube-api-access-bpj9s\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.785448 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785327    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.785448 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785356    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-bound-sa-token\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.785448 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785374    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-trusted-ca\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.785448 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785424    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-ca-trust-extracted\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.785667 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785503    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-installation-pull-secrets\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.785667 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785534    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-certificates\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.785667 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.785563    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-image-registry-private-configuration\") pod \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\" (UID: \"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c\") "
Jul 07 18:52:48.786971 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.786719    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:48.786971 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.786940    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:48.788843 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.788814    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-kube-api-access-bpj9s" (OuterVolumeSpecName: "kube-api-access-bpj9s") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "kube-api-access-bpj9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:48.788980 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.788961    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:48.789058 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.788961    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:52:48.789151 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.789125    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:52:48.789599 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.789578    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:48.794915 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.794887    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" (UID: "f9bc6c87-1433-4af2-b6b4-9587c15aeb2c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:52:48.886637 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886610    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-installation-pull-secrets\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:48.886637 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886638    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-certificates\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:48.886801 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886655    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-image-registry-private-configuration\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:48.886801 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886668    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpj9s\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-kube-api-access-bpj9s\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:48.886801 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886681    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-registry-tls\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:48.886801 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886694    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-bound-sa-token\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:48.886801 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886706    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-trusted-ca\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:48.886801 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:48.886717    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c-ca-trust-extracted\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:52:49.098923 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.098834    2562 generic.go:356] "Generic (PLEG): container finished" podID="c0ee4d04-87c0-4489-89ee-b85237a6398a" containerID="59818cb583fa25ec9a96a56d857f1e0a90f347b9e3e38050e694b01ba7686584" exitCode=0
Jul 07 18:52:49.099093 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.098915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4" event={"ID":"c0ee4d04-87c0-4489-89ee-b85237a6398a","Type":"ContainerDied","Data":"59818cb583fa25ec9a96a56d857f1e0a90f347b9e3e38050e694b01ba7686584"}
Jul 07 18:52:49.099331 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.099313    2562 scope.go:117] "RemoveContainer" containerID="59818cb583fa25ec9a96a56d857f1e0a90f347b9e3e38050e694b01ba7686584"
Jul 07 18:52:49.100207 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.100184    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" containerID="a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3" exitCode=0
Jul 07 18:52:49.100328 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.100246    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9595fff9-htn96"
Jul 07 18:52:49.100328 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.100247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9595fff9-htn96" event={"ID":"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c","Type":"ContainerDied","Data":"a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3"}
Jul 07 18:52:49.100328 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.100321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9595fff9-htn96" event={"ID":"f9bc6c87-1433-4af2-b6b4-9587c15aeb2c","Type":"ContainerDied","Data":"ec0bf38033f835f09906cf5a49fc87cb0da8e2bc5641292e4a225aeb7411763f"}
Jul 07 18:52:49.100476 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.100352    2562 scope.go:117] "RemoveContainer" containerID="a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3"
Jul 07 18:52:49.102727 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.102701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jgw7m" event={"ID":"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26","Type":"ContainerStarted","Data":"bcf4741b257bcbf28365db7e886ea835ad8722caeaa9e0beb04114e4297610b7"}
Jul 07 18:52:49.102841 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.102754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jgw7m" event={"ID":"2ab0ffc3-9c02-4a8b-9555-84da21ad5f26","Type":"ContainerStarted","Data":"189db5dd90c8bcfd4af5e179b5c9d63c2ff7efab4b7c1467f57de65f21348876"}
Jul 07 18:52:49.110164 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.110144    2562 scope.go:117] "RemoveContainer" containerID="a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3"
Jul 07 18:52:49.110495 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:52:49.110474    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3\": container with ID starting with a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3 not found: ID does not exist" containerID="a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3"
Jul 07 18:52:49.110566 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.110504    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3"} err="failed to get container status \"a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3\": rpc error: code = NotFound desc = could not find container \"a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3\": container with ID starting with a4ecd81eb79fb3602823c4ebd5982b299884eb5c1c3475b75abce0689f8ad3d3 not found: ID does not exist"
Jul 07 18:52:49.152445 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.152395    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jgw7m" podStartSLOduration=130.978781428 podStartE2EDuration="2m12.152377436s" totalImagesPullingTime="1.173596008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:49.133682284 +0000 UTC m=+132.197158984" watchObservedRunningTime="2026-07-07 18:52:49.152377436 +0000 UTC m=+132.215854135"
Jul 07 18:52:49.153593 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.153570    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c9595fff9-htn96"]
Jul 07 18:52:49.160009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.159988    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c9595fff9-htn96"]
Jul 07 18:52:49.445375 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:49.445335    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" path="/var/lib/kubelet/pods/f9bc6c87-1433-4af2-b6b4-9587c15aeb2c/volumes"
Jul 07 18:52:50.108087 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:50.107997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hz6b4" event={"ID":"c0ee4d04-87c0-4489-89ee-b85237a6398a","Type":"ContainerStarted","Data":"27bcf62d195050b2b49872a16273b5a029c81e895dfb5122b36afe1bdb0817fb"}
Jul 07 18:52:51.137487 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:51.137456    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-dxk88_2f643423-faf7-4ab2-9a74-f2e47ae97560/cluster-monitoring-operator/0.log"
Jul 07 18:52:51.336704 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:51.336673    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xrtgf_ac246d33-36de-4f01-8c54-4732880fe614/kube-state-metrics/0.log"
Jul 07 18:52:51.535698 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:51.535671    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xrtgf_ac246d33-36de-4f01-8c54-4732880fe614/kube-rbac-proxy-main/0.log"
Jul 07 18:52:51.736056 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:51.736025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xrtgf_ac246d33-36de-4f01-8c54-4732880fe614/kube-rbac-proxy-self/0.log"
Jul 07 18:52:52.337819 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:52.337790    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cw8d_0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a/init-textfile/0.log"
Jul 07 18:52:52.540589 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:52.540557    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cw8d_0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a/node-exporter/0.log"
Jul 07 18:52:52.736324 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:52.736289    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cw8d_0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a/kube-rbac-proxy/0.log"
Jul 07 18:52:56.137726 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:56.137700    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xlbgz_bd368f4e-5d49-4121-9228-ffa9e590a4d6/prometheus-operator/0.log"
Jul 07 18:52:56.337471 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:56.337436    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xlbgz_bd368f4e-5d49-4121-9228-ffa9e590a4d6/kube-rbac-proxy/0.log"
Jul 07 18:52:58.742181 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:58.742145    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 18:52:58.937496 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:52:58.937462    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/3.log"
Jul 07 18:53:09.185616 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:53:09.185582    2562 generic.go:356] "Generic (PLEG): container finished" podID="5588527f-2b7a-47e2-95d3-0f10164a6c5f" containerID="9099cd26c7c55f74fda50cf85a316eb27ede464b7f1f79b8ea670b6c0bccab5f" exitCode=0
Jul 07 18:53:09.185616 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:53:09.185625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl" event={"ID":"5588527f-2b7a-47e2-95d3-0f10164a6c5f","Type":"ContainerDied","Data":"9099cd26c7c55f74fda50cf85a316eb27ede464b7f1f79b8ea670b6c0bccab5f"}
Jul 07 18:53:09.186066 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:53:09.185900    2562 scope.go:117] "RemoveContainer" containerID="9099cd26c7c55f74fda50cf85a316eb27ede464b7f1f79b8ea670b6c0bccab5f"
Jul 07 18:53:10.191847 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:53:10.191804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m68sl" event={"ID":"5588527f-2b7a-47e2-95d3-0f10164a6c5f","Type":"ContainerStarted","Data":"0314d9fbc449a4a4645aa40a0223bdaf24f0c22dd9ea500c4303c66763dd6ef0"}
Jul 07 18:54:14.725611 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.725576    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"]
Jul 07 18:54:14.726227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.725958    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" containerName="registry"
Jul 07 18:54:14.726227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.725973    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" containerName="registry"
Jul 07 18:54:14.726227 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.726040    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9bc6c87-1433-4af2-b6b4-9587c15aeb2c" containerName="registry"
Jul 07 18:54:14.729181 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.729164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.740028 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.740008    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 18:54:14.740028 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.740017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gx6kb\""
Jul 07 18:54:14.740161 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.740062    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 18:54:14.753182 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.753159    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"]
Jul 07 18:54:14.829415 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.829377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgnkn\" (UniqueName: \"kubernetes.io/projected/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-kube-api-access-cgnkn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.829598 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.829448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.829598 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.829478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.930455 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.930420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.930593 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.930464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.930593 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.930502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgnkn\" (UniqueName: \"kubernetes.io/projected/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-kube-api-access-cgnkn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.930819 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.930798    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.930901 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.930825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:14.948071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:14.948038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgnkn\" (UniqueName: \"kubernetes.io/projected/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-kube-api-access-cgnkn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:15.038359 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:15.038277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:15.179900 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:15.179869    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"]
Jul 07 18:54:15.184545 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:54:15.184517    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a77e5c5_98ff_4abd_8352_7968b3fa45ff.slice/crio-d0a9f7a20c3964fb5456ed348b94275f901abadfd083344a0ee348ada67984ec WatchSource:0}: Error finding container d0a9f7a20c3964fb5456ed348b94275f901abadfd083344a0ee348ada67984ec: Status 404 returned error can't find the container with id d0a9f7a20c3964fb5456ed348b94275f901abadfd083344a0ee348ada67984ec
Jul 07 18:54:15.430335 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:15.430297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p" event={"ID":"8a77e5c5-98ff-4abd-8352-7968b3fa45ff","Type":"ContainerStarted","Data":"d0a9f7a20c3964fb5456ed348b94275f901abadfd083344a0ee348ada67984ec"}
Jul 07 18:54:24.464736 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:24.464683    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerID="33fdcf524f74a78f98a6ac4aca38829820b9f8f17ac1f56121dd5ee784402c9c" exitCode=0
Jul 07 18:54:24.465167 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:24.464759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p" event={"ID":"8a77e5c5-98ff-4abd-8352-7968b3fa45ff","Type":"ContainerDied","Data":"33fdcf524f74a78f98a6ac4aca38829820b9f8f17ac1f56121dd5ee784402c9c"}
Jul 07 18:54:26.473760 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:26.473733    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerID="d2bf5ae8ef33b8d0ea85daf02afdbb9500964dc767947ff57db352ae842c840f" exitCode=0
Jul 07 18:54:26.474077 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:26.473813    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p" event={"ID":"8a77e5c5-98ff-4abd-8352-7968b3fa45ff","Type":"ContainerDied","Data":"d2bf5ae8ef33b8d0ea85daf02afdbb9500964dc767947ff57db352ae842c840f"}
Jul 07 18:54:34.509994 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:34.509956    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerID="ebbbe934cb636bf0ddda2b6eaab3b0329ad3029e08303d24d5438137cc848c21" exitCode=0
Jul 07 18:54:34.510488 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:34.510016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p" event={"ID":"8a77e5c5-98ff-4abd-8352-7968b3fa45ff","Type":"ContainerDied","Data":"ebbbe934cb636bf0ddda2b6eaab3b0329ad3029e08303d24d5438137cc848c21"}
Jul 07 18:54:35.640518 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.640490    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:35.708466 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.708435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgnkn\" (UniqueName: \"kubernetes.io/projected/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-kube-api-access-cgnkn\") pod \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") "
Jul 07 18:54:35.708644 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.708494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-bundle\") pod \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") "
Jul 07 18:54:35.708644 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.708541    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-util\") pod \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\" (UID: \"8a77e5c5-98ff-4abd-8352-7968b3fa45ff\") "
Jul 07 18:54:35.709189 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.709163    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-bundle" (OuterVolumeSpecName: "bundle") pod "8a77e5c5-98ff-4abd-8352-7968b3fa45ff" (UID: "8a77e5c5-98ff-4abd-8352-7968b3fa45ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:54:35.710994 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.710954    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-kube-api-access-cgnkn" (OuterVolumeSpecName: "kube-api-access-cgnkn") pod "8a77e5c5-98ff-4abd-8352-7968b3fa45ff" (UID: "8a77e5c5-98ff-4abd-8352-7968b3fa45ff"). InnerVolumeSpecName "kube-api-access-cgnkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:54:35.712644 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.712614    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-util" (OuterVolumeSpecName: "util") pod "8a77e5c5-98ff-4abd-8352-7968b3fa45ff" (UID: "8a77e5c5-98ff-4abd-8352-7968b3fa45ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:54:35.810986 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.810060    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:54:35.810986 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.810137    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-util\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:54:35.810986 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:35.810154    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgnkn\" (UniqueName: \"kubernetes.io/projected/8a77e5c5-98ff-4abd-8352-7968b3fa45ff-kube-api-access-cgnkn\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:54:36.518853 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:36.518819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p" event={"ID":"8a77e5c5-98ff-4abd-8352-7968b3fa45ff","Type":"ContainerDied","Data":"d0a9f7a20c3964fb5456ed348b94275f901abadfd083344a0ee348ada67984ec"}
Jul 07 18:54:36.519015 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:36.518863    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0a9f7a20c3964fb5456ed348b94275f901abadfd083344a0ee348ada67984ec"
Jul 07 18:54:36.519015 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:36.518865    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407hh5p"
Jul 07 18:54:43.696860 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.696827    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"]
Jul 07 18:54:43.697247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.697105    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerName="util"
Jul 07 18:54:43.697247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.697116    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerName="util"
Jul 07 18:54:43.697247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.697130    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerName="extract"
Jul 07 18:54:43.697247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.697135    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerName="extract"
Jul 07 18:54:43.697247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.697143    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerName="pull"
Jul 07 18:54:43.697247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.697148    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerName="pull"
Jul 07 18:54:43.697247 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.697199    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a77e5c5-98ff-4abd-8352-7968b3fa45ff" containerName="extract"
Jul 07 18:54:43.700402 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.700386    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:43.703934 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.703917    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 18:54:43.704067 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.704018    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bspzw\""
Jul 07 18:54:43.704138 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.704088    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:54:43.719495 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.719475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"]
Jul 07 18:54:43.775812 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.775780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b57831-921f-4a3c-a152-38ff39eb6147-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p5tvb\" (UID: \"41b57831-921f-4a3c-a152-38ff39eb6147\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:43.775945 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.775817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g797r\" (UniqueName: \"kubernetes.io/projected/41b57831-921f-4a3c-a152-38ff39eb6147-kube-api-access-g797r\") pod \"cert-manager-operator-controller-manager-55c444bf86-p5tvb\" (UID: \"41b57831-921f-4a3c-a152-38ff39eb6147\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:43.876320 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.876289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b57831-921f-4a3c-a152-38ff39eb6147-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p5tvb\" (UID: \"41b57831-921f-4a3c-a152-38ff39eb6147\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:43.876443 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.876325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g797r\" (UniqueName: \"kubernetes.io/projected/41b57831-921f-4a3c-a152-38ff39eb6147-kube-api-access-g797r\") pod \"cert-manager-operator-controller-manager-55c444bf86-p5tvb\" (UID: \"41b57831-921f-4a3c-a152-38ff39eb6147\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:43.876703 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.876685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b57831-921f-4a3c-a152-38ff39eb6147-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p5tvb\" (UID: \"41b57831-921f-4a3c-a152-38ff39eb6147\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:43.894052 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:43.894028    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g797r\" (UniqueName: \"kubernetes.io/projected/41b57831-921f-4a3c-a152-38ff39eb6147-kube-api-access-g797r\") pod \"cert-manager-operator-controller-manager-55c444bf86-p5tvb\" (UID: \"41b57831-921f-4a3c-a152-38ff39eb6147\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:44.009701 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:44.009625    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"
Jul 07 18:54:44.154863 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:44.154828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb"]
Jul 07 18:54:44.159449 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:54:44.159419    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b57831_921f_4a3c_a152_38ff39eb6147.slice/crio-8d899a684455008e586ce8ed8ea0b7ea4a50a42375241f42e8f7741b674c1313 WatchSource:0}: Error finding container 8d899a684455008e586ce8ed8ea0b7ea4a50a42375241f42e8f7741b674c1313: Status 404 returned error can't find the container with id 8d899a684455008e586ce8ed8ea0b7ea4a50a42375241f42e8f7741b674c1313
Jul 07 18:54:44.553360 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:44.553326    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb" event={"ID":"41b57831-921f-4a3c-a152-38ff39eb6147","Type":"ContainerStarted","Data":"8d899a684455008e586ce8ed8ea0b7ea4a50a42375241f42e8f7741b674c1313"}
Jul 07 18:54:46.563761 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:46.563728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb" event={"ID":"41b57831-921f-4a3c-a152-38ff39eb6147","Type":"ContainerStarted","Data":"2f27f1512338ba5fb07c4390a913b4832f3b7a5978cdcc793e58b69ddb86b540"}
Jul 07 18:54:46.604861 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:46.604807    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p5tvb" podStartSLOduration=1.802900786 podStartE2EDuration="3.604790911s" totalImagesPullingTime="1.801890125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:46.598160772 +0000 UTC m=+249.661637473" watchObservedRunningTime="2026-07-07 18:54:46.604790911 +0000 UTC m=+249.668267687"
Jul 07 18:54:47.381886 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.381852    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kvc9m"]
Jul 07 18:54:47.385214 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.385198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.388504 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.388470    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 18:54:47.388636 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.388613    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7b52c\""
Jul 07 18:54:47.388952 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.388924    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 18:54:47.414567 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.414542    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kvc9m"]
Jul 07 18:54:47.511279 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.511241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e78bdb44-16c3-42e8-b72e-41502802ada7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kvc9m\" (UID: \"e78bdb44-16c3-42e8-b72e-41502802ada7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.511444 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.511361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjfhb\" (UniqueName: \"kubernetes.io/projected/e78bdb44-16c3-42e8-b72e-41502802ada7-kube-api-access-bjfhb\") pod \"cert-manager-webhook-6486ffd997-kvc9m\" (UID: \"e78bdb44-16c3-42e8-b72e-41502802ada7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.612033 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.612004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e78bdb44-16c3-42e8-b72e-41502802ada7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kvc9m\" (UID: \"e78bdb44-16c3-42e8-b72e-41502802ada7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.612409 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.612042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjfhb\" (UniqueName: \"kubernetes.io/projected/e78bdb44-16c3-42e8-b72e-41502802ada7-kube-api-access-bjfhb\") pod \"cert-manager-webhook-6486ffd997-kvc9m\" (UID: \"e78bdb44-16c3-42e8-b72e-41502802ada7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.646639 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.646564    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"]
Jul 07 18:54:47.647420 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.647392    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e78bdb44-16c3-42e8-b72e-41502802ada7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kvc9m\" (UID: \"e78bdb44-16c3-42e8-b72e-41502802ada7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.647546 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.647487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjfhb\" (UniqueName: \"kubernetes.io/projected/e78bdb44-16c3-42e8-b72e-41502802ada7-kube-api-access-bjfhb\") pod \"cert-manager-webhook-6486ffd997-kvc9m\" (UID: \"e78bdb44-16c3-42e8-b72e-41502802ada7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.650281 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.650251    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.660177 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.660153    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 18:54:47.660379 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.660364    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gx6kb\""
Jul 07 18:54:47.660475 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.660446    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 18:54:47.691258 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.691227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"]
Jul 07 18:54:47.704325 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.704297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:47.814726 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.814696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lvqf\" (UniqueName: \"kubernetes.io/projected/d2332741-16ce-40e1-808e-b58a9f9258c2-kube-api-access-5lvqf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.814885 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.814792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.814885 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.814839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.862965 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.862932    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kvc9m"]
Jul 07 18:54:47.867165 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:54:47.867136    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode78bdb44_16c3_42e8_b72e_41502802ada7.slice/crio-61b7ad5269c00895f088862dfafa65c7a6cd72825a04cb94f746a288453e61a1 WatchSource:0}: Error finding container 61b7ad5269c00895f088862dfafa65c7a6cd72825a04cb94f746a288453e61a1: Status 404 returned error can't find the container with id 61b7ad5269c00895f088862dfafa65c7a6cd72825a04cb94f746a288453e61a1
Jul 07 18:54:47.915297 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.915211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lvqf\" (UniqueName: \"kubernetes.io/projected/d2332741-16ce-40e1-808e-b58a9f9258c2-kube-api-access-5lvqf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.915421 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.915300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.915421 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.915327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.915669 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.915651    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.915759 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.915740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.942062 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.942036    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lvqf\" (UniqueName: \"kubernetes.io/projected/d2332741-16ce-40e1-808e-b58a9f9258c2-kube-api-access-5lvqf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:47.966953 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:47.966929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:48.143082 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:48.143048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"]
Jul 07 18:54:48.146293 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:54:48.146246    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2332741_16ce_40e1_808e_b58a9f9258c2.slice/crio-7f2a3c3776cae03d83031c99e87db43e52428023aa71614239fa55a776baec1c WatchSource:0}: Error finding container 7f2a3c3776cae03d83031c99e87db43e52428023aa71614239fa55a776baec1c: Status 404 returned error can't find the container with id 7f2a3c3776cae03d83031c99e87db43e52428023aa71614239fa55a776baec1c
Jul 07 18:54:48.574118 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:48.574038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m" event={"ID":"e78bdb44-16c3-42e8-b72e-41502802ada7","Type":"ContainerStarted","Data":"61b7ad5269c00895f088862dfafa65c7a6cd72825a04cb94f746a288453e61a1"}
Jul 07 18:54:48.576164 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:48.576129    2562 generic.go:356] "Generic (PLEG): container finished" podID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerID="03aa6034dcdf5af8775b20df41a8fd891729ef93f226808c21585b86b73c7378" exitCode=0
Jul 07 18:54:48.576336 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:48.576168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk" event={"ID":"d2332741-16ce-40e1-808e-b58a9f9258c2","Type":"ContainerDied","Data":"03aa6034dcdf5af8775b20df41a8fd891729ef93f226808c21585b86b73c7378"}
Jul 07 18:54:48.576336 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:48.576200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk" event={"ID":"d2332741-16ce-40e1-808e-b58a9f9258c2","Type":"ContainerStarted","Data":"7f2a3c3776cae03d83031c99e87db43e52428023aa71614239fa55a776baec1c"}
Jul 07 18:54:51.595195 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:51.595107    2562 generic.go:356] "Generic (PLEG): container finished" podID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerID="5c93241ef015b76dd1473a00e0ebc891c6af14bbc2eaa5ce84fadba3021333b5" exitCode=0
Jul 07 18:54:51.595195 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:51.595154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk" event={"ID":"d2332741-16ce-40e1-808e-b58a9f9258c2","Type":"ContainerDied","Data":"5c93241ef015b76dd1473a00e0ebc891c6af14bbc2eaa5ce84fadba3021333b5"}
Jul 07 18:54:51.597995 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:51.597973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m" event={"ID":"e78bdb44-16c3-42e8-b72e-41502802ada7","Type":"ContainerStarted","Data":"48a81f3b87702c0c7cc12c8d04c6e120caf2c7df868cd39e2220d8657a8887fb"}
Jul 07 18:54:51.600336 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:51.600315    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:51.645220 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:51.645175    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m" podStartSLOduration=1.199198347 podStartE2EDuration="4.645160271s" totalImagesPullingTime="3.445961924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:51.643187425 +0000 UTC m=+254.706664127" watchObservedRunningTime="2026-07-07 18:54:51.645160271 +0000 UTC m=+254.708636971"
Jul 07 18:54:52.604210 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:52.604175    2562 generic.go:356] "Generic (PLEG): container finished" podID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerID="0d3190491195e1a32e89b531188bac2b3ff4ed5ed4017bf7fbd4d2998ce6af32" exitCode=0
Jul 07 18:54:52.604629 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:52.604276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk" event={"ID":"d2332741-16ce-40e1-808e-b58a9f9258c2","Type":"ContainerDied","Data":"0d3190491195e1a32e89b531188bac2b3ff4ed5ed4017bf7fbd4d2998ce6af32"}
Jul 07 18:54:53.741380 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.741354    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:53.864469 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.864383    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-util\") pod \"d2332741-16ce-40e1-808e-b58a9f9258c2\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") "
Jul 07 18:54:53.864469 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.864445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lvqf\" (UniqueName: \"kubernetes.io/projected/d2332741-16ce-40e1-808e-b58a9f9258c2-kube-api-access-5lvqf\") pod \"d2332741-16ce-40e1-808e-b58a9f9258c2\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") "
Jul 07 18:54:53.864645 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.864487    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-bundle\") pod \"d2332741-16ce-40e1-808e-b58a9f9258c2\" (UID: \"d2332741-16ce-40e1-808e-b58a9f9258c2\") "
Jul 07 18:54:53.864917 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.864894    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-bundle" (OuterVolumeSpecName: "bundle") pod "d2332741-16ce-40e1-808e-b58a9f9258c2" (UID: "d2332741-16ce-40e1-808e-b58a9f9258c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:54:53.866693 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.866667    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2332741-16ce-40e1-808e-b58a9f9258c2-kube-api-access-5lvqf" (OuterVolumeSpecName: "kube-api-access-5lvqf") pod "d2332741-16ce-40e1-808e-b58a9f9258c2" (UID: "d2332741-16ce-40e1-808e-b58a9f9258c2"). InnerVolumeSpecName "kube-api-access-5lvqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:54:53.869126 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.869103    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-util" (OuterVolumeSpecName: "util") pod "d2332741-16ce-40e1-808e-b58a9f9258c2" (UID: "d2332741-16ce-40e1-808e-b58a9f9258c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:54:53.965204 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.965176    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-util\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:54:53.965204 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.965201    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lvqf\" (UniqueName: \"kubernetes.io/projected/d2332741-16ce-40e1-808e-b58a9f9258c2-kube-api-access-5lvqf\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:54:53.965387 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:53.965212    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2332741-16ce-40e1-808e-b58a9f9258c2-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:54:54.614898 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.614867    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk"
Jul 07 18:54:54.614898 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.614892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk97kk" event={"ID":"d2332741-16ce-40e1-808e-b58a9f9258c2","Type":"ContainerDied","Data":"7f2a3c3776cae03d83031c99e87db43e52428023aa71614239fa55a776baec1c"}
Jul 07 18:54:54.615093 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.614929    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f2a3c3776cae03d83031c99e87db43e52428023aa71614239fa55a776baec1c"
Jul 07 18:54:54.739995 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.739956    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"]
Jul 07 18:54:54.740442 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.740425    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerName="extract"
Jul 07 18:54:54.740489 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.740446    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerName="extract"
Jul 07 18:54:54.740489 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.740464    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerName="util"
Jul 07 18:54:54.740489 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.740472    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerName="util"
Jul 07 18:54:54.740489 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.740482    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerName="pull"
Jul 07 18:54:54.740628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.740490    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerName="pull"
Jul 07 18:54:54.740628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.740557    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2332741-16ce-40e1-808e-b58a9f9258c2" containerName="extract"
Jul 07 18:54:54.744628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.744602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:54.747691 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.747671    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nb4zc\""
Jul 07 18:54:54.758003 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.757975    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"]
Jul 07 18:54:54.873603 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.873513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aee117a5-98a9-404d-8f90-86912b29728a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vb59\" (UID: \"aee117a5-98a9-404d-8f90-86912b29728a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:54.873603 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.873553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dngp4\" (UniqueName: \"kubernetes.io/projected/aee117a5-98a9-404d-8f90-86912b29728a-kube-api-access-dngp4\") pod \"cert-manager-cainjector-559cdd8c87-9vb59\" (UID: \"aee117a5-98a9-404d-8f90-86912b29728a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:54.974667 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.974627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngp4\" (UniqueName: \"kubernetes.io/projected/aee117a5-98a9-404d-8f90-86912b29728a-kube-api-access-dngp4\") pod \"cert-manager-cainjector-559cdd8c87-9vb59\" (UID: \"aee117a5-98a9-404d-8f90-86912b29728a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:54.974834 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.974737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aee117a5-98a9-404d-8f90-86912b29728a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vb59\" (UID: \"aee117a5-98a9-404d-8f90-86912b29728a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:54.985412 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.985378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aee117a5-98a9-404d-8f90-86912b29728a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vb59\" (UID: \"aee117a5-98a9-404d-8f90-86912b29728a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:54.985540 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:54.985474    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dngp4\" (UniqueName: \"kubernetes.io/projected/aee117a5-98a9-404d-8f90-86912b29728a-kube-api-access-dngp4\") pod \"cert-manager-cainjector-559cdd8c87-9vb59\" (UID: \"aee117a5-98a9-404d-8f90-86912b29728a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:55.053425 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:55.053391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"
Jul 07 18:54:55.187723 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:55.187689    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vb59"]
Jul 07 18:54:55.191256 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:54:55.191228    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaee117a5_98a9_404d_8f90_86912b29728a.slice/crio-d7b57de99751bcb587a5ae599fe91d8fa89d476325547b29681c845ed66a4dd9 WatchSource:0}: Error finding container d7b57de99751bcb587a5ae599fe91d8fa89d476325547b29681c845ed66a4dd9: Status 404 returned error can't find the container with id d7b57de99751bcb587a5ae599fe91d8fa89d476325547b29681c845ed66a4dd9
Jul 07 18:54:55.621010 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:55.620975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59" event={"ID":"aee117a5-98a9-404d-8f90-86912b29728a","Type":"ContainerStarted","Data":"00c5658a0c9638cc9fe7e89641ede4ca3394aa8b5c27ba8a592d4ca945602cf9"}
Jul 07 18:54:55.621010 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:55.621018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59" event={"ID":"aee117a5-98a9-404d-8f90-86912b29728a","Type":"ContainerStarted","Data":"d7b57de99751bcb587a5ae599fe91d8fa89d476325547b29681c845ed66a4dd9"}
Jul 07 18:54:57.607288 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:57.607241    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kvc9m"
Jul 07 18:54:57.630874 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:54:57.630821    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vb59" podStartSLOduration=3.630805412 podStartE2EDuration="3.630805412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:55.643444933 +0000 UTC m=+258.706921633" watchObservedRunningTime="2026-07-07 18:54:57.630805412 +0000 UTC m=+260.694282152"
Jul 07 18:55:06.952307 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:06.952275    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"]
Jul 07 18:55:06.957814 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:06.957796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:06.960071 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:06.960041    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 18:55:06.960254 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:06.960237    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 18:55:06.960771 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:06.960749    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gx6kb\""
Jul 07 18:55:06.970080 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:06.970043    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"]
Jul 07 18:55:07.074197 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.074161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.074399 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.074210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blpg8\" (UniqueName: \"kubernetes.io/projected/bfe76e72-29bb-4891-8e25-185e928bdc69-kube-api-access-blpg8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.074399 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.074234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.175202 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.175170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.175395 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.175254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.175395 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.175304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpg8\" (UniqueName: \"kubernetes.io/projected/bfe76e72-29bb-4891-8e25-185e928bdc69-kube-api-access-blpg8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.175659 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.175634    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.175694 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.175645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.184852 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.184821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpg8\" (UniqueName: \"kubernetes.io/projected/bfe76e72-29bb-4891-8e25-185e928bdc69-kube-api-access-blpg8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.268440 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.268364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:07.407909 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:55:07.407871    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe76e72_29bb_4891_8e25_185e928bdc69.slice/crio-0e7bf3a3073d92ffcee46e8b6286d143e0820972b8645337509c1866416d1d6f WatchSource:0}: Error finding container 0e7bf3a3073d92ffcee46e8b6286d143e0820972b8645337509c1866416d1d6f: Status 404 returned error can't find the container with id 0e7bf3a3073d92ffcee46e8b6286d143e0820972b8645337509c1866416d1d6f
Jul 07 18:55:07.408089 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.408067    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"]
Jul 07 18:55:07.674496 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.674463    2562 generic.go:356] "Generic (PLEG): container finished" podID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerID="cf96f7122cc184dc1106e4e2372d695e43cf7c311d3f23303f8539ce512ba09f" exitCode=0
Jul 07 18:55:07.674668 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.674550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh" event={"ID":"bfe76e72-29bb-4891-8e25-185e928bdc69","Type":"ContainerDied","Data":"cf96f7122cc184dc1106e4e2372d695e43cf7c311d3f23303f8539ce512ba09f"}
Jul 07 18:55:07.674668 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:07.674599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh" event={"ID":"bfe76e72-29bb-4891-8e25-185e928bdc69","Type":"ContainerStarted","Data":"0e7bf3a3073d92ffcee46e8b6286d143e0820972b8645337509c1866416d1d6f"}
Jul 07 18:55:08.680533 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:08.680502    2562 generic.go:356] "Generic (PLEG): container finished" podID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerID="7b9b9f5033664683003e3883ffb6bf230143bca0396d7bc19decad7948826b79" exitCode=0
Jul 07 18:55:08.680937 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:08.680585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh" event={"ID":"bfe76e72-29bb-4891-8e25-185e928bdc69","Type":"ContainerDied","Data":"7b9b9f5033664683003e3883ffb6bf230143bca0396d7bc19decad7948826b79"}
Jul 07 18:55:09.686904 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:09.686873    2562 generic.go:356] "Generic (PLEG): container finished" podID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerID="45e9531d17e668232dde7456a93773531b1a9f6fa3c56c164e6a7a3f70663470" exitCode=0
Jul 07 18:55:09.687303 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:09.686962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh" event={"ID":"bfe76e72-29bb-4891-8e25-185e928bdc69","Type":"ContainerDied","Data":"45e9531d17e668232dde7456a93773531b1a9f6fa3c56c164e6a7a3f70663470"}
Jul 07 18:55:10.822969 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:10.822946    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:10.905798 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:10.905772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blpg8\" (UniqueName: \"kubernetes.io/projected/bfe76e72-29bb-4891-8e25-185e928bdc69-kube-api-access-blpg8\") pod \"bfe76e72-29bb-4891-8e25-185e928bdc69\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") "
Jul 07 18:55:10.905966 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:10.905863    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-bundle\") pod \"bfe76e72-29bb-4891-8e25-185e928bdc69\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") "
Jul 07 18:55:10.905966 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:10.905892    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-util\") pod \"bfe76e72-29bb-4891-8e25-185e928bdc69\" (UID: \"bfe76e72-29bb-4891-8e25-185e928bdc69\") "
Jul 07 18:55:10.906627 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:10.906578    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-bundle" (OuterVolumeSpecName: "bundle") pod "bfe76e72-29bb-4891-8e25-185e928bdc69" (UID: "bfe76e72-29bb-4891-8e25-185e928bdc69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:55:10.908011 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:10.907980    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe76e72-29bb-4891-8e25-185e928bdc69-kube-api-access-blpg8" (OuterVolumeSpecName: "kube-api-access-blpg8") pod "bfe76e72-29bb-4891-8e25-185e928bdc69" (UID: "bfe76e72-29bb-4891-8e25-185e928bdc69"). InnerVolumeSpecName "kube-api-access-blpg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:55:10.912024 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:10.911967    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-util" (OuterVolumeSpecName: "util") pod "bfe76e72-29bb-4891-8e25-185e928bdc69" (UID: "bfe76e72-29bb-4891-8e25-185e928bdc69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:55:11.006592 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:11.006526    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:55:11.006592 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:11.006550    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe76e72-29bb-4891-8e25-185e928bdc69-util\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:55:11.006592 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:11.006559    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blpg8\" (UniqueName: \"kubernetes.io/projected/bfe76e72-29bb-4891-8e25-185e928bdc69-kube-api-access-blpg8\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:55:11.697606 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:11.697578    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh"
Jul 07 18:55:11.697606 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:11.697600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvp5jh" event={"ID":"bfe76e72-29bb-4891-8e25-185e928bdc69","Type":"ContainerDied","Data":"0e7bf3a3073d92ffcee46e8b6286d143e0820972b8645337509c1866416d1d6f"}
Jul 07 18:55:11.697809 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:11.697644    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e7bf3a3073d92ffcee46e8b6286d143e0820972b8645337509c1866416d1d6f"
Jul 07 18:55:23.712317 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712280    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"]
Jul 07 18:55:23.712767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712565    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerName="pull"
Jul 07 18:55:23.712767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712574    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerName="pull"
Jul 07 18:55:23.712767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712586    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerName="util"
Jul 07 18:55:23.712767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712592    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerName="util"
Jul 07 18:55:23.712767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712603    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerName="extract"
Jul 07 18:55:23.712767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712609    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerName="extract"
Jul 07 18:55:23.712767 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.712670    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe76e72-29bb-4891-8e25-185e928bdc69" containerName="extract"
Jul 07 18:55:23.716009 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.715989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.733475 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.733452    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 18:55:23.733603 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.733565    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 18:55:23.733749 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.733725    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 18:55:23.733853 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.733727    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6rxgb\""
Jul 07 18:55:23.734548 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.734534    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 18:55:23.738657 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.738639    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"]
Jul 07 18:55:23.807331 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.807294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/716cd3df-87f7-468c-ba71-eab814b9ae66-manifests\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.807493 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.807339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/716cd3df-87f7-468c-ba71-eab814b9ae66-tmp\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.807493 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.807427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhl4t\" (UniqueName: \"kubernetes.io/projected/716cd3df-87f7-468c-ba71-eab814b9ae66-kube-api-access-xhl4t\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.807575 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.807488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/716cd3df-87f7-468c-ba71-eab814b9ae66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.807575 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.807514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/716cd3df-87f7-468c-ba71-eab814b9ae66-webhook-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.908393 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.908355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/716cd3df-87f7-468c-ba71-eab814b9ae66-manifests\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.908393 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.908395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/716cd3df-87f7-468c-ba71-eab814b9ae66-tmp\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.908602 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.908455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhl4t\" (UniqueName: \"kubernetes.io/projected/716cd3df-87f7-468c-ba71-eab814b9ae66-kube-api-access-xhl4t\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.908602 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.908490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/716cd3df-87f7-468c-ba71-eab814b9ae66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.908602 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.908517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/716cd3df-87f7-468c-ba71-eab814b9ae66-webhook-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.908821 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.908797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/716cd3df-87f7-468c-ba71-eab814b9ae66-manifests\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.910861 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.910830    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/716cd3df-87f7-468c-ba71-eab814b9ae66-tmp\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.911056 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.911037    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/716cd3df-87f7-468c-ba71-eab814b9ae66-webhook-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.911188 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.911168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/716cd3df-87f7-468c-ba71-eab814b9ae66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:23.938729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:23.938703    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhl4t\" (UniqueName: \"kubernetes.io/projected/716cd3df-87f7-468c-ba71-eab814b9ae66-kube-api-access-xhl4t\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-tfbzp\" (UID: \"716cd3df-87f7-468c-ba71-eab814b9ae66\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:24.025894 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:24.025819    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:24.200389 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:24.200351    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"]
Jul 07 18:55:24.203506 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:55:24.203469    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716cd3df_87f7_468c_ba71_eab814b9ae66.slice/crio-0da45f1855a81edf2dfe4094cef28ac1e96ef4a1082e1a74415bc8aef4ee9ba6 WatchSource:0}: Error finding container 0da45f1855a81edf2dfe4094cef28ac1e96ef4a1082e1a74415bc8aef4ee9ba6: Status 404 returned error can't find the container with id 0da45f1855a81edf2dfe4094cef28ac1e96ef4a1082e1a74415bc8aef4ee9ba6
Jul 07 18:55:24.760975 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:24.760935    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp" event={"ID":"716cd3df-87f7-468c-ba71-eab814b9ae66","Type":"ContainerStarted","Data":"0da45f1855a81edf2dfe4094cef28ac1e96ef4a1082e1a74415bc8aef4ee9ba6"}
Jul 07 18:55:27.779433 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:27.779396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp" event={"ID":"716cd3df-87f7-468c-ba71-eab814b9ae66","Type":"ContainerStarted","Data":"2a57ef743eaf6ef1ae99873c2b047052e1273aabab82957f0dbdb92567204f00"}
Jul 07 18:55:28.786493 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:28.786457    2562 generic.go:356] "Generic (PLEG): container finished" podID="716cd3df-87f7-468c-ba71-eab814b9ae66" containerID="2a57ef743eaf6ef1ae99873c2b047052e1273aabab82957f0dbdb92567204f00" exitCode=0
Jul 07 18:55:28.786899 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:28.786552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp" event={"ID":"716cd3df-87f7-468c-ba71-eab814b9ae66","Type":"ContainerDied","Data":"2a57ef743eaf6ef1ae99873c2b047052e1273aabab82957f0dbdb92567204f00"}
Jul 07 18:55:29.792892 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:29.792851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp" event={"ID":"716cd3df-87f7-468c-ba71-eab814b9ae66","Type":"ContainerStarted","Data":"860a5e11a4744ba8bca4e0ac9b2e1e61c315ba8dfd8a0d1bc70203a84a7741ab"}
Jul 07 18:55:29.793386 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:29.792969    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:29.823553 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:29.823400    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp" podStartSLOduration=2.601612111 podStartE2EDuration="6.823329037s" totalImagesPullingTime="3.219659378s" totalInitContainerRuntime="1.002057548s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:29.822296627 +0000 UTC m=+292.885773326" watchObservedRunningTime="2026-07-07 18:55:29.823329037 +0000 UTC m=+292.886805737"
Jul 07 18:55:37.374048 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:37.374013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 18:55:37.381397 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:37.381239    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 18:55:37.381967 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:37.381948    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 18:55:37.386885 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:37.386868    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 18:55:37.387628 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:37.387614    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 18:55:40.800609 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:40.800571    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-tfbzp"
Jul 07 18:55:45.773674 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.773636    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-97fxk"]
Jul 07 18:55:45.780753 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.780736    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:45.784787 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.784762    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 18:55:45.784910 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.784794    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jn6x9\""
Jul 07 18:55:45.807576 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.807550    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-97fxk"]
Jul 07 18:55:45.896782 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.896749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k75n\" (UniqueName: \"kubernetes.io/projected/ddc5adc1-a487-464b-9192-9650aa776319-kube-api-access-8k75n\") pod \"odh-model-controller-7998c67dc4-97fxk\" (UID: \"ddc5adc1-a487-464b-9192-9650aa776319\") " pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:45.897005 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.896836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc5adc1-a487-464b-9192-9650aa776319-cert\") pod \"odh-model-controller-7998c67dc4-97fxk\" (UID: \"ddc5adc1-a487-464b-9192-9650aa776319\") " pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:45.997216 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.997182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc5adc1-a487-464b-9192-9650aa776319-cert\") pod \"odh-model-controller-7998c67dc4-97fxk\" (UID: \"ddc5adc1-a487-464b-9192-9650aa776319\") " pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:45.997405 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:45.997244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k75n\" (UniqueName: \"kubernetes.io/projected/ddc5adc1-a487-464b-9192-9650aa776319-kube-api-access-8k75n\") pod \"odh-model-controller-7998c67dc4-97fxk\" (UID: \"ddc5adc1-a487-464b-9192-9650aa776319\") " pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:45.997405 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:55:45.997353    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 18:55:45.997515 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:55:45.997428    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc5adc1-a487-464b-9192-9650aa776319-cert podName:ddc5adc1-a487-464b-9192-9650aa776319 nodeName:}" failed. No retries permitted until 2026-07-07 18:55:46.49741241 +0000 UTC m=+309.560889089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddc5adc1-a487-464b-9192-9650aa776319-cert") pod "odh-model-controller-7998c67dc4-97fxk" (UID: "ddc5adc1-a487-464b-9192-9650aa776319") : secret "odh-model-controller-webhook-cert" not found
Jul 07 18:55:46.106575 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:46.106492    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k75n\" (UniqueName: \"kubernetes.io/projected/ddc5adc1-a487-464b-9192-9650aa776319-kube-api-access-8k75n\") pod \"odh-model-controller-7998c67dc4-97fxk\" (UID: \"ddc5adc1-a487-464b-9192-9650aa776319\") " pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:46.502991 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:46.502957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc5adc1-a487-464b-9192-9650aa776319-cert\") pod \"odh-model-controller-7998c67dc4-97fxk\" (UID: \"ddc5adc1-a487-464b-9192-9650aa776319\") " pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:46.505923 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:46.505890    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc5adc1-a487-464b-9192-9650aa776319-cert\") pod \"odh-model-controller-7998c67dc4-97fxk\" (UID: \"ddc5adc1-a487-464b-9192-9650aa776319\") " pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:46.690737 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:46.690704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:46.875927 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:46.875895    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-97fxk"]
Jul 07 18:55:46.879757 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:55:46.879727    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc5adc1_a487_464b_9192_9650aa776319.slice/crio-2044c963478ee5059ef42b84d56959898cf40101c36bd8329f7c3e1784e7dc63 WatchSource:0}: Error finding container 2044c963478ee5059ef42b84d56959898cf40101c36bd8329f7c3e1784e7dc63: Status 404 returned error can't find the container with id 2044c963478ee5059ef42b84d56959898cf40101c36bd8329f7c3e1784e7dc63
Jul 07 18:55:46.881135 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:46.881119    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:55:47.601889 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.601278    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pvxfq"]
Jul 07 18:55:47.604906 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.604882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:47.608210 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.608186    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 18:55:47.625140 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.625070    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pvxfq"]
Jul 07 18:55:47.712531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.712364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac06b0f-c681-445c-a1ee-2535c7fed694-tls-certs\") pod \"model-serving-api-54d89bd5fc-pvxfq\" (UID: \"6ac06b0f-c681-445c-a1ee-2535c7fed694\") " pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:47.712531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.712410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgscn\" (UniqueName: \"kubernetes.io/projected/6ac06b0f-c681-445c-a1ee-2535c7fed694-kube-api-access-rgscn\") pod \"model-serving-api-54d89bd5fc-pvxfq\" (UID: \"6ac06b0f-c681-445c-a1ee-2535c7fed694\") " pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:47.813675 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.813644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac06b0f-c681-445c-a1ee-2535c7fed694-tls-certs\") pod \"model-serving-api-54d89bd5fc-pvxfq\" (UID: \"6ac06b0f-c681-445c-a1ee-2535c7fed694\") " pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:47.813675 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.813679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgscn\" (UniqueName: \"kubernetes.io/projected/6ac06b0f-c681-445c-a1ee-2535c7fed694-kube-api-access-rgscn\") pod \"model-serving-api-54d89bd5fc-pvxfq\" (UID: \"6ac06b0f-c681-445c-a1ee-2535c7fed694\") " pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:47.816497 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.816469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac06b0f-c681-445c-a1ee-2535c7fed694-tls-certs\") pod \"model-serving-api-54d89bd5fc-pvxfq\" (UID: \"6ac06b0f-c681-445c-a1ee-2535c7fed694\") " pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:47.838003 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.837971    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgscn\" (UniqueName: \"kubernetes.io/projected/6ac06b0f-c681-445c-a1ee-2535c7fed694-kube-api-access-rgscn\") pod \"model-serving-api-54d89bd5fc-pvxfq\" (UID: \"6ac06b0f-c681-445c-a1ee-2535c7fed694\") " pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:47.881865 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.881771    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-97fxk" event={"ID":"ddc5adc1-a487-464b-9192-9650aa776319","Type":"ContainerStarted","Data":"2044c963478ee5059ef42b84d56959898cf40101c36bd8329f7c3e1784e7dc63"}
Jul 07 18:55:47.920255 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:47.920219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:48.103516 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:48.103490    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pvxfq"]
Jul 07 18:55:48.107421 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:55:48.106795    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac06b0f_c681_445c_a1ee_2535c7fed694.slice/crio-3467c40ae4da07e007b5ae4eb592d5ec467e11a9c84aa2de0542f1ac7447bb9e WatchSource:0}: Error finding container 3467c40ae4da07e007b5ae4eb592d5ec467e11a9c84aa2de0542f1ac7447bb9e: Status 404 returned error can't find the container with id 3467c40ae4da07e007b5ae4eb592d5ec467e11a9c84aa2de0542f1ac7447bb9e
Jul 07 18:55:48.889456 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:48.889385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq" event={"ID":"6ac06b0f-c681-445c-a1ee-2535c7fed694","Type":"ContainerStarted","Data":"3467c40ae4da07e007b5ae4eb592d5ec467e11a9c84aa2de0542f1ac7447bb9e"}
Jul 07 18:55:50.900634 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:50.900596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-97fxk" event={"ID":"ddc5adc1-a487-464b-9192-9650aa776319","Type":"ContainerStarted","Data":"81f85465e695d67d6259221b8fc64b311c6b4865b9b25a50b63b94612f24fdb9"}
Jul 07 18:55:50.901117 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:50.900659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:55:50.902283 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:50.902239    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq" event={"ID":"6ac06b0f-c681-445c-a1ee-2535c7fed694","Type":"ContainerStarted","Data":"51e067e5c592769febdfb34733127475d8fb6adf7bcb8a5a720feb2af3e4a9f1"}
Jul 07 18:55:50.902406 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:50.902323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:55:50.932574 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:50.932508    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-97fxk" podStartSLOduration=2.4194809 podStartE2EDuration="5.932480056s" totalImagesPullingTime="3.512999156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:50.930922173 +0000 UTC m=+313.994398870" watchObservedRunningTime="2026-07-07 18:55:50.932480056 +0000 UTC m=+313.995956755"
Jul 07 18:55:51.022830 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.022773    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq" podStartSLOduration=1.7397446090000002 podStartE2EDuration="4.022751596s" totalImagesPullingTime="2.283006987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:51.02181911 +0000 UTC m=+314.085295809" watchObservedRunningTime="2026-07-07 18:55:51.022751596 +0000 UTC m=+314.086228297"
Jul 07 18:55:51.253430 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.253385    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"]
Jul 07 18:55:51.259970 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.259941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.262558 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.262531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dx98f\""
Jul 07 18:55:51.262707 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.262532    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 18:55:51.264875 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.264858    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 18:55:51.268689 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.268663    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"]
Jul 07 18:55:51.352570 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.352527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgjhw\" (UniqueName: \"kubernetes.io/projected/38d105c7-2833-48f4-a043-756e77296986-kube-api-access-xgjhw\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.352784 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.352681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d105c7-2833-48f4-a043-756e77296986-tmp\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.352784 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.352735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d105c7-2833-48f4-a043-756e77296986-tls-certs\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.454024 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.453991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d105c7-2833-48f4-a043-756e77296986-tmp\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.454215 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.454041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d105c7-2833-48f4-a043-756e77296986-tls-certs\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.454215 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.454092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgjhw\" (UniqueName: \"kubernetes.io/projected/38d105c7-2833-48f4-a043-756e77296986-kube-api-access-xgjhw\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.457364 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.457339    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d105c7-2833-48f4-a043-756e77296986-tmp\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.458152 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.458124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d105c7-2833-48f4-a043-756e77296986-tls-certs\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.464969 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.464939    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgjhw\" (UniqueName: \"kubernetes.io/projected/38d105c7-2833-48f4-a043-756e77296986-kube-api-access-xgjhw\") pod \"kube-auth-proxy-566bc96858-gvm2l\" (UID: \"38d105c7-2833-48f4-a043-756e77296986\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.572045 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.571961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"
Jul 07 18:55:51.721107 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.720937    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bc96858-gvm2l"]
Jul 07 18:55:51.723742 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:55:51.723712    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d105c7_2833_48f4_a043_756e77296986.slice/crio-46f297c6fb176d80dd2d7eadd2cf17ff930cc474b8acd634fd70dd65e33683a7 WatchSource:0}: Error finding container 46f297c6fb176d80dd2d7eadd2cf17ff930cc474b8acd634fd70dd65e33683a7: Status 404 returned error can't find the container with id 46f297c6fb176d80dd2d7eadd2cf17ff930cc474b8acd634fd70dd65e33683a7
Jul 07 18:55:51.908668 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:51.908558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l" event={"ID":"38d105c7-2833-48f4-a043-756e77296986","Type":"ContainerStarted","Data":"46f297c6fb176d80dd2d7eadd2cf17ff930cc474b8acd634fd70dd65e33683a7"}
Jul 07 18:55:52.027254 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.027213    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"]
Jul 07 18:55:52.032548 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.032516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.038989 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.038924    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 18:55:52.039136 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.039066    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 18:55:52.039296 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.039217    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:55:52.040551 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.040180    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 18:55:52.043002 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.042933    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 18:55:52.048736 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.048716    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wppld\""
Jul 07 18:55:52.058232 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.058208    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"]
Jul 07 18:55:52.159702 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.159623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-cert\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.159702 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.159668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-metrics-cert\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.159702 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.159696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-manager-config\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.159935 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.159711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9275\" (UniqueName: \"kubernetes.io/projected/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-kube-api-access-b9275\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.261051 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.260952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-manager-config\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.261230 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.261079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9275\" (UniqueName: \"kubernetes.io/projected/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-kube-api-access-b9275\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.261230 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.261157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-cert\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.261230 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.261200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-metrics-cert\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.261691 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.261669    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-manager-config\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.263720 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.263703    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-cert\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.263782 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.263765    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-metrics-cert\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.322641 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.322612    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9275\" (UniqueName: \"kubernetes.io/projected/0f70f204-b58f-4ca3-aeaa-17b665a36e0e-kube-api-access-b9275\") pod \"lws-controller-manager-564669cfc7-9vvs7\" (UID: \"0f70f204-b58f-4ca3-aeaa-17b665a36e0e\") " pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.345274 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.345229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:52.600999 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.600972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"]
Jul 07 18:55:52.602996 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:55:52.602962    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f70f204_b58f_4ca3_aeaa_17b665a36e0e.slice/crio-4f85db14317c1bf235eb59f1246e19820cbe32a4193cdcd8207cee0d9de29998 WatchSource:0}: Error finding container 4f85db14317c1bf235eb59f1246e19820cbe32a4193cdcd8207cee0d9de29998: Status 404 returned error can't find the container with id 4f85db14317c1bf235eb59f1246e19820cbe32a4193cdcd8207cee0d9de29998
Jul 07 18:55:52.917750 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:52.917656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7" event={"ID":"0f70f204-b58f-4ca3-aeaa-17b665a36e0e","Type":"ContainerStarted","Data":"4f85db14317c1bf235eb59f1246e19820cbe32a4193cdcd8207cee0d9de29998"}
Jul 07 18:55:54.931778 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:54.931737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l" event={"ID":"38d105c7-2833-48f4-a043-756e77296986","Type":"ContainerStarted","Data":"9794613ca024816daa5fd9a794a800aea40d8ac0730c7b893ebbf49bc63ab31a"}
Jul 07 18:55:54.933586 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:54.933558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7" event={"ID":"0f70f204-b58f-4ca3-aeaa-17b665a36e0e","Type":"ContainerStarted","Data":"9eec67bc1a42b326f75c70add8e79eb1224ba2cb1f28874826c6fe2d981e3696"}
Jul 07 18:55:54.933716 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:54.933609    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:55:54.956644 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:54.956601    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-566bc96858-gvm2l" podStartSLOduration=0.952128392 podStartE2EDuration="3.956582294s" totalImagesPullingTime="3.004453902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:54.956384711 +0000 UTC m=+318.019861412" watchObservedRunningTime="2026-07-07 18:55:54.956582294 +0000 UTC m=+318.020058994"
Jul 07 18:55:55.006246 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:55:55.006151    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7" podStartSLOduration=1.88892656 podStartE2EDuration="4.006135393s" totalImagesPullingTime="2.117208833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:55.00490605 +0000 UTC m=+318.068382756" watchObservedRunningTime="2026-07-07 18:55:55.006135393 +0000 UTC m=+318.069612092"
Jul 07 18:56:01.911506 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:56:01.911468    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-97fxk"
Jul 07 18:56:01.913650 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:56:01.913632    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pvxfq"
Jul 07 18:56:05.940729 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:56:05.940696    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-564669cfc7-9vvs7"
Jul 07 18:57:01.512680 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.512649    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"]
Jul 07 18:57:01.514890 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.514872    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.517024 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.517003    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:57:01.517024 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.517012    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j6cxj\""
Jul 07 18:57:01.517201 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.517005    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:57:01.525510 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.525452    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"]
Jul 07 18:57:01.532531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.532507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.532658 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.532574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.532870 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.532833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c2w6\" (UniqueName: \"kubernetes.io/projected/9e9cc02f-d35f-4020-9a23-75c9318f871b-kube-api-access-9c2w6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.633340 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.633300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.633544 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.633367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c2w6\" (UniqueName: \"kubernetes.io/projected/9e9cc02f-d35f-4020-9a23-75c9318f871b-kube-api-access-9c2w6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.633544 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.633432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.633665 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.633650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.633781 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.633762    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.641831 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.641801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c2w6\" (UniqueName: \"kubernetes.io/projected/9e9cc02f-d35f-4020-9a23-75c9318f871b-kube-api-access-9c2w6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.825062 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.824978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:01.956743 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:01.956722    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"]
Jul 07 18:57:01.959395 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:57:01.959364    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9cc02f_d35f_4020_9a23_75c9318f871b.slice/crio-1ff05255e5df47d15ade5d205f8212558f117ca46c882e4a8e9d2de8020d4841 WatchSource:0}: Error finding container 1ff05255e5df47d15ade5d205f8212558f117ca46c882e4a8e9d2de8020d4841: Status 404 returned error can't find the container with id 1ff05255e5df47d15ade5d205f8212558f117ca46c882e4a8e9d2de8020d4841
Jul 07 18:57:02.246745 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.246713    2562 generic.go:356] "Generic (PLEG): container finished" podID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerID="e53685321ee3943acc8e204f0233ebb3fe8c355567335d148822410c0bc63682" exitCode=0
Jul 07 18:57:02.246933 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.246816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6" event={"ID":"9e9cc02f-d35f-4020-9a23-75c9318f871b","Type":"ContainerDied","Data":"e53685321ee3943acc8e204f0233ebb3fe8c355567335d148822410c0bc63682"}
Jul 07 18:57:02.246933 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.246869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6" event={"ID":"9e9cc02f-d35f-4020-9a23-75c9318f871b","Type":"ContainerStarted","Data":"1ff05255e5df47d15ade5d205f8212558f117ca46c882e4a8e9d2de8020d4841"}
Jul 07 18:57:02.313647 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.313619    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"]
Jul 07 18:57:02.315943 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.315928    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.327827 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.327806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"]
Jul 07 18:57:02.338207 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.338187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.338335 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.338218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582lv\" (UniqueName: \"kubernetes.io/projected/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-kube-api-access-582lv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.338384 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.338349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.439034 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.438998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.439187 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.439055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.439187 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.439074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582lv\" (UniqueName: \"kubernetes.io/projected/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-kube-api-access-582lv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.439360 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.439342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.439446 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.439429    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.469498 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.469472    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-582lv\" (UniqueName: \"kubernetes.io/projected/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-kube-api-access-582lv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.625610 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.625532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:02.703395 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.703209    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"]
Jul 07 18:57:02.706958 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.706936    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.713553 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.713528    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"]
Jul 07 18:57:02.742078 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.742047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.742228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.742094    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.742228 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.742159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppgdg\" (UniqueName: \"kubernetes.io/projected/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-kube-api-access-ppgdg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.781172 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.781149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"]
Jul 07 18:57:02.784569 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:57:02.784542    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd803e664_8821_4ee1_a2b8_c81e6c6ca21d.slice/crio-187b8e60f6f45973e2291af8a3c1564bcd932430fe27cbcdf84b4051ff93293d WatchSource:0}: Error finding container 187b8e60f6f45973e2291af8a3c1564bcd932430fe27cbcdf84b4051ff93293d: Status 404 returned error can't find the container with id 187b8e60f6f45973e2291af8a3c1564bcd932430fe27cbcdf84b4051ff93293d
Jul 07 18:57:02.843497 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.843467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.843611 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.843524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.843611 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.843604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppgdg\" (UniqueName: \"kubernetes.io/projected/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-kube-api-access-ppgdg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.843946 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.843924    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.844020 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.843952    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:02.851779 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:02.851754    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppgdg\" (UniqueName: \"kubernetes.io/projected/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-kube-api-access-ppgdg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:03.018460 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.018429    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:03.108776 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.108740    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"]
Jul 07 18:57:03.114324 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.114300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.120124 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.119837    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"]
Jul 07 18:57:03.146297 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.146251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.146467 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.146316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4x2j\" (UniqueName: \"kubernetes.io/projected/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-kube-api-access-r4x2j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.146467 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.146403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.165106 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.165082    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"]
Jul 07 18:57:03.166815 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:57:03.166790    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aaf425a_f82b_4e6a_9ce2_56f3f53b4327.slice/crio-a71e75e3e69d2ca8a4b52d0de3bd56434cfa8c6d7c8ad6386c286944f8bd75b4 WatchSource:0}: Error finding container a71e75e3e69d2ca8a4b52d0de3bd56434cfa8c6d7c8ad6386c286944f8bd75b4: Status 404 returned error can't find the container with id a71e75e3e69d2ca8a4b52d0de3bd56434cfa8c6d7c8ad6386c286944f8bd75b4
Jul 07 18:57:03.247350 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.247320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.247476 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.247367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.247476 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.247393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4x2j\" (UniqueName: \"kubernetes.io/projected/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-kube-api-access-r4x2j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.247711 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.247689    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.247773 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.247732    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.253148 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.253121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f" event={"ID":"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327","Type":"ContainerStarted","Data":"5cbb9187e6c45dae12470679247d7c5db0c8d5f1b77d5303bc0ae318a93a11b0"}
Jul 07 18:57:03.253279 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.253173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f" event={"ID":"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327","Type":"ContainerStarted","Data":"a71e75e3e69d2ca8a4b52d0de3bd56434cfa8c6d7c8ad6386c286944f8bd75b4"}
Jul 07 18:57:03.255123 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.255097    2562 generic.go:356] "Generic (PLEG): container finished" podID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerID="82260919ab88496efd65a747892765cc9b5acdfd978ecfa5968a2c6d5b59b85e" exitCode=0
Jul 07 18:57:03.255225 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.255178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x" event={"ID":"d803e664-8821-4ee1-a2b8-c81e6c6ca21d","Type":"ContainerDied","Data":"82260919ab88496efd65a747892765cc9b5acdfd978ecfa5968a2c6d5b59b85e"}
Jul 07 18:57:03.255375 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.255234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x" event={"ID":"d803e664-8821-4ee1-a2b8-c81e6c6ca21d","Type":"ContainerStarted","Data":"187b8e60f6f45973e2291af8a3c1564bcd932430fe27cbcdf84b4051ff93293d"}
Jul 07 18:57:03.256326 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.256301    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4x2j\" (UniqueName: \"kubernetes.io/projected/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-kube-api-access-r4x2j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.257528 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.257502    2562 generic.go:356] "Generic (PLEG): container finished" podID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerID="1b730f8b05fb5aaba6f167effd0faa02d651e6fdfb5109ef6af98352c99531bb" exitCode=0
Jul 07 18:57:03.257627 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.257540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6" event={"ID":"9e9cc02f-d35f-4020-9a23-75c9318f871b","Type":"ContainerDied","Data":"1b730f8b05fb5aaba6f167effd0faa02d651e6fdfb5109ef6af98352c99531bb"}
Jul 07 18:57:03.425609 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.425535    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:03.568399 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:03.568368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"]
Jul 07 18:57:03.570877 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:57:03.570853    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989d42f2_89bd_4356_8ba6_e6bc7e9ace47.slice/crio-db6d1c638ea0c452f03f1255163455b1b0860a3deb684f684c88e4957fd9c40a WatchSource:0}: Error finding container db6d1c638ea0c452f03f1255163455b1b0860a3deb684f684c88e4957fd9c40a: Status 404 returned error can't find the container with id db6d1c638ea0c452f03f1255163455b1b0860a3deb684f684c88e4957fd9c40a
Jul 07 18:57:04.264897 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.264861    2562 generic.go:356] "Generic (PLEG): container finished" podID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerID="829bc02ea9c944dc7a9946ca3e303f7fe6af6a749edeed74346f136dbee878bc" exitCode=0
Jul 07 18:57:04.265381 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.264944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x" event={"ID":"d803e664-8821-4ee1-a2b8-c81e6c6ca21d","Type":"ContainerDied","Data":"829bc02ea9c944dc7a9946ca3e303f7fe6af6a749edeed74346f136dbee878bc"}
Jul 07 18:57:04.267221 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.267200    2562 generic.go:356] "Generic (PLEG): container finished" podID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerID="f61a7f4df5b8ea1a9512da0466eec14b2fd6aea58deb959045f5f7f5ae316a9d" exitCode=0
Jul 07 18:57:04.267332 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.267290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6" event={"ID":"9e9cc02f-d35f-4020-9a23-75c9318f871b","Type":"ContainerDied","Data":"f61a7f4df5b8ea1a9512da0466eec14b2fd6aea58deb959045f5f7f5ae316a9d"}
Jul 07 18:57:04.268840 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.268821    2562 generic.go:356] "Generic (PLEG): container finished" podID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerID="5cbb9187e6c45dae12470679247d7c5db0c8d5f1b77d5303bc0ae318a93a11b0" exitCode=0
Jul 07 18:57:04.268935 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.268851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f" event={"ID":"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327","Type":"ContainerDied","Data":"5cbb9187e6c45dae12470679247d7c5db0c8d5f1b77d5303bc0ae318a93a11b0"}
Jul 07 18:57:04.270484 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.270463    2562 generic.go:356] "Generic (PLEG): container finished" podID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerID="f95f852aedc1208948d9fb0626171f65e2c84f0cfb0f0cd2dca6bbb4677506f2" exitCode=0
Jul 07 18:57:04.270585 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.270518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh" event={"ID":"989d42f2-89bd-4356-8ba6-e6bc7e9ace47","Type":"ContainerDied","Data":"f95f852aedc1208948d9fb0626171f65e2c84f0cfb0f0cd2dca6bbb4677506f2"}
Jul 07 18:57:04.270585 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:04.270551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh" event={"ID":"989d42f2-89bd-4356-8ba6-e6bc7e9ace47","Type":"ContainerStarted","Data":"db6d1c638ea0c452f03f1255163455b1b0860a3deb684f684c88e4957fd9c40a"}
Jul 07 18:57:05.277799 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.277765    2562 generic.go:356] "Generic (PLEG): container finished" podID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerID="493f969d5a74f30b92c89588d6b953eb95777c5371ff192045cb752d90bc30ce" exitCode=0
Jul 07 18:57:05.278198 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.277845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x" event={"ID":"d803e664-8821-4ee1-a2b8-c81e6c6ca21d","Type":"ContainerDied","Data":"493f969d5a74f30b92c89588d6b953eb95777c5371ff192045cb752d90bc30ce"}
Jul 07 18:57:05.279559 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.279534    2562 generic.go:356] "Generic (PLEG): container finished" podID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerID="87777f499468b759a6e66b59a2e46abe77073d37215fdd3211615a321f596dc9" exitCode=0
Jul 07 18:57:05.279671 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.279611    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f" event={"ID":"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327","Type":"ContainerDied","Data":"87777f499468b759a6e66b59a2e46abe77073d37215fdd3211615a321f596dc9"}
Jul 07 18:57:05.412417 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.412386    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:05.466124 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.466099    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-util\") pod \"9e9cc02f-d35f-4020-9a23-75c9318f871b\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") "
Jul 07 18:57:05.466239 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.466193    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c2w6\" (UniqueName: \"kubernetes.io/projected/9e9cc02f-d35f-4020-9a23-75c9318f871b-kube-api-access-9c2w6\") pod \"9e9cc02f-d35f-4020-9a23-75c9318f871b\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") "
Jul 07 18:57:05.466239 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.466235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-bundle\") pod \"9e9cc02f-d35f-4020-9a23-75c9318f871b\" (UID: \"9e9cc02f-d35f-4020-9a23-75c9318f871b\") "
Jul 07 18:57:05.466824 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.466788    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-bundle" (OuterVolumeSpecName: "bundle") pod "9e9cc02f-d35f-4020-9a23-75c9318f871b" (UID: "9e9cc02f-d35f-4020-9a23-75c9318f871b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:05.468410 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.468388    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9cc02f-d35f-4020-9a23-75c9318f871b-kube-api-access-9c2w6" (OuterVolumeSpecName: "kube-api-access-9c2w6") pod "9e9cc02f-d35f-4020-9a23-75c9318f871b" (UID: "9e9cc02f-d35f-4020-9a23-75c9318f871b"). InnerVolumeSpecName "kube-api-access-9c2w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:57:05.471899 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.471865    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-util" (OuterVolumeSpecName: "util") pod "9e9cc02f-d35f-4020-9a23-75c9318f871b" (UID: "9e9cc02f-d35f-4020-9a23-75c9318f871b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:05.567845 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.567759    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c2w6\" (UniqueName: \"kubernetes.io/projected/9e9cc02f-d35f-4020-9a23-75c9318f871b-kube-api-access-9c2w6\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:05.567845 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.567790    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:05.567845 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:05.567801    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e9cc02f-d35f-4020-9a23-75c9318f871b-util\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:06.287356 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.287319    2562 generic.go:356] "Generic (PLEG): container finished" podID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerID="75d04770b041facfcc9f69adafe0016d77e27435747e6d8551a2fd74dd0c2147" exitCode=0
Jul 07 18:57:06.287784 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.287414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f" event={"ID":"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327","Type":"ContainerDied","Data":"75d04770b041facfcc9f69adafe0016d77e27435747e6d8551a2fd74dd0c2147"}
Jul 07 18:57:06.289131 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.289110    2562 generic.go:356] "Generic (PLEG): container finished" podID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerID="063d83df6fa1974f1e2b3690357341857fd6a757f998741ca2a1e5217d844eab" exitCode=0
Jul 07 18:57:06.289224 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.289201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh" event={"ID":"989d42f2-89bd-4356-8ba6-e6bc7e9ace47","Type":"ContainerDied","Data":"063d83df6fa1974f1e2b3690357341857fd6a757f998741ca2a1e5217d844eab"}
Jul 07 18:57:06.291476 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.291446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6" event={"ID":"9e9cc02f-d35f-4020-9a23-75c9318f871b","Type":"ContainerDied","Data":"1ff05255e5df47d15ade5d205f8212558f117ca46c882e4a8e9d2de8020d4841"}
Jul 07 18:57:06.291587 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.291483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6"
Jul 07 18:57:06.291587 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.291497    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ff05255e5df47d15ade5d205f8212558f117ca46c882e4a8e9d2de8020d4841"
Jul 07 18:57:06.500229 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.500207    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:06.574506 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.574420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-bundle\") pod \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") "
Jul 07 18:57:06.574506 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.574460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-util\") pod \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") "
Jul 07 18:57:06.574690 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.574510    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-582lv\" (UniqueName: \"kubernetes.io/projected/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-kube-api-access-582lv\") pod \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\" (UID: \"d803e664-8821-4ee1-a2b8-c81e6c6ca21d\") "
Jul 07 18:57:06.575004 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.574978    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-bundle" (OuterVolumeSpecName: "bundle") pod "d803e664-8821-4ee1-a2b8-c81e6c6ca21d" (UID: "d803e664-8821-4ee1-a2b8-c81e6c6ca21d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:06.576888 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.576861    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-kube-api-access-582lv" (OuterVolumeSpecName: "kube-api-access-582lv") pod "d803e664-8821-4ee1-a2b8-c81e6c6ca21d" (UID: "d803e664-8821-4ee1-a2b8-c81e6c6ca21d"). InnerVolumeSpecName "kube-api-access-582lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:57:06.579894 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.579875    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-util" (OuterVolumeSpecName: "util") pod "d803e664-8821-4ee1-a2b8-c81e6c6ca21d" (UID: "d803e664-8821-4ee1-a2b8-c81e6c6ca21d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:06.676018 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.675989    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:06.676018 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.676015    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-util\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:06.676018 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:06.676024    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-582lv\" (UniqueName: \"kubernetes.io/projected/d803e664-8821-4ee1-a2b8-c81e6c6ca21d-kube-api-access-582lv\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:07.298604 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.298571    2562 generic.go:356] "Generic (PLEG): container finished" podID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerID="e1481d70ff3d8c2b692c1578951251814dee76a2b8219d97ef5033b1c174a1e1" exitCode=0
Jul 07 18:57:07.299034 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.298659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh" event={"ID":"989d42f2-89bd-4356-8ba6-e6bc7e9ace47","Type":"ContainerDied","Data":"e1481d70ff3d8c2b692c1578951251814dee76a2b8219d97ef5033b1c174a1e1"}
Jul 07 18:57:07.300479 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.300450    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x"
Jul 07 18:57:07.300479 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.300462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x" event={"ID":"d803e664-8821-4ee1-a2b8-c81e6c6ca21d","Type":"ContainerDied","Data":"187b8e60f6f45973e2291af8a3c1564bcd932430fe27cbcdf84b4051ff93293d"}
Jul 07 18:57:07.300662 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.300499    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="187b8e60f6f45973e2291af8a3c1564bcd932430fe27cbcdf84b4051ff93293d"
Jul 07 18:57:07.436220 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.436197    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:07.482180 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.482156    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-util\") pod \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") "
Jul 07 18:57:07.482344 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.482221    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-bundle\") pod \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") "
Jul 07 18:57:07.482344 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.482314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppgdg\" (UniqueName: \"kubernetes.io/projected/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-kube-api-access-ppgdg\") pod \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\" (UID: \"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327\") "
Jul 07 18:57:07.482957 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.482923    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-bundle" (OuterVolumeSpecName: "bundle") pod "6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" (UID: "6aaf425a-f82b-4e6a-9ce2-56f3f53b4327"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:07.484549 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.484528    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-kube-api-access-ppgdg" (OuterVolumeSpecName: "kube-api-access-ppgdg") pod "6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" (UID: "6aaf425a-f82b-4e6a-9ce2-56f3f53b4327"). InnerVolumeSpecName "kube-api-access-ppgdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:57:07.487468 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.487448    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-util" (OuterVolumeSpecName: "util") pod "6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" (UID: "6aaf425a-f82b-4e6a-9ce2-56f3f53b4327"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:07.583555 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.583468    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:07.583555 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.583498    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppgdg\" (UniqueName: \"kubernetes.io/projected/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-kube-api-access-ppgdg\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:07.583555 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:07.583507    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aaf425a-f82b-4e6a-9ce2-56f3f53b4327-util\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:08.307278 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.307247    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f"
Jul 07 18:57:08.307643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.307298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f" event={"ID":"6aaf425a-f82b-4e6a-9ce2-56f3f53b4327","Type":"ContainerDied","Data":"a71e75e3e69d2ca8a4b52d0de3bd56434cfa8c6d7c8ad6386c286944f8bd75b4"}
Jul 07 18:57:08.307643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.307344    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a71e75e3e69d2ca8a4b52d0de3bd56434cfa8c6d7c8ad6386c286944f8bd75b4"
Jul 07 18:57:08.434194 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.434172    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:08.490853 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.490820    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4x2j\" (UniqueName: \"kubernetes.io/projected/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-kube-api-access-r4x2j\") pod \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") "
Jul 07 18:57:08.491014 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.490884    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-bundle\") pod \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") "
Jul 07 18:57:08.491014 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.490913    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-util\") pod \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\" (UID: \"989d42f2-89bd-4356-8ba6-e6bc7e9ace47\") "
Jul 07 18:57:08.491429 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.491391    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-bundle" (OuterVolumeSpecName: "bundle") pod "989d42f2-89bd-4356-8ba6-e6bc7e9ace47" (UID: "989d42f2-89bd-4356-8ba6-e6bc7e9ace47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:08.493104 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.493076    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-kube-api-access-r4x2j" (OuterVolumeSpecName: "kube-api-access-r4x2j") pod "989d42f2-89bd-4356-8ba6-e6bc7e9ace47" (UID: "989d42f2-89bd-4356-8ba6-e6bc7e9ace47"). InnerVolumeSpecName "kube-api-access-r4x2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:57:08.496650 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.496626    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-util" (OuterVolumeSpecName: "util") pod "989d42f2-89bd-4356-8ba6-e6bc7e9ace47" (UID: "989d42f2-89bd-4356-8ba6-e6bc7e9ace47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:08.592206 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.592115    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4x2j\" (UniqueName: \"kubernetes.io/projected/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-kube-api-access-r4x2j\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:08.592206 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.592148    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-bundle\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:08.592206 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:08.592159    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/989d42f2-89bd-4356-8ba6-e6bc7e9ace47-util\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:57:09.313867 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:09.313822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh" event={"ID":"989d42f2-89bd-4356-8ba6-e6bc7e9ace47","Type":"ContainerDied","Data":"db6d1c638ea0c452f03f1255163455b1b0860a3deb684f684c88e4957fd9c40a"}
Jul 07 18:57:09.313867 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:09.313868    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh"
Jul 07 18:57:09.314333 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:57:09.313897    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db6d1c638ea0c452f03f1255163455b1b0860a3deb684f684c88e4957fd9c40a"
Jul 07 18:58:20.987089 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987049    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987538    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerName="pull"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987557    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerName="pull"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987572    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerName="util"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987579    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerName="util"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987588    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerName="extract"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987598    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerName="extract"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987612    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerName="util"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987620    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerName="util"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987633    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerName="extract"
Jul 07 18:58:20.987643 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987641    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987654    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerName="pull"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987664    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerName="pull"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987677    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerName="util"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987685    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerName="util"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987695    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerName="pull"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987703    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerName="pull"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987721    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerName="util"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987729    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerName="util"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987737    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987744    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987754    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987762    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987779    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerName="pull"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987787    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerName="pull"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987885    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e9cc02f-d35f-4020-9a23-75c9318f871b" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987899    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="989d42f2-89bd-4356-8ba6-e6bc7e9ace47" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987909    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aaf425a-f82b-4e6a-9ce2-56f3f53b4327" containerName="extract"
Jul 07 18:58:20.988133 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.987917    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d803e664-8821-4ee1-a2b8-c81e6c6ca21d" containerName="extract"
Jul 07 18:58:20.991211 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.991190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:20.993622 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.993603    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:58:20.993724 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.993670    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j6cxj\""
Jul 07 18:58:20.993724 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.993672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 18:58:20.994170 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:20.994156    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:58:21.000045 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.000021    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 18:58:21.033462 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.033425    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 18:58:21.095768 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.095730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec7672cd-6c12-47f8-987e-179d55bc15c2-config-file\") pod \"limitador-limitador-54d6d988d5-9rxs8\" (UID: \"ec7672cd-6c12-47f8-987e-179d55bc15c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:21.095910 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.095773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvsnf\" (UniqueName: \"kubernetes.io/projected/ec7672cd-6c12-47f8-987e-179d55bc15c2-kube-api-access-mvsnf\") pod \"limitador-limitador-54d6d988d5-9rxs8\" (UID: \"ec7672cd-6c12-47f8-987e-179d55bc15c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:21.196445 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.196415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvsnf\" (UniqueName: \"kubernetes.io/projected/ec7672cd-6c12-47f8-987e-179d55bc15c2-kube-api-access-mvsnf\") pod \"limitador-limitador-54d6d988d5-9rxs8\" (UID: \"ec7672cd-6c12-47f8-987e-179d55bc15c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:21.196589 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.196493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec7672cd-6c12-47f8-987e-179d55bc15c2-config-file\") pod \"limitador-limitador-54d6d988d5-9rxs8\" (UID: \"ec7672cd-6c12-47f8-987e-179d55bc15c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:21.197038 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.197020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec7672cd-6c12-47f8-987e-179d55bc15c2-config-file\") pod \"limitador-limitador-54d6d988d5-9rxs8\" (UID: \"ec7672cd-6c12-47f8-987e-179d55bc15c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:21.206872 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.206844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvsnf\" (UniqueName: \"kubernetes.io/projected/ec7672cd-6c12-47f8-987e-179d55bc15c2-kube-api-access-mvsnf\") pod \"limitador-limitador-54d6d988d5-9rxs8\" (UID: \"ec7672cd-6c12-47f8-987e-179d55bc15c2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:21.291938 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.291848    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-cwjln"]
Jul 07 18:58:21.295282 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.295248    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cwjln"
Jul 07 18:58:21.299231 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.299210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8w792\""
Jul 07 18:58:21.303298 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.303222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:21.307609 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.306374    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cwjln"]
Jul 07 18:58:21.398865 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.398832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrws\" (UniqueName: \"kubernetes.io/projected/536e217b-2f66-4946-946b-5a9c5fbdfa87-kube-api-access-vsrws\") pod \"authorino-58cd955675-cwjln\" (UID: \"536e217b-2f66-4946-946b-5a9c5fbdfa87\") " pod="kuadrant-system/authorino-58cd955675-cwjln"
Jul 07 18:58:21.446280 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.446234    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 18:58:21.446778 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:58:21.446756    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7672cd_6c12_47f8_987e_179d55bc15c2.slice/crio-2a0db480193de5c9a26f073510bbd5c4fc0dc35354552bba588e34d1cabfbf39 WatchSource:0}: Error finding container 2a0db480193de5c9a26f073510bbd5c4fc0dc35354552bba588e34d1cabfbf39: Status 404 returned error can't find the container with id 2a0db480193de5c9a26f073510bbd5c4fc0dc35354552bba588e34d1cabfbf39
Jul 07 18:58:21.499873 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.499831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrws\" (UniqueName: \"kubernetes.io/projected/536e217b-2f66-4946-946b-5a9c5fbdfa87-kube-api-access-vsrws\") pod \"authorino-58cd955675-cwjln\" (UID: \"536e217b-2f66-4946-946b-5a9c5fbdfa87\") " pod="kuadrant-system/authorino-58cd955675-cwjln"
Jul 07 18:58:21.508201 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.508163    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrws\" (UniqueName: \"kubernetes.io/projected/536e217b-2f66-4946-946b-5a9c5fbdfa87-kube-api-access-vsrws\") pod \"authorino-58cd955675-cwjln\" (UID: \"536e217b-2f66-4946-946b-5a9c5fbdfa87\") " pod="kuadrant-system/authorino-58cd955675-cwjln"
Jul 07 18:58:21.605288 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.605182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cwjln"
Jul 07 18:58:21.683035 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.683006    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8" event={"ID":"ec7672cd-6c12-47f8-987e-179d55bc15c2","Type":"ContainerStarted","Data":"2a0db480193de5c9a26f073510bbd5c4fc0dc35354552bba588e34d1cabfbf39"}
Jul 07 18:58:21.745825 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:21.745792    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cwjln"]
Jul 07 18:58:21.749165 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:58:21.749134    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod536e217b_2f66_4946_946b_5a9c5fbdfa87.slice/crio-99ebc938343f297141e812c5e37825afa47ab842222fbaf54b25d82d930639d7 WatchSource:0}: Error finding container 99ebc938343f297141e812c5e37825afa47ab842222fbaf54b25d82d930639d7: Status 404 returned error can't find the container with id 99ebc938343f297141e812c5e37825afa47ab842222fbaf54b25d82d930639d7
Jul 07 18:58:22.698352 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:22.698283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cwjln" event={"ID":"536e217b-2f66-4946-946b-5a9c5fbdfa87","Type":"ContainerStarted","Data":"99ebc938343f297141e812c5e37825afa47ab842222fbaf54b25d82d930639d7"}
Jul 07 18:58:26.722211 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:26.722171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8" event={"ID":"ec7672cd-6c12-47f8-987e-179d55bc15c2","Type":"ContainerStarted","Data":"45eb420dd35f3ec42e4e6c861126081d0f031f2457ccfd0331d96d546bbf25d7"}
Jul 07 18:58:26.722706 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:26.722391    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:26.723647 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:26.723617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cwjln" event={"ID":"536e217b-2f66-4946-946b-5a9c5fbdfa87","Type":"ContainerStarted","Data":"308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795"}
Jul 07 18:58:26.747783 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:26.747739    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8" podStartSLOduration=2.094641191 podStartE2EDuration="6.747724987s" totalImagesPullingTime="4.653083796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:26.7457755 +0000 UTC m=+469.809252201" watchObservedRunningTime="2026-07-07 18:58:26.747724987 +0000 UTC m=+469.811201687"
Jul 07 18:58:26.768584 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:26.768537    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-cwjln" podStartSLOduration=1.416781935 podStartE2EDuration="5.768523839s" totalImagesPullingTime="4.351741904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:26.768209683 +0000 UTC m=+469.831686382" watchObservedRunningTime="2026-07-07 18:58:26.768523839 +0000 UTC m=+469.832000539"
Jul 07 18:58:27.535100 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:27.535065    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cwjln"]
Jul 07 18:58:28.734544 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:28.734484    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-cwjln" podUID="536e217b-2f66-4946-946b-5a9c5fbdfa87" containerName="authorino" containerID="cri-o://308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795" gracePeriod=30
Jul 07 18:58:28.988797 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:28.988696    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cwjln"
Jul 07 18:58:29.071745 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.071719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsrws\" (UniqueName: \"kubernetes.io/projected/536e217b-2f66-4946-946b-5a9c5fbdfa87-kube-api-access-vsrws\") pod \"536e217b-2f66-4946-946b-5a9c5fbdfa87\" (UID: \"536e217b-2f66-4946-946b-5a9c5fbdfa87\") "
Jul 07 18:58:29.073904 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.073877    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536e217b-2f66-4946-946b-5a9c5fbdfa87-kube-api-access-vsrws" (OuterVolumeSpecName: "kube-api-access-vsrws") pod "536e217b-2f66-4946-946b-5a9c5fbdfa87" (UID: "536e217b-2f66-4946-946b-5a9c5fbdfa87"). InnerVolumeSpecName "kube-api-access-vsrws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:29.172954 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.172918    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsrws\" (UniqueName: \"kubernetes.io/projected/536e217b-2f66-4946-946b-5a9c5fbdfa87-kube-api-access-vsrws\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:58:29.740537 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.740435    2562 generic.go:356] "Generic (PLEG): container finished" podID="536e217b-2f66-4946-946b-5a9c5fbdfa87" containerID="308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795" exitCode=0
Jul 07 18:58:29.740537 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.740467    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cwjln"
Jul 07 18:58:29.740537 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.740501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cwjln" event={"ID":"536e217b-2f66-4946-946b-5a9c5fbdfa87","Type":"ContainerDied","Data":"308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795"}
Jul 07 18:58:29.741081 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.740541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cwjln" event={"ID":"536e217b-2f66-4946-946b-5a9c5fbdfa87","Type":"ContainerDied","Data":"99ebc938343f297141e812c5e37825afa47ab842222fbaf54b25d82d930639d7"}
Jul 07 18:58:29.741081 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.740559    2562 scope.go:117] "RemoveContainer" containerID="308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795"
Jul 07 18:58:29.749390 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.749370    2562 scope.go:117] "RemoveContainer" containerID="308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795"
Jul 07 18:58:29.749673 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:58:29.749645    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795\": container with ID starting with 308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795 not found: ID does not exist" containerID="308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795"
Jul 07 18:58:29.749795 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.749680    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795"} err="failed to get container status \"308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795\": rpc error: code = NotFound desc = could not find container \"308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795\": container with ID starting with 308722f00c8180ddedd85342c0b236de1b7c14da9f2426b202029ca0b1b2e795 not found: ID does not exist"
Jul 07 18:58:29.757278 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.757245    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cwjln"]
Jul 07 18:58:29.759106 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:29.759083    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-cwjln"]
Jul 07 18:58:31.445527 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:31.445494    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536e217b-2f66-4946-946b-5a9c5fbdfa87" path="/var/lib/kubelet/pods/536e217b-2f66-4946-946b-5a9c5fbdfa87/volumes"
Jul 07 18:58:37.730196 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:37.730167    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"
Jul 07 18:58:54.158142 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.158108    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jhvn2"]
Jul 07 18:58:54.158716 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.158492    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e217b-2f66-4946-946b-5a9c5fbdfa87" containerName="authorino"
Jul 07 18:58:54.158716 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.158511    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e217b-2f66-4946-946b-5a9c5fbdfa87" containerName="authorino"
Jul 07 18:58:54.158716 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.158608    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e217b-2f66-4946-946b-5a9c5fbdfa87" containerName="authorino"
Jul 07 18:58:54.166642 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.166619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jhvn2"
Jul 07 18:58:54.168641 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.168621    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8w792\""
Jul 07 18:58:54.168814 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.168794    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jhvn2"]
Jul 07 18:58:54.184976 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.184945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/0870d030-ad2f-465d-8d7a-dc20e630a0bb-kube-api-access-grtq8\") pod \"authorino-5d4b67c446-jhvn2\" (UID: \"0870d030-ad2f-465d-8d7a-dc20e630a0bb\") " pod="kuadrant-system/authorino-5d4b67c446-jhvn2"
Jul 07 18:58:54.285482 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.285451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/0870d030-ad2f-465d-8d7a-dc20e630a0bb-kube-api-access-grtq8\") pod \"authorino-5d4b67c446-jhvn2\" (UID: \"0870d030-ad2f-465d-8d7a-dc20e630a0bb\") " pod="kuadrant-system/authorino-5d4b67c446-jhvn2"
Jul 07 18:58:54.293698 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.293669    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/0870d030-ad2f-465d-8d7a-dc20e630a0bb-kube-api-access-grtq8\") pod \"authorino-5d4b67c446-jhvn2\" (UID: \"0870d030-ad2f-465d-8d7a-dc20e630a0bb\") " pod="kuadrant-system/authorino-5d4b67c446-jhvn2"
Jul 07 18:58:54.396625 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.396591    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jhvn2"]
Jul 07 18:58:54.396812 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.396801    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jhvn2"
Jul 07 18:58:54.427514 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.427486    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ff4cf55c6-7g4w8"]
Jul 07 18:58:54.431078 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.431059    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8"
Jul 07 18:58:54.440929 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.440877    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ff4cf55c6-7g4w8"]
Jul 07 18:58:54.487390 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.487255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkndc\" (UniqueName: \"kubernetes.io/projected/c0138255-9be7-497d-9096-b66d1fd6b77f-kube-api-access-vkndc\") pod \"authorino-ff4cf55c6-7g4w8\" (UID: \"c0138255-9be7-497d-9096-b66d1fd6b77f\") " pod="kuadrant-system/authorino-ff4cf55c6-7g4w8"
Jul 07 18:58:54.535201 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.535178    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jhvn2"]
Jul 07 18:58:54.537356 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:58:54.537329    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0870d030_ad2f_465d_8d7a_dc20e630a0bb.slice/crio-933eab585bf00b52a580831b22f20ae482292596ac79d8e6fee580ed0b4997df WatchSource:0}: Error finding container 933eab585bf00b52a580831b22f20ae482292596ac79d8e6fee580ed0b4997df: Status 404 returned error can't find the container with id 933eab585bf00b52a580831b22f20ae482292596ac79d8e6fee580ed0b4997df
Jul 07 18:58:54.587887 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.587843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkndc\" (UniqueName: \"kubernetes.io/projected/c0138255-9be7-497d-9096-b66d1fd6b77f-kube-api-access-vkndc\") pod \"authorino-ff4cf55c6-7g4w8\" (UID: \"c0138255-9be7-497d-9096-b66d1fd6b77f\") " pod="kuadrant-system/authorino-ff4cf55c6-7g4w8"
Jul 07 18:58:54.596617 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.596591    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkndc\" (UniqueName: \"kubernetes.io/projected/c0138255-9be7-497d-9096-b66d1fd6b77f-kube-api-access-vkndc\") pod \"authorino-ff4cf55c6-7g4w8\" (UID: \"c0138255-9be7-497d-9096-b66d1fd6b77f\") " pod="kuadrant-system/authorino-ff4cf55c6-7g4w8"
Jul 07 18:58:54.706757 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.706719    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ff4cf55c6-7g4w8"]
Jul 07 18:58:54.706985 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.706972    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8"
Jul 07 18:58:54.760402 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.760173    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dbdb5687b-44nwj"]
Jul 07 18:58:54.764225 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.764200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:54.766715 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.766690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 18:58:54.784279 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.784233    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbdb5687b-44nwj"]
Jul 07 18:58:54.788963 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.788936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zzb4\" (UniqueName: \"kubernetes.io/projected/2f67529c-21db-46ca-bc46-08628258e583-kube-api-access-7zzb4\") pod \"authorino-dbdb5687b-44nwj\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") " pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:54.789121 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.789101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f67529c-21db-46ca-bc46-08628258e583-tls-cert\") pod \"authorino-dbdb5687b-44nwj\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") " pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:54.857638 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.857616    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ff4cf55c6-7g4w8"]
Jul 07 18:58:54.859467 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:58:54.859437    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0138255_9be7_497d_9096_b66d1fd6b77f.slice/crio-f8e49c419b769fa1881b2c768a4854f73c581c64221843f6f1fd092483048b83 WatchSource:0}: Error finding container f8e49c419b769fa1881b2c768a4854f73c581c64221843f6f1fd092483048b83: Status 404 returned error can't find the container with id f8e49c419b769fa1881b2c768a4854f73c581c64221843f6f1fd092483048b83
Jul 07 18:58:54.865435 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.865406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jhvn2" event={"ID":"0870d030-ad2f-465d-8d7a-dc20e630a0bb","Type":"ContainerStarted","Data":"933eab585bf00b52a580831b22f20ae482292596ac79d8e6fee580ed0b4997df"}
Jul 07 18:58:54.889665 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.889642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f67529c-21db-46ca-bc46-08628258e583-tls-cert\") pod \"authorino-dbdb5687b-44nwj\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") " pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:54.889746 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.889676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zzb4\" (UniqueName: \"kubernetes.io/projected/2f67529c-21db-46ca-bc46-08628258e583-kube-api-access-7zzb4\") pod \"authorino-dbdb5687b-44nwj\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") " pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:54.892076 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.892056    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f67529c-21db-46ca-bc46-08628258e583-tls-cert\") pod \"authorino-dbdb5687b-44nwj\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") " pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:54.900316 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:54.900296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zzb4\" (UniqueName: \"kubernetes.io/projected/2f67529c-21db-46ca-bc46-08628258e583-kube-api-access-7zzb4\") pod \"authorino-dbdb5687b-44nwj\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") " pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:55.079000 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.078969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 18:58:55.219556 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.219527    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbdb5687b-44nwj"]
Jul 07 18:58:55.221583 ip-10-0-132-202 kubenswrapper[2562]: W0707 18:58:55.221557    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f67529c_21db_46ca_bc46_08628258e583.slice/crio-691b9a8cd606560d2c2ef448a0afc89f2859661aee7967161505c4880a12f779 WatchSource:0}: Error finding container 691b9a8cd606560d2c2ef448a0afc89f2859661aee7967161505c4880a12f779: Status 404 returned error can't find the container with id 691b9a8cd606560d2c2ef448a0afc89f2859661aee7967161505c4880a12f779
Jul 07 18:58:55.872617 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.872518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbdb5687b-44nwj" event={"ID":"2f67529c-21db-46ca-bc46-08628258e583","Type":"ContainerStarted","Data":"dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f"}
Jul 07 18:58:55.872617 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.872566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbdb5687b-44nwj" event={"ID":"2f67529c-21db-46ca-bc46-08628258e583","Type":"ContainerStarted","Data":"691b9a8cd606560d2c2ef448a0afc89f2859661aee7967161505c4880a12f779"}
Jul 07 18:58:55.874126 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.874098    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-jhvn2" podUID="0870d030-ad2f-465d-8d7a-dc20e630a0bb" containerName="authorino" containerID="cri-o://585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6" gracePeriod=30
Jul 07 18:58:55.874256 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.874112    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jhvn2" event={"ID":"0870d030-ad2f-465d-8d7a-dc20e630a0bb","Type":"ContainerStarted","Data":"585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6"}
Jul 07 18:58:55.875758 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.875720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8" event={"ID":"c0138255-9be7-497d-9096-b66d1fd6b77f","Type":"ContainerStarted","Data":"652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3"}
Jul 07 18:58:55.875950 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.875770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8" event={"ID":"c0138255-9be7-497d-9096-b66d1fd6b77f","Type":"ContainerStarted","Data":"f8e49c419b769fa1881b2c768a4854f73c581c64221843f6f1fd092483048b83"}
Jul 07 18:58:55.875950 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.875725    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8" podUID="c0138255-9be7-497d-9096-b66d1fd6b77f" containerName="authorino" containerID="cri-o://652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3" gracePeriod=30
Jul 07 18:58:55.889104 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.889062    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-dbdb5687b-44nwj" podStartSLOduration=1.5439647509999999 podStartE2EDuration="1.889047973s" totalImagesPullingTime="345.083222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:55.887986206 +0000 UTC m=+498.951462906" watchObservedRunningTime="2026-07-07 18:58:55.889047973 +0000 UTC m=+498.952524651"
Jul 07 18:58:55.907004 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.906932    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8" podStartSLOduration=1.527495224 podStartE2EDuration="1.906917007s" totalImagesPullingTime="379.421783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:55.905719829 +0000 UTC m=+498.969196529" watchObservedRunningTime="2026-07-07 18:58:55.906917007 +0000 UTC m=+498.970393703"
Jul 07 18:58:55.929531 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:55.929483    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-jhvn2" podStartSLOduration=1.4777757280000001 podStartE2EDuration="1.929467298s" totalImagesPullingTime="451.69157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:55.926932493 +0000 UTC m=+498.990409195" watchObservedRunningTime="2026-07-07 18:58:55.929467298 +0000 UTC m=+498.992944031"
Jul 07 18:58:56.131213 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.131195    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jhvn2"
Jul 07 18:58:56.138546 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.138519    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8"
Jul 07 18:58:56.207134 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.207101    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/0870d030-ad2f-465d-8d7a-dc20e630a0bb-kube-api-access-grtq8\") pod \"0870d030-ad2f-465d-8d7a-dc20e630a0bb\" (UID: \"0870d030-ad2f-465d-8d7a-dc20e630a0bb\") "
Jul 07 18:58:56.207342 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.207153    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkndc\" (UniqueName: \"kubernetes.io/projected/c0138255-9be7-497d-9096-b66d1fd6b77f-kube-api-access-vkndc\") pod \"c0138255-9be7-497d-9096-b66d1fd6b77f\" (UID: \"c0138255-9be7-497d-9096-b66d1fd6b77f\") "
Jul 07 18:58:56.209441 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.209402    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0870d030-ad2f-465d-8d7a-dc20e630a0bb-kube-api-access-grtq8" (OuterVolumeSpecName: "kube-api-access-grtq8") pod "0870d030-ad2f-465d-8d7a-dc20e630a0bb" (UID: "0870d030-ad2f-465d-8d7a-dc20e630a0bb"). InnerVolumeSpecName "kube-api-access-grtq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:56.209547 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.209481    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0138255-9be7-497d-9096-b66d1fd6b77f-kube-api-access-vkndc" (OuterVolumeSpecName: "kube-api-access-vkndc") pod "c0138255-9be7-497d-9096-b66d1fd6b77f" (UID: "c0138255-9be7-497d-9096-b66d1fd6b77f"). InnerVolumeSpecName "kube-api-access-vkndc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:56.308188 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.308160    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/0870d030-ad2f-465d-8d7a-dc20e630a0bb-kube-api-access-grtq8\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:58:56.308188 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.308187    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkndc\" (UniqueName: \"kubernetes.io/projected/c0138255-9be7-497d-9096-b66d1fd6b77f-kube-api-access-vkndc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 18:58:56.882184 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.882150    2562 generic.go:356] "Generic (PLEG): container finished" podID="c0138255-9be7-497d-9096-b66d1fd6b77f" containerID="652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3" exitCode=0
Jul 07 18:58:56.882395 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.882195    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8"
Jul 07 18:58:56.882395 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.882230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8" event={"ID":"c0138255-9be7-497d-9096-b66d1fd6b77f","Type":"ContainerDied","Data":"652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3"}
Jul 07 18:58:56.882395 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.882281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff4cf55c6-7g4w8" event={"ID":"c0138255-9be7-497d-9096-b66d1fd6b77f","Type":"ContainerDied","Data":"f8e49c419b769fa1881b2c768a4854f73c581c64221843f6f1fd092483048b83"}
Jul 07 18:58:56.882395 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.882300    2562 scope.go:117] "RemoveContainer" containerID="652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3"
Jul 07 18:58:56.883822 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.883800    2562 generic.go:356] "Generic (PLEG): container finished" podID="0870d030-ad2f-465d-8d7a-dc20e630a0bb" containerID="585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6" exitCode=0
Jul 07 18:58:56.883907 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.883846    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jhvn2"
Jul 07 18:58:56.883907 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.883858    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jhvn2" event={"ID":"0870d030-ad2f-465d-8d7a-dc20e630a0bb","Type":"ContainerDied","Data":"585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6"}
Jul 07 18:58:56.884056 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.884033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jhvn2" event={"ID":"0870d030-ad2f-465d-8d7a-dc20e630a0bb","Type":"ContainerDied","Data":"933eab585bf00b52a580831b22f20ae482292596ac79d8e6fee580ed0b4997df"}
Jul 07 18:58:56.891417 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.891399    2562 scope.go:117] "RemoveContainer" containerID="652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3"
Jul 07 18:58:56.891700 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:58:56.891679    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3\": container with ID starting with 652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3 not found: ID does not exist" containerID="652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3"
Jul 07 18:58:56.891766 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.891708    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3"} err="failed to get container status \"652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3\": rpc error: code = NotFound desc = could not find container \"652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3\": container with ID starting with 652604a4828192eab33691f811857d9bb300dd4014221cd484d7601b5005c7f3 not found: ID does not exist"
Jul 07 18:58:56.891766 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.891724    2562 scope.go:117] "RemoveContainer" containerID="585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6"
Jul 07 18:58:56.899435 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.899413    2562 scope.go:117] "RemoveContainer" containerID="585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6"
Jul 07 18:58:56.899663 ip-10-0-132-202 kubenswrapper[2562]: E0707 18:58:56.899648    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6\": container with ID starting with 585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6 not found: ID does not exist" containerID="585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6"
Jul 07 18:58:56.899713 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.899670    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6"} err="failed to get container status \"585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6\": rpc error: code = NotFound desc = could not find container \"585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6\": container with ID starting with 585fc5721f9459cceca1008cf9cede4b7a6e19299e2d3856b9dd58cc1900eff6 not found: ID does not exist"
Jul 07 18:58:56.906639 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.906615    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jhvn2"]
Jul 07 18:58:56.910660 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.910640    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jhvn2"]
Jul 07 18:58:56.922310 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.922292    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ff4cf55c6-7g4w8"]
Jul 07 18:58:56.926163 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:56.926128    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-ff4cf55c6-7g4w8"]
Jul 07 18:58:57.445446 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:57.445407    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0870d030-ad2f-465d-8d7a-dc20e630a0bb" path="/var/lib/kubelet/pods/0870d030-ad2f-465d-8d7a-dc20e630a0bb/volumes"
Jul 07 18:58:57.445815 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:58:57.445719    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0138255-9be7-497d-9096-b66d1fd6b77f" path="/var/lib/kubelet/pods/c0138255-9be7-497d-9096-b66d1fd6b77f/volumes"
Jul 07 18:59:37.324028 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:59:37.323946    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 18:59:55.641419 ip-10-0-132-202 kubenswrapper[2562]: I0707 18:59:55.641378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:00:12.507697 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:12.507660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:00:20.796310 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:20.796274    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:00:29.501807 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:29.501770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:00:37.410745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:37.410717    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:00:37.413911 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:37.413888    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:00:37.416174 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:37.416155    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:00:37.419359 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:37.419342    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:00:39.522424 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:39.522387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:00:47.527611 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.527575    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"]
Jul 07 19:00:47.529928 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.527908    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0138255-9be7-497d-9096-b66d1fd6b77f" containerName="authorino"
Jul 07 19:00:47.529928 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.527919    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0138255-9be7-497d-9096-b66d1fd6b77f" containerName="authorino"
Jul 07 19:00:47.529928 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.527929    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0870d030-ad2f-465d-8d7a-dc20e630a0bb" containerName="authorino"
Jul 07 19:00:47.529928 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.527934    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0870d030-ad2f-465d-8d7a-dc20e630a0bb" containerName="authorino"
Jul 07 19:00:47.529928 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.528006    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0870d030-ad2f-465d-8d7a-dc20e630a0bb" containerName="authorino"
Jul 07 19:00:47.529928 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.528013    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0138255-9be7-497d-9096-b66d1fd6b77f" containerName="authorino"
Jul 07 19:00:47.530831 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.530814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.533606 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.533581    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 19:00:47.533744 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.533713    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mnl4n\""
Jul 07 19:00:47.533817 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.533764    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 19:00:47.533817 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.533791    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 19:00:47.542778 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.542753    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"]
Jul 07 19:00:47.634395 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.634355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.634570 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.634412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.634570 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.634492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/939b9330-515e-4cee-86bd-e9457b2ff011-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.634570 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.634557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.634702 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.634593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl46g\" (UniqueName: \"kubernetes.io/projected/939b9330-515e-4cee-86bd-e9457b2ff011-kube-api-access-zl46g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.634702 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.634616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736013 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.735980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736013 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/939b9330-515e-4cee-86bd-e9457b2ff011-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736245 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736245 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl46g\" (UniqueName: \"kubernetes.io/projected/939b9330-515e-4cee-86bd-e9457b2ff011-kube-api-access-zl46g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736245 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736245 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736538 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736374    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736538 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.736538 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.736536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.738495 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.738477    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/939b9330-515e-4cee-86bd-e9457b2ff011-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.738761 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.738744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/939b9330-515e-4cee-86bd-e9457b2ff011-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.744827 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.744804    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl46g\" (UniqueName: \"kubernetes.io/projected/939b9330-515e-4cee-86bd-e9457b2ff011-kube-api-access-zl46g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq\" (UID: \"939b9330-515e-4cee-86bd-e9457b2ff011\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.839966 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.839897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:47.979085 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.979006    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"]
Jul 07 19:00:47.981392 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:00:47.981364    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod939b9330_515e_4cee_86bd_e9457b2ff011.slice/crio-a74540c353d34959874fe5c0d4ae6fe495d7ef72fc412e91ed0d836478837be7 WatchSource:0}: Error finding container a74540c353d34959874fe5c0d4ae6fe495d7ef72fc412e91ed0d836478837be7: Status 404 returned error can't find the container with id a74540c353d34959874fe5c0d4ae6fe495d7ef72fc412e91ed0d836478837be7
Jul 07 19:00:47.982844 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:47.982822    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:00:48.456807 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:48.456774    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq" event={"ID":"939b9330-515e-4cee-86bd-e9457b2ff011","Type":"ContainerStarted","Data":"a74540c353d34959874fe5c0d4ae6fe495d7ef72fc412e91ed0d836478837be7"}
Jul 07 19:00:50.101565 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:50.101532    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:00:54.486830 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:54.486798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq" event={"ID":"939b9330-515e-4cee-86bd-e9457b2ff011","Type":"ContainerStarted","Data":"da8bd0dd4230fe47355dc14caa1ef44ad12e181295537d65491673bfdd97473b"}
Jul 07 19:00:54.504976 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:54.504911    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq" podStartSLOduration=1.9738373 podStartE2EDuration="7.504890292s" totalImagesPullingTime="5.531052992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:00:54.504355237 +0000 UTC m=+617.567831938" watchObservedRunningTime="2026-07-07 19:00:54.504890292 +0000 UTC m=+617.568366992"
Jul 07 19:00:57.840686 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:57.840655    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:57.841083 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:57.840704    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:57.853453 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:57.853429    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:00:58.517465 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:00:58.517382    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq"
Jul 07 19:01:34.098354 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.098317    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-989476477-z46p4"]
Jul 07 19:01:34.101675 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.101657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.112699 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.112681    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-989476477-z46p4"]
Jul 07 19:01:34.223722 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.223681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxr6m\" (UniqueName: \"kubernetes.io/projected/5f956065-4520-4d8b-9e6f-1f1489402001-kube-api-access-vxr6m\") pod \"authorino-989476477-z46p4\" (UID: \"5f956065-4520-4d8b-9e6f-1f1489402001\") " pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.223911 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.223741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f956065-4520-4d8b-9e6f-1f1489402001-tls-cert\") pod \"authorino-989476477-z46p4\" (UID: \"5f956065-4520-4d8b-9e6f-1f1489402001\") " pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.324819 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.324779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxr6m\" (UniqueName: \"kubernetes.io/projected/5f956065-4520-4d8b-9e6f-1f1489402001-kube-api-access-vxr6m\") pod \"authorino-989476477-z46p4\" (UID: \"5f956065-4520-4d8b-9e6f-1f1489402001\") " pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.325012 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.324854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f956065-4520-4d8b-9e6f-1f1489402001-tls-cert\") pod \"authorino-989476477-z46p4\" (UID: \"5f956065-4520-4d8b-9e6f-1f1489402001\") " pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.327642 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.327613    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f956065-4520-4d8b-9e6f-1f1489402001-tls-cert\") pod \"authorino-989476477-z46p4\" (UID: \"5f956065-4520-4d8b-9e6f-1f1489402001\") " pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.341389 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.341361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxr6m\" (UniqueName: \"kubernetes.io/projected/5f956065-4520-4d8b-9e6f-1f1489402001-kube-api-access-vxr6m\") pod \"authorino-989476477-z46p4\" (UID: \"5f956065-4520-4d8b-9e6f-1f1489402001\") " pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.411154 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.411071    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-989476477-z46p4"
Jul 07 19:01:34.552686 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.552620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-989476477-z46p4"]
Jul 07 19:01:34.555000 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:01:34.554973    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f956065_4520_4d8b_9e6f_1f1489402001.slice/crio-90b2880c3af8718ddbd2e4e30209cb0406cef830676d00aa36e2f789b5dff525 WatchSource:0}: Error finding container 90b2880c3af8718ddbd2e4e30209cb0406cef830676d00aa36e2f789b5dff525: Status 404 returned error can't find the container with id 90b2880c3af8718ddbd2e4e30209cb0406cef830676d00aa36e2f789b5dff525
Jul 07 19:01:34.697752 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:34.697718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-989476477-z46p4" event={"ID":"5f956065-4520-4d8b-9e6f-1f1489402001","Type":"ContainerStarted","Data":"90b2880c3af8718ddbd2e4e30209cb0406cef830676d00aa36e2f789b5dff525"}
Jul 07 19:01:35.707006 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:35.706961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-989476477-z46p4" event={"ID":"5f956065-4520-4d8b-9e6f-1f1489402001","Type":"ContainerStarted","Data":"88b40ea289bb85c6584283b326703e4ec02e6e9c71539a06358df437497775f2"}
Jul 07 19:01:35.741765 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:35.741700    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-989476477-z46p4" podStartSLOduration=1.343826645 podStartE2EDuration="1.741681029s" totalImagesPullingTime="397.854384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:35.740817105 +0000 UTC m=+658.804293805" watchObservedRunningTime="2026-07-07 19:01:35.741681029 +0000 UTC m=+658.805157729"
Jul 07 19:01:35.801156 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:35.801116    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dbdb5687b-44nwj"]
Jul 07 19:01:35.801365 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:35.801335    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-dbdb5687b-44nwj" podUID="2f67529c-21db-46ca-bc46-08628258e583" containerName="authorino" containerID="cri-o://dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f" gracePeriod=30
Jul 07 19:01:36.066337 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.066312    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 19:01:36.242630 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.242536    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f67529c-21db-46ca-bc46-08628258e583-tls-cert\") pod \"2f67529c-21db-46ca-bc46-08628258e583\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") "
Jul 07 19:01:36.242630 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.242596    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zzb4\" (UniqueName: \"kubernetes.io/projected/2f67529c-21db-46ca-bc46-08628258e583-kube-api-access-7zzb4\") pod \"2f67529c-21db-46ca-bc46-08628258e583\" (UID: \"2f67529c-21db-46ca-bc46-08628258e583\") "
Jul 07 19:01:36.244852 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.244821    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f67529c-21db-46ca-bc46-08628258e583-kube-api-access-7zzb4" (OuterVolumeSpecName: "kube-api-access-7zzb4") pod "2f67529c-21db-46ca-bc46-08628258e583" (UID: "2f67529c-21db-46ca-bc46-08628258e583"). InnerVolumeSpecName "kube-api-access-7zzb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:01:36.254546 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.254522    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f67529c-21db-46ca-bc46-08628258e583-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2f67529c-21db-46ca-bc46-08628258e583" (UID: "2f67529c-21db-46ca-bc46-08628258e583"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:01:36.343353 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.343321    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f67529c-21db-46ca-bc46-08628258e583-tls-cert\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:01:36.343353 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.343348    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zzb4\" (UniqueName: \"kubernetes.io/projected/2f67529c-21db-46ca-bc46-08628258e583-kube-api-access-7zzb4\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:01:36.720005 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.719970    2562 generic.go:356] "Generic (PLEG): container finished" podID="2f67529c-21db-46ca-bc46-08628258e583" containerID="dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f" exitCode=0
Jul 07 19:01:36.720500 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.720032    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbdb5687b-44nwj"
Jul 07 19:01:36.720500 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.720060    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbdb5687b-44nwj" event={"ID":"2f67529c-21db-46ca-bc46-08628258e583","Type":"ContainerDied","Data":"dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f"}
Jul 07 19:01:36.720500 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.720109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbdb5687b-44nwj" event={"ID":"2f67529c-21db-46ca-bc46-08628258e583","Type":"ContainerDied","Data":"691b9a8cd606560d2c2ef448a0afc89f2859661aee7967161505c4880a12f779"}
Jul 07 19:01:36.720500 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.720131    2562 scope.go:117] "RemoveContainer" containerID="dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f"
Jul 07 19:01:36.730164 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.730141    2562 scope.go:117] "RemoveContainer" containerID="dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f"
Jul 07 19:01:36.730465 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:01:36.730447    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f\": container with ID starting with dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f not found: ID does not exist" containerID="dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f"
Jul 07 19:01:36.730543 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.730472    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f"} err="failed to get container status \"dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f\": rpc error: code = NotFound desc = could not find container \"dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f\": container with ID starting with dadb17bed4691cf2e695f5618e7fb894a7e802411fbbb015207fabb1ee317d5f not found: ID does not exist"
Jul 07 19:01:36.746661 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.746609    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dbdb5687b-44nwj"]
Jul 07 19:01:36.753681 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:36.753615    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-dbdb5687b-44nwj"]
Jul 07 19:01:37.445685 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:01:37.445656    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f67529c-21db-46ca-bc46-08628258e583" path="/var/lib/kubelet/pods/2f67529c-21db-46ca-bc46-08628258e583/volumes"
Jul 07 19:02:04.036605 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:02:04.036562    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:02:14.910878 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:02:14.910845    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:02:24.002587 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:02:24.002544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:02:34.223460 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:02:34.223365    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:02:44.204619 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:02:44.204591    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:03:11.033411 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:03:11.033376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:03:24.205568 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:03:24.205516    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:04:03.708646 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:04:03.708612    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:04:10.895897 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:04:10.895860    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:04:20.947500 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:04:20.947465    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:04:26.697554 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:04:26.697526    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:04:37.196646 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:04:37.196607    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:04:47.260950 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:04:47.260904    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:04:58.793018 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:04:58.792980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:05:08.100643 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:05:08.100600    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:05:30.905013 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:05:30.904936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:05:37.452900 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:05:37.452863    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:05:37.453353 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:05:37.453012    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:05:37.458489 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:05:37.458464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:05:37.458664 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:05:37.458466    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:05:39.501421 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:05:39.501386    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:06:04.495467 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:06:04.495431    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:06:14.827474 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:06:14.827434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:06:31.813027 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:06:31.812992    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:06:41.010210 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:06:41.010172    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:06:51.014501 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:06:51.014467    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:07:00.331984 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:07:00.331895    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:07:08.830227 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:07:08.830190    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:09:02.997873 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:09:02.997827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:09:12.005660 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:09:12.005627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:09:24.599073 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:09:24.599033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:09:33.499022 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:09:33.498987    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:09:42.298680 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:09:42.298642    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:09:52.809508 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:09:52.809468    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:10:02.498376 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:02.498337    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:10:12.706097 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:12.706055    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:10:22.806310 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:22.806243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:10:35.094438 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:35.094398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:10:37.485200 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:37.485166    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:10:37.487698 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:37.487675    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:10:37.490492 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:37.490466    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:10:37.493486 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:37.493461    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:10:45.787073 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:45.787035    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:10:55.710599 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:10:55.710557    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:11:13.010473 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:11:13.010439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:11:22.100502 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:11:22.100466    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:11:31.611586 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:11:31.611512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:11:42.806896 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:11:42.806855    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:11:50.902157 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:11:50.902122    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:12:02.791272 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:12:02.791226    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:12:13.993562 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:12:13.993525    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:12:22.996418 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:12:22.996381    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:12:33.006327 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:12:33.006293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:12:42.610498 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:12:42.610467    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:12:52.307839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:12:52.307806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:13:05.198538 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:13:05.198502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:13:14.525460 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:13:14.525421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:13:23.509146 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:13:23.509112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:13:35.399795 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:13:35.399753    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:13:47.495375 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:13:47.495340    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:13:54.995374 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:13:54.995338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:14:07.406984 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:14:07.406944    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:14:19.893832 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:14:19.893798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:14:32.111124 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:14:32.111037    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:14:40.505711 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:14:40.505672    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:14:53.016943 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:14:53.016906    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:15:01.709470 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:01.709433    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:15:11.620425 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:11.620384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:15:19.797066 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:19.797023    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:15:27.317016 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:27.316983    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:15:35.699549 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:35.699455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:15:37.518415 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:37.518382    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:15:37.522537 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:37.522513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:15:37.524149 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:37.524128    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:15:37.527895 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:37.527877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:15:44.994987 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:44.994952    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:15:53.002283 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:15:53.002230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:17:16.103499 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:17:16.103462    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:17:24.713012 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:17:24.712967    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:17:38.710006 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:17:38.709973    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:17:49.315005 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:17:49.314971    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:18:21.539800 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:21.539766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:18:41.540136 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.540099    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"]
Jul 07 19:18:41.540629 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.540610    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f67529c-21db-46ca-bc46-08628258e583" containerName="authorino"
Jul 07 19:18:41.540674 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.540634    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f67529c-21db-46ca-bc46-08628258e583" containerName="authorino"
Jul 07 19:18:41.540754 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.540743    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f67529c-21db-46ca-bc46-08628258e583" containerName="authorino"
Jul 07 19:18:41.543612 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.543596    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.548111 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.548088    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-62ed4bc1\"/\"e2e-lifecycle-model-62ed4bc1-kserve-self-signed-certs\""
Jul 07 19:18:41.548111 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.548106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-62ed4bc1\"/\"default-dockercfg-n78z8\""
Jul 07 19:18:41.548303 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.548137    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-62ed4bc1\"/\"kube-root-ca.crt\""
Jul 07 19:18:41.548303 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.548090    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-62ed4bc1\"/\"openshift-service-ca.crt\""
Jul 07 19:18:41.556908 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.556886    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"]
Jul 07 19:18:41.685723 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.685685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-dshm\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.685908 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.685737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-home\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.685908 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.685757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tls-certs\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.685908 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.685843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-model-cache\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.685908 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.685884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tmp-dir\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.686092 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.685935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdf9\" (UniqueName: \"kubernetes.io/projected/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-kube-api-access-cxdf9\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787087 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-home\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787087 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tls-certs\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787307 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-model-cache\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787307 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tmp-dir\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787307 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdf9\" (UniqueName: \"kubernetes.io/projected/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-kube-api-access-cxdf9\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787307 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-dshm\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787536 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787513    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-home\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787591 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tmp-dir\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.787632 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.787617    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-model-cache\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.789525 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.789505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-dshm\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.789769 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.789753    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tls-certs\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.797896 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.797836    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdf9\" (UniqueName: \"kubernetes.io/projected/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-kube-api-access-cxdf9\") pod \"e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") " pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.852633 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.852614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:41.997351 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:41.997328    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"]
Jul 07 19:18:41.999428 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:18:41.999400    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8eb2cd3a_3655_49e1_afee_a671bf5e99bc.slice/crio-da4361dd6752fb837da8111e2ca4c4b79bc7a0037523c2d8265b35796a20271c WatchSource:0}: Error finding container da4361dd6752fb837da8111e2ca4c4b79bc7a0037523c2d8265b35796a20271c: Status 404 returned error can't find the container with id da4361dd6752fb837da8111e2ca4c4b79bc7a0037523c2d8265b35796a20271c
Jul 07 19:18:42.989860 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:42.989826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q" event={"ID":"8eb2cd3a-3655-49e1-afee-a671bf5e99bc","Type":"ContainerStarted","Data":"5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf"}
Jul 07 19:18:42.989860 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:42.989866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q" event={"ID":"8eb2cd3a-3655-49e1-afee-a671bf5e99bc","Type":"ContainerStarted","Data":"da4361dd6752fb837da8111e2ca4c4b79bc7a0037523c2d8265b35796a20271c"}
Jul 07 19:18:43.013680 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:43.013621    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q" podStartSLOduration=2.013605627 podStartE2EDuration="2.013605627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:43.011767035 +0000 UTC m=+1686.075243734" watchObservedRunningTime="2026-07-07 19:18:43.013605627 +0000 UTC m=+1686.077082325"
Jul 07 19:18:44.805664 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:44.805630    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:18:51.853434 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:51.853398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:51.853434 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:51.853445    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:51.865534 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:51.865498    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:52.045138 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:52.045114    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:18:55.704343 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:18:55.704306    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:19:05.693621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:05.693587    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:19:09.557718 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:09.557674    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"]
Jul 07 19:19:14.800379 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:14.800344    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:19:24.578022 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.577960    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q" podUID="8eb2cd3a-3655-49e1-afee-a671bf5e99bc" containerName="main" containerID="cri-o://5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf" gracePeriod=45
Jul 07 19:19:24.822914 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.822891    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:19:24.935997 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.935969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tmp-dir\") pod \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") "
Jul 07 19:19:24.936162 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936039    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-dshm\") pod \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") "
Jul 07 19:19:24.936162 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936055    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tls-certs\") pod \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") "
Jul 07 19:19:24.936162 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936101    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-model-cache\") pod \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") "
Jul 07 19:19:24.936162 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxdf9\" (UniqueName: \"kubernetes.io/projected/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-kube-api-access-cxdf9\") pod \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") "
Jul 07 19:19:24.936162 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936144    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-home\") pod \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\" (UID: \"8eb2cd3a-3655-49e1-afee-a671bf5e99bc\") "
Jul 07 19:19:24.936442 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936253    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8eb2cd3a-3655-49e1-afee-a671bf5e99bc" (UID: "8eb2cd3a-3655-49e1-afee-a671bf5e99bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:19:24.936442 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936358    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "8eb2cd3a-3655-49e1-afee-a671bf5e99bc" (UID: "8eb2cd3a-3655-49e1-afee-a671bf5e99bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:19:24.936442 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936417    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:19:24.936585 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.936475    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-home" (OuterVolumeSpecName: "home") pod "8eb2cd3a-3655-49e1-afee-a671bf5e99bc" (UID: "8eb2cd3a-3655-49e1-afee-a671bf5e99bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:19:24.938294 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.938255    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8eb2cd3a-3655-49e1-afee-a671bf5e99bc" (UID: "8eb2cd3a-3655-49e1-afee-a671bf5e99bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:19:24.938373 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.938340    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-kube-api-access-cxdf9" (OuterVolumeSpecName: "kube-api-access-cxdf9") pod "8eb2cd3a-3655-49e1-afee-a671bf5e99bc" (UID: "8eb2cd3a-3655-49e1-afee-a671bf5e99bc"). InnerVolumeSpecName "kube-api-access-cxdf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:19:24.938434 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:24.938408    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-dshm" (OuterVolumeSpecName: "dshm") pod "8eb2cd3a-3655-49e1-afee-a671bf5e99bc" (UID: "8eb2cd3a-3655-49e1-afee-a671bf5e99bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:19:25.036961 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.036932    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:19:25.036961 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.036958    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:19:25.037116 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.036972    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:19:25.037116 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.036998    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxdf9\" (UniqueName: \"kubernetes.io/projected/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-kube-api-access-cxdf9\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:19:25.037116 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.037010    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eb2cd3a-3655-49e1-afee-a671bf5e99bc-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:19:25.198969 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.198881    2562 generic.go:356] "Generic (PLEG): container finished" podID="8eb2cd3a-3655-49e1-afee-a671bf5e99bc" containerID="5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf" exitCode=0
Jul 07 19:19:25.198969 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.198935    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"
Jul 07 19:19:25.199172 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.198969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q" event={"ID":"8eb2cd3a-3655-49e1-afee-a671bf5e99bc","Type":"ContainerDied","Data":"5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf"}
Jul 07 19:19:25.199172 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.199011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q" event={"ID":"8eb2cd3a-3655-49e1-afee-a671bf5e99bc","Type":"ContainerDied","Data":"da4361dd6752fb837da8111e2ca4c4b79bc7a0037523c2d8265b35796a20271c"}
Jul 07 19:19:25.199172 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.199030    2562 scope.go:117] "RemoveContainer" containerID="5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf"
Jul 07 19:19:25.208725 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.208710    2562 scope.go:117] "RemoveContainer" containerID="5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf"
Jul 07 19:19:25.208960 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:19:25.208945    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf\": container with ID starting with 5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf not found: ID does not exist" containerID="5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf"
Jul 07 19:19:25.208998 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.208968    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf"} err="failed to get container status \"5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf\": rpc error: code = NotFound desc = could not find container \"5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf\": container with ID starting with 5500f056d8e40893ee1683440332765f8ae72346804e63cce45853206c997fbf not found: ID does not exist"
Jul 07 19:19:25.220671 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.220651    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"]
Jul 07 19:19:25.224771 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.224751    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-62ed4bc1/e2e-lifecycle-model-62ed4bc1-kserve-6755d869dc-lm22q"]
Jul 07 19:19:25.444834 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:25.444791    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb2cd3a-3655-49e1-afee-a671bf5e99bc" path="/var/lib/kubelet/pods/8eb2cd3a-3655-49e1-afee-a671bf5e99bc/volumes"
Jul 07 19:19:49.201113 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:19:49.201078    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:20:08.211447 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:20:08.211410    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:20:17.498352 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:20:17.498320    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:20:37.553458 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:20:37.553425    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:20:37.558749 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:20:37.558721    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:20:37.559178 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:20:37.559158    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:20:37.564518 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:20:37.564499    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:21:07.335197 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:07.335159    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:21:17.427230 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:17.427198    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:21:39.726705 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.726671    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"]
Jul 07 19:21:39.727157 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.727145    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb2cd3a-3655-49e1-afee-a671bf5e99bc" containerName="main"
Jul 07 19:21:39.727224 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.727165    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb2cd3a-3655-49e1-afee-a671bf5e99bc" containerName="main"
Jul 07 19:21:39.727311 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.727297    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb2cd3a-3655-49e1-afee-a671bf5e99bc" containerName="main"
Jul 07 19:21:39.730214 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.730193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.732833 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.732815    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54b9e6\"/\"test-model-54b9e6-kserve-self-signed-certs\""
Jul 07 19:21:39.733405 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.733390    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54b9e6\"/\"openshift-service-ca.crt\""
Jul 07 19:21:39.733698 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.733682    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54b9e6\"/\"kube-root-ca.crt\""
Jul 07 19:21:39.733767 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.733682    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54b9e6\"/\"default-dockercfg-5ccm8\""
Jul 07 19:21:39.741078 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.741053    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"]
Jul 07 19:21:39.831251 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.831219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-home\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.831251 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.831273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-tmp-dir\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.831441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.831312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-dshm\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.831441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.831331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-model-cache\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.831441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.831392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefafaba-fcf8-4703-854b-33c6d288eb68-tls-certs\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.831441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.831410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkpx\" (UniqueName: \"kubernetes.io/projected/aefafaba-fcf8-4703-854b-33c6d288eb68-kube-api-access-xpkpx\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.932783 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.932747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-tmp-dir\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.932783 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.932785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-dshm\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.933034 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.932812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-model-cache\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.933034 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.932869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefafaba-fcf8-4703-854b-33c6d288eb68-tls-certs\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.933034 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.932893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkpx\" (UniqueName: \"kubernetes.io/projected/aefafaba-fcf8-4703-854b-33c6d288eb68-kube-api-access-xpkpx\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.933034 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.932949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-home\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.933604 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.933155    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-tmp-dir\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.933604 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.933247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-model-cache\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.933604 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.933359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-home\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.935218 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.935198    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-dshm\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.935369 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.935352    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefafaba-fcf8-4703-854b-33c6d288eb68-tls-certs\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:39.941921 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:39.941888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkpx\" (UniqueName: \"kubernetes.io/projected/aefafaba-fcf8-4703-854b-33c6d288eb68-kube-api-access-xpkpx\") pod \"test-model-54b9e6-kserve-69754ff49f-c564w\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") " pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:40.038950 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:40.038881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:40.171120 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:40.171091    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"]
Jul 07 19:21:40.172938 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:21:40.172907    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaefafaba_fcf8_4703_854b_33c6d288eb68.slice/crio-27768913de174582c0f652ce3fd07fce43201b6e4c802a215d41547dddd200be WatchSource:0}: Error finding container 27768913de174582c0f652ce3fd07fce43201b6e4c802a215d41547dddd200be: Status 404 returned error can't find the container with id 27768913de174582c0f652ce3fd07fce43201b6e4c802a215d41547dddd200be
Jul 07 19:21:40.876174 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:40.876138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w" event={"ID":"aefafaba-fcf8-4703-854b-33c6d288eb68","Type":"ContainerStarted","Data":"940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96"}
Jul 07 19:21:40.876174 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:40.876176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w" event={"ID":"aefafaba-fcf8-4703-854b-33c6d288eb68","Type":"ContainerStarted","Data":"27768913de174582c0f652ce3fd07fce43201b6e4c802a215d41547dddd200be"}
Jul 07 19:21:40.898154 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:40.898099    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w" podStartSLOduration=1.8980844449999998 podStartE2EDuration="1.898084445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:21:40.895586257 +0000 UTC m=+1863.959062956" watchObservedRunningTime="2026-07-07 19:21:40.898084445 +0000 UTC m=+1863.961561146"
Jul 07 19:21:42.805802 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:42.805758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:21:50.039385 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:50.039343    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:50.039385 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:50.039400    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:50.052384 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:50.052359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:50.939055 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:50.939027    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:21:53.301358 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:21:53.301322    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:22:00.136672 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.136591    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"]
Jul 07 19:22:00.140739 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.140712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.143720 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.143690    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c575f8\"/\"openshift-service-ca.crt\""
Jul 07 19:22:00.143720 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.143690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c575f8\"/\"test-model-c575f8-kserve-self-signed-certs\""
Jul 07 19:22:00.143984 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.143970    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c575f8\"/\"default-dockercfg-4vpm6\""
Jul 07 19:22:00.144068 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.143995    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c575f8\"/\"kube-root-ca.crt\""
Jul 07 19:22:00.148976 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.148956    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"]
Jul 07 19:22:00.296462 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.296430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9v4\" (UniqueName: \"kubernetes.io/projected/b25470be-20a7-4d3b-b7d6-34bc66e1b158-kube-api-access-mr9v4\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.296462 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.296466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-dshm\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.296661 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.296488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-model-cache\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.296661 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.296504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tmp-dir\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.296661 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.296568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-home\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.296661 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.296641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tls-certs\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.397930 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.397853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-home\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.397930 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.397899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tls-certs\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.398103 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.397944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9v4\" (UniqueName: \"kubernetes.io/projected/b25470be-20a7-4d3b-b7d6-34bc66e1b158-kube-api-access-mr9v4\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.398103 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.397969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-dshm\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.398103 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.397993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-model-cache\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.398103 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.398015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tmp-dir\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.398337 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.398251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-home\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.398391 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.398357    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tmp-dir\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.398452 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.398436    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-model-cache\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.400413 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.400394    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-dshm\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.400673 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.400657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tls-certs\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.407587 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.407560    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9v4\" (UniqueName: \"kubernetes.io/projected/b25470be-20a7-4d3b-b7d6-34bc66e1b158-kube-api-access-mr9v4\") pod \"test-model-c575f8-kserve-76b9997bcc-4vlhp\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") " pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.451626 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.451595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:00.588824 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.588798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"]
Jul 07 19:22:00.591100 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:22:00.591074    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb25470be_20a7_4d3b_b7d6_34bc66e1b158.slice/crio-6c3284326e7dfd120f537ae9e72d65e9dbbc9388bd5f1ac8ce0f4b8b03db3a19 WatchSource:0}: Error finding container 6c3284326e7dfd120f537ae9e72d65e9dbbc9388bd5f1ac8ce0f4b8b03db3a19: Status 404 returned error can't find the container with id 6c3284326e7dfd120f537ae9e72d65e9dbbc9388bd5f1ac8ce0f4b8b03db3a19
Jul 07 19:22:00.978686 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.978653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp" event={"ID":"b25470be-20a7-4d3b-b7d6-34bc66e1b158","Type":"ContainerStarted","Data":"ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1"}
Jul 07 19:22:00.978686 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.978690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp" event={"ID":"b25470be-20a7-4d3b-b7d6-34bc66e1b158","Type":"ContainerStarted","Data":"6c3284326e7dfd120f537ae9e72d65e9dbbc9388bd5f1ac8ce0f4b8b03db3a19"}
Jul 07 19:22:00.997793 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:00.997744    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp" podStartSLOduration=0.997728359 podStartE2EDuration="997.728359ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:22:00.997011648 +0000 UTC m=+1884.060488345" watchObservedRunningTime="2026-07-07 19:22:00.997728359 +0000 UTC m=+1884.061205058"
Jul 07 19:22:02.796370 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:02.796335    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:22:10.452043 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:10.452009    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:10.452043 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:10.452048    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:10.464599 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:10.464568    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:11.041491 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:11.041451    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:18.148535 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:18.148501    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:22:20.618681 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:20.618650    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"]
Jul 07 19:22:21.555686 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:21.555655    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"]
Jul 07 19:22:34.100799 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:34.100766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:22:35.638669 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:35.638631    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w" podUID="aefafaba-fcf8-4703-854b-33c6d288eb68" containerName="main" containerID="cri-o://940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96" gracePeriod=45
Jul 07 19:22:35.882491 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:35.882468    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:22:36.001837 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.001806    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-tmp-dir\") pod \"aefafaba-fcf8-4703-854b-33c6d288eb68\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") "
Jul 07 19:22:36.002029 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.001856    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpkpx\" (UniqueName: \"kubernetes.io/projected/aefafaba-fcf8-4703-854b-33c6d288eb68-kube-api-access-xpkpx\") pod \"aefafaba-fcf8-4703-854b-33c6d288eb68\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") "
Jul 07 19:22:36.002029 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.001927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-dshm\") pod \"aefafaba-fcf8-4703-854b-33c6d288eb68\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") "
Jul 07 19:22:36.002029 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.001943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefafaba-fcf8-4703-854b-33c6d288eb68-tls-certs\") pod \"aefafaba-fcf8-4703-854b-33c6d288eb68\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") "
Jul 07 19:22:36.002029 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.001962    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-home\") pod \"aefafaba-fcf8-4703-854b-33c6d288eb68\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") "
Jul 07 19:22:36.002029 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.001978    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-model-cache\") pod \"aefafaba-fcf8-4703-854b-33c6d288eb68\" (UID: \"aefafaba-fcf8-4703-854b-33c6d288eb68\") "
Jul 07 19:22:36.002328 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.002108    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aefafaba-fcf8-4703-854b-33c6d288eb68" (UID: "aefafaba-fcf8-4703-854b-33c6d288eb68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.002328 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.002258    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.002441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.002376    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-home" (OuterVolumeSpecName: "home") pod "aefafaba-fcf8-4703-854b-33c6d288eb68" (UID: "aefafaba-fcf8-4703-854b-33c6d288eb68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.002441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.002416    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-model-cache" (OuterVolumeSpecName: "model-cache") pod "aefafaba-fcf8-4703-854b-33c6d288eb68" (UID: "aefafaba-fcf8-4703-854b-33c6d288eb68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.004389 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.004368    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aefafaba-fcf8-4703-854b-33c6d288eb68-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aefafaba-fcf8-4703-854b-33c6d288eb68" (UID: "aefafaba-fcf8-4703-854b-33c6d288eb68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:22:36.004567 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.004546    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-dshm" (OuterVolumeSpecName: "dshm") pod "aefafaba-fcf8-4703-854b-33c6d288eb68" (UID: "aefafaba-fcf8-4703-854b-33c6d288eb68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.004634 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.004552    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aefafaba-fcf8-4703-854b-33c6d288eb68-kube-api-access-xpkpx" (OuterVolumeSpecName: "kube-api-access-xpkpx") pod "aefafaba-fcf8-4703-854b-33c6d288eb68" (UID: "aefafaba-fcf8-4703-854b-33c6d288eb68"). InnerVolumeSpecName "kube-api-access-xpkpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:22:36.102935 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.102907    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.102935 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.102930    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefafaba-fcf8-4703-854b-33c6d288eb68-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.102935 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.102941    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.103133 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.102949    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefafaba-fcf8-4703-854b-33c6d288eb68-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.103133 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.102957    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpkpx\" (UniqueName: \"kubernetes.io/projected/aefafaba-fcf8-4703-854b-33c6d288eb68-kube-api-access-xpkpx\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.158107 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.158074    2562 generic.go:356] "Generic (PLEG): container finished" podID="aefafaba-fcf8-4703-854b-33c6d288eb68" containerID="940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96" exitCode=0
Jul 07 19:22:36.158231 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.158120    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"
Jul 07 19:22:36.158231 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.158159    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w" event={"ID":"aefafaba-fcf8-4703-854b-33c6d288eb68","Type":"ContainerDied","Data":"940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96"}
Jul 07 19:22:36.158231 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.158200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w" event={"ID":"aefafaba-fcf8-4703-854b-33c6d288eb68","Type":"ContainerDied","Data":"27768913de174582c0f652ce3fd07fce43201b6e4c802a215d41547dddd200be"}
Jul 07 19:22:36.158231 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.158220    2562 scope.go:117] "RemoveContainer" containerID="940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96"
Jul 07 19:22:36.173944 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.173921    2562 scope.go:117] "RemoveContainer" containerID="940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96"
Jul 07 19:22:36.174416 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:22:36.174394    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96\": container with ID starting with 940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96 not found: ID does not exist" containerID="940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96"
Jul 07 19:22:36.174511 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.174425    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96"} err="failed to get container status \"940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96\": rpc error: code = NotFound desc = could not find container \"940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96\": container with ID starting with 940fe1a421a53ee2ecf266ce3476fdee2fc91549772f7af7f3592768de3a2c96 not found: ID does not exist"
Jul 07 19:22:36.183910 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.183881    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"]
Jul 07 19:22:36.187868 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.187849    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-54b9e6/test-model-54b9e6-kserve-69754ff49f-c564w"]
Jul 07 19:22:36.575889 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.575845    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp" podUID="b25470be-20a7-4d3b-b7d6-34bc66e1b158" containerName="main" containerID="cri-o://ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1" gracePeriod=45
Jul 07 19:22:36.820953 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.820930    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:36.909731 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909657    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tls-certs\") pod \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") "
Jul 07 19:22:36.909731 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909692    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr9v4\" (UniqueName: \"kubernetes.io/projected/b25470be-20a7-4d3b-b7d6-34bc66e1b158-kube-api-access-mr9v4\") pod \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") "
Jul 07 19:22:36.909731 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909711    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-home\") pod \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") "
Jul 07 19:22:36.909731 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909730    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-model-cache\") pod \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") "
Jul 07 19:22:36.910047 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909930    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tmp-dir\") pod \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") "
Jul 07 19:22:36.910047 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909981    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-model-cache" (OuterVolumeSpecName: "model-cache") pod "b25470be-20a7-4d3b-b7d6-34bc66e1b158" (UID: "b25470be-20a7-4d3b-b7d6-34bc66e1b158"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.910047 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909988    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-home" (OuterVolumeSpecName: "home") pod "b25470be-20a7-4d3b-b7d6-34bc66e1b158" (UID: "b25470be-20a7-4d3b-b7d6-34bc66e1b158"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.910047 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.909984    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-dshm\") pod \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\" (UID: \"b25470be-20a7-4d3b-b7d6-34bc66e1b158\") "
Jul 07 19:22:36.910249 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.910151    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b25470be-20a7-4d3b-b7d6-34bc66e1b158" (UID: "b25470be-20a7-4d3b-b7d6-34bc66e1b158"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.910345 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.910320    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.910345 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.910335    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.910345 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.910343    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:36.912038 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.912008    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-dshm" (OuterVolumeSpecName: "dshm") pod "b25470be-20a7-4d3b-b7d6-34bc66e1b158" (UID: "b25470be-20a7-4d3b-b7d6-34bc66e1b158"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:22:36.912145 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.912051    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25470be-20a7-4d3b-b7d6-34bc66e1b158-kube-api-access-mr9v4" (OuterVolumeSpecName: "kube-api-access-mr9v4") pod "b25470be-20a7-4d3b-b7d6-34bc66e1b158" (UID: "b25470be-20a7-4d3b-b7d6-34bc66e1b158"). InnerVolumeSpecName "kube-api-access-mr9v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:22:36.912145 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:36.912068    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b25470be-20a7-4d3b-b7d6-34bc66e1b158" (UID: "b25470be-20a7-4d3b-b7d6-34bc66e1b158"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:22:37.011328 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.011303    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25470be-20a7-4d3b-b7d6-34bc66e1b158-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:37.011328 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.011325    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25470be-20a7-4d3b-b7d6-34bc66e1b158-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:37.011488 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.011335    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr9v4\" (UniqueName: \"kubernetes.io/projected/b25470be-20a7-4d3b-b7d6-34bc66e1b158-kube-api-access-mr9v4\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:22:37.164298 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.164206    2562 generic.go:356] "Generic (PLEG): container finished" podID="b25470be-20a7-4d3b-b7d6-34bc66e1b158" containerID="ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1" exitCode=0
Jul 07 19:22:37.164298 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.164250    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"
Jul 07 19:22:37.164493 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.164292    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp" event={"ID":"b25470be-20a7-4d3b-b7d6-34bc66e1b158","Type":"ContainerDied","Data":"ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1"}
Jul 07 19:22:37.164493 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.164339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp" event={"ID":"b25470be-20a7-4d3b-b7d6-34bc66e1b158","Type":"ContainerDied","Data":"6c3284326e7dfd120f537ae9e72d65e9dbbc9388bd5f1ac8ce0f4b8b03db3a19"}
Jul 07 19:22:37.164493 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.164360    2562 scope.go:117] "RemoveContainer" containerID="ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1"
Jul 07 19:22:37.173412 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.173395    2562 scope.go:117] "RemoveContainer" containerID="ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1"
Jul 07 19:22:37.173649 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:22:37.173621    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1\": container with ID starting with ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1 not found: ID does not exist" containerID="ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1"
Jul 07 19:22:37.173743 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.173655    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1"} err="failed to get container status \"ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1\": rpc error: code = NotFound desc = could not find container \"ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1\": container with ID starting with ad86b4242eeaad800f36d22d7c1b1ad303622db23e6007da8cdd21b7827a0db1 not found: ID does not exist"
Jul 07 19:22:37.188244 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.188224    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"]
Jul 07 19:22:37.192500 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.192477    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c575f8/test-model-c575f8-kserve-76b9997bcc-4vlhp"]
Jul 07 19:22:37.444950 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.444922    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aefafaba-fcf8-4703-854b-33c6d288eb68" path="/var/lib/kubelet/pods/aefafaba-fcf8-4703-854b-33c6d288eb68/volumes"
Jul 07 19:22:37.445308 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:22:37.445294    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25470be-20a7-4d3b-b7d6-34bc66e1b158" path="/var/lib/kubelet/pods/b25470be-20a7-4d3b-b7d6-34bc66e1b158/volumes"
Jul 07 19:23:08.108035 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:23:08.108001    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:23:21.095528 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:23:21.095497    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:23:30.004161 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:23:30.004072    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:23:40.712899 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:23:40.712864    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:23:51.232601 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:23:51.232567    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:24:01.402473 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:01.402440    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:24:12.718337 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:12.718304    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:24:22.135196 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.135163    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"]
Jul 07 19:24:22.135699 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.135682    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25470be-20a7-4d3b-b7d6-34bc66e1b158" containerName="main"
Jul 07 19:24:22.135745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.135703    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25470be-20a7-4d3b-b7d6-34bc66e1b158" containerName="main"
Jul 07 19:24:22.135745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.135721    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aefafaba-fcf8-4703-854b-33c6d288eb68" containerName="main"
Jul 07 19:24:22.135745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.135730    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aefafaba-fcf8-4703-854b-33c6d288eb68" containerName="main"
Jul 07 19:24:22.135844 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.135834    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aefafaba-fcf8-4703-854b-33c6d288eb68" containerName="main"
Jul 07 19:24:22.135881 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.135848    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25470be-20a7-4d3b-b7d6-34bc66e1b158" containerName="main"
Jul 07 19:24:22.139143 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.139118    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.141703 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.141682    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44233f\"/\"openshift-service-ca.crt\""
Jul 07 19:24:22.141980 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.141960    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44233f\"/\"auth-test-model-44233f-kserve-self-signed-certs\""
Jul 07 19:24:22.142084 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.141987    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-44233f\"/\"kube-root-ca.crt\""
Jul 07 19:24:22.142084 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.141987    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44233f\"/\"default-dockercfg-gwgbn\""
Jul 07 19:24:22.148944 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.148920    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"]
Jul 07 19:24:22.169988 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.169966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-dshm\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.170098 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.169992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-model-cache\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.170098 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.170009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tmp-dir\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.170098 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.170028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6bz\" (UniqueName: \"kubernetes.io/projected/96b21ebd-0f45-4c4a-bdea-e45a931b060b-kube-api-access-6n6bz\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.170098 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.170045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tls-certs\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.170232 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.170124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-home\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.270776 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.270747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-dshm\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.270776 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.270779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-model-cache\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.270962 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.270794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tmp-dir\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.270962 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.270922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6bz\" (UniqueName: \"kubernetes.io/projected/96b21ebd-0f45-4c4a-bdea-e45a931b060b-kube-api-access-6n6bz\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.271040 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.270962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tls-certs\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.271040 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.271015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-home\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.271135 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.271117    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-model-cache\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.271187 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.271152    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tmp-dir\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.271437 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.271419    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-home\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.273310 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.273287    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-dshm\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.273458 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.273443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tls-certs\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.279683 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.279663    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6bz\" (UniqueName: \"kubernetes.io/projected/96b21ebd-0f45-4c4a-bdea-e45a931b060b-kube-api-access-6n6bz\") pod \"auth-test-model-44233f-kserve-7b5464c79-4f44q\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") " pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.450947 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.450918    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:22.588158 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.588135    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"]
Jul 07 19:24:22.590676 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:24:22.590640    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96b21ebd_0f45_4c4a_bdea_e45a931b060b.slice/crio-497bb1b7ca6dc5c6d9a6eded71139ce71f57c09dfa22c66ccc91fbce5c18bba6 WatchSource:0}: Error finding container 497bb1b7ca6dc5c6d9a6eded71139ce71f57c09dfa22c66ccc91fbce5c18bba6: Status 404 returned error can't find the container with id 497bb1b7ca6dc5c6d9a6eded71139ce71f57c09dfa22c66ccc91fbce5c18bba6
Jul 07 19:24:22.692412 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.692377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q" event={"ID":"96b21ebd-0f45-4c4a-bdea-e45a931b060b","Type":"ContainerStarted","Data":"418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95"}
Jul 07 19:24:22.692412 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.692416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q" event={"ID":"96b21ebd-0f45-4c4a-bdea-e45a931b060b","Type":"ContainerStarted","Data":"497bb1b7ca6dc5c6d9a6eded71139ce71f57c09dfa22c66ccc91fbce5c18bba6"}
Jul 07 19:24:22.710816 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:22.710727    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q" podStartSLOduration=0.710713429 podStartE2EDuration="710.713429ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:24:22.708771195 +0000 UTC m=+2025.772247894" watchObservedRunningTime="2026-07-07 19:24:22.710713429 +0000 UTC m=+2025.774190127"
Jul 07 19:24:25.032661 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:25.032625    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:24:32.451743 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:32.451708    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:32.451743 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:32.451748    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:32.463969 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:32.463943    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:32.751071 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:32.750988    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:24:36.932458 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.932425    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"]
Jul 07 19:24:36.936092 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.936076    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:36.941473 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.941454    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"openshift-service-ca.crt\""
Jul 07 19:24:36.942076 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.942042    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"auth-test-model-6f2191-kserve-self-signed-certs\""
Jul 07 19:24:36.942076 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.942058    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"default-dockercfg-jzxbj\""
Jul 07 19:24:36.942076 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.942068    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"kube-root-ca.crt\""
Jul 07 19:24:36.950932 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.950907    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"]
Jul 07 19:24:36.994298 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.994244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-model-cache\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:36.994458 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.994305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8b4\" (UniqueName: \"kubernetes.io/projected/24fdebe7-9069-43ab-914b-21f84b7cf5f7-kube-api-access-gn8b4\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:36.994458 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.994385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-dshm\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:36.994458 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.994428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-home\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:36.994617 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.994469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tls-certs\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:36.994617 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:36.994545    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tmp-dir\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.095825 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.095789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tmp-dir\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096021 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.095847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-model-cache\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096021 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.095872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8b4\" (UniqueName: \"kubernetes.io/projected/24fdebe7-9069-43ab-914b-21f84b7cf5f7-kube-api-access-gn8b4\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096021 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.095913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-dshm\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096021 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.095940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-home\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096021 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.095973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tls-certs\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096320 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.096234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tmp-dir\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096320 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.096289    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-model-cache\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.096436 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.096396    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-home\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.098450 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.098428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-dshm\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.098552 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.098514    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tls-certs\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.110837 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.110816    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8b4\" (UniqueName: \"kubernetes.io/projected/24fdebe7-9069-43ab-914b-21f84b7cf5f7-kube-api-access-gn8b4\") pod \"auth-test-model-6f2191-kserve-548468b987-nc5x5\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") " pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.246412 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.246347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:37.387365 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.387341    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"]
Jul 07 19:24:37.389290 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:24:37.389236    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24fdebe7_9069_43ab_914b_21f84b7cf5f7.slice/crio-61fcac3c1898a90e99f8a954d1a05f608a158cfbad4742c932fc625bb02239d9 WatchSource:0}: Error finding container 61fcac3c1898a90e99f8a954d1a05f608a158cfbad4742c932fc625bb02239d9: Status 404 returned error can't find the container with id 61fcac3c1898a90e99f8a954d1a05f608a158cfbad4742c932fc625bb02239d9
Jul 07 19:24:37.767149 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.767114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5" event={"ID":"24fdebe7-9069-43ab-914b-21f84b7cf5f7","Type":"ContainerStarted","Data":"bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2"}
Jul 07 19:24:37.767343 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.767157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5" event={"ID":"24fdebe7-9069-43ab-914b-21f84b7cf5f7","Type":"ContainerStarted","Data":"61fcac3c1898a90e99f8a954d1a05f608a158cfbad4742c932fc625bb02239d9"}
Jul 07 19:24:37.790422 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:37.790369    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5" podStartSLOduration=1.790350299 podStartE2EDuration="1.790350299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:24:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:24:37.790205578 +0000 UTC m=+2040.853682276" watchObservedRunningTime="2026-07-07 19:24:37.790350299 +0000 UTC m=+2040.853826999"
Jul 07 19:24:40.494704 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:40.494661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:24:47.247004 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:47.246970    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:47.247600 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:47.247128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:47.259191 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:47.259166    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:47.830451 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:47.830425    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:24:58.322743 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:24:58.322658    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:25:14.207506 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:14.207467    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:25:29.597159 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:29.597121    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:25:37.591693 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:37.591668    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:25:37.597178 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:37.597156    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:25:37.597597 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:37.597580    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:25:37.602473 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:37.602456    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvks2_75c86c11-7f9d-4c9f-96e0-094cfb07d1fd/ovn-acl-logging/0.log"
Jul 07 19:25:44.098747 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:44.098714    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:25:57.216401 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:25:57.216369    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:26:12.700979 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:12.700945    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:26:28.296778 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:28.296685    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:26:33.013731 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:33.013698    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"]
Jul 07 19:26:33.822501 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:33.822468    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"]
Jul 07 19:26:43.400248 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:43.400160    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:26:45.806010 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.805978    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"]
Jul 07 19:26:45.809176 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.809155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.811097 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.811080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44233f\"/\"sub-test-model-44233f-kserve-self-signed-certs\""
Jul 07 19:26:45.836788 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.836767    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"]
Jul 07 19:26:45.892110 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.892075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vbm\" (UniqueName: \"kubernetes.io/projected/44418767-5b8e-4f21-bc76-9d9f5c6137f0-kube-api-access-b7vbm\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.892258 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.892133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-dshm\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.892258 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.892194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-home\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.892258 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.892218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tls-certs\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.892412 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.892330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-model-cache\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.892412 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.892361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tmp-dir\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993133 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-home\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993133 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tls-certs\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993371 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-model-cache\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993371 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tmp-dir\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993371 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vbm\" (UniqueName: \"kubernetes.io/projected/44418767-5b8e-4f21-bc76-9d9f5c6137f0-kube-api-access-b7vbm\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993516 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-dshm\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993581 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-home\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993641 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993580    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tmp-dir\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.993641 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.993628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-model-cache\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.995607 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.995587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-dshm\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:45.995760 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:45.995741    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tls-certs\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:46.002915 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:46.002892    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vbm\" (UniqueName: \"kubernetes.io/projected/44418767-5b8e-4f21-bc76-9d9f5c6137f0-kube-api-access-b7vbm\") pod \"sub-test-model-44233f-kserve-c4d776ff5-bbchc\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") " pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:46.118041 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:46.117966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:46.248866 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:46.248839    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"]
Jul 07 19:26:46.250809 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:26:46.250779    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44418767_5b8e_4f21_bc76_9d9f5c6137f0.slice/crio-6a74da410403fcaf778fbcebbca9b0ea7d05014c26fab96ec89162a273c6336d WatchSource:0}: Error finding container 6a74da410403fcaf778fbcebbca9b0ea7d05014c26fab96ec89162a273c6336d: Status 404 returned error can't find the container with id 6a74da410403fcaf778fbcebbca9b0ea7d05014c26fab96ec89162a273c6336d
Jul 07 19:26:46.418609 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:46.418516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc" event={"ID":"44418767-5b8e-4f21-bc76-9d9f5c6137f0","Type":"ContainerStarted","Data":"3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038"}
Jul 07 19:26:46.418609 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:46.418570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc" event={"ID":"44418767-5b8e-4f21-bc76-9d9f5c6137f0","Type":"ContainerStarted","Data":"6a74da410403fcaf778fbcebbca9b0ea7d05014c26fab96ec89162a273c6336d"}
Jul 07 19:26:46.437468 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:46.437403    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc" podStartSLOduration=1.4373847610000001 podStartE2EDuration="1.437384761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:26:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:26:46.436168824 +0000 UTC m=+2169.499645524" watchObservedRunningTime="2026-07-07 19:26:46.437384761 +0000 UTC m=+2169.500861461"
Jul 07 19:26:48.033416 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.033377    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q" podUID="96b21ebd-0f45-4c4a-bdea-e45a931b060b" containerName="main" containerID="cri-o://418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95" gracePeriod=45
Jul 07 19:26:48.277699 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.277674    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:26:48.416233 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416164    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-model-cache\") pod \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") "
Jul 07 19:26:48.416233 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416213    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tmp-dir\") pod \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") "
Jul 07 19:26:48.416615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416290    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-dshm\") pod \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") "
Jul 07 19:26:48.416615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416324    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-home\") pod \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") "
Jul 07 19:26:48.416615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416384    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tls-certs\") pod \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") "
Jul 07 19:26:48.416615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416416    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n6bz\" (UniqueName: \"kubernetes.io/projected/96b21ebd-0f45-4c4a-bdea-e45a931b060b-kube-api-access-6n6bz\") pod \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\" (UID: \"96b21ebd-0f45-4c4a-bdea-e45a931b060b\") "
Jul 07 19:26:48.416615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416485    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-model-cache" (OuterVolumeSpecName: "model-cache") pod "96b21ebd-0f45-4c4a-bdea-e45a931b060b" (UID: "96b21ebd-0f45-4c4a-bdea-e45a931b060b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:48.416615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416497    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "96b21ebd-0f45-4c4a-bdea-e45a931b060b" (UID: "96b21ebd-0f45-4c4a-bdea-e45a931b060b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:48.416615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416591    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-home" (OuterVolumeSpecName: "home") pod "96b21ebd-0f45-4c4a-bdea-e45a931b060b" (UID: "96b21ebd-0f45-4c4a-bdea-e45a931b060b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:48.416932 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416710    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:48.416932 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416735    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:48.416932 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.416746    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:48.418674 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.418644    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b21ebd-0f45-4c4a-bdea-e45a931b060b-kube-api-access-6n6bz" (OuterVolumeSpecName: "kube-api-access-6n6bz") pod "96b21ebd-0f45-4c4a-bdea-e45a931b060b" (UID: "96b21ebd-0f45-4c4a-bdea-e45a931b060b"). InnerVolumeSpecName "kube-api-access-6n6bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:48.418674 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.418645    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-dshm" (OuterVolumeSpecName: "dshm") pod "96b21ebd-0f45-4c4a-bdea-e45a931b060b" (UID: "96b21ebd-0f45-4c4a-bdea-e45a931b060b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:48.418817 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.418727    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "96b21ebd-0f45-4c4a-bdea-e45a931b060b" (UID: "96b21ebd-0f45-4c4a-bdea-e45a931b060b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:26:48.431071 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.431048    2562 generic.go:356] "Generic (PLEG): container finished" podID="96b21ebd-0f45-4c4a-bdea-e45a931b060b" containerID="418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95" exitCode=0
Jul 07 19:26:48.431179 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.431090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q" event={"ID":"96b21ebd-0f45-4c4a-bdea-e45a931b060b","Type":"ContainerDied","Data":"418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95"}
Jul 07 19:26:48.431179 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.431098    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"
Jul 07 19:26:48.431179 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.431116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q" event={"ID":"96b21ebd-0f45-4c4a-bdea-e45a931b060b","Type":"ContainerDied","Data":"497bb1b7ca6dc5c6d9a6eded71139ce71f57c09dfa22c66ccc91fbce5c18bba6"}
Jul 07 19:26:48.431179 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.431131    2562 scope.go:117] "RemoveContainer" containerID="418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95"
Jul 07 19:26:48.440006 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.439989    2562 scope.go:117] "RemoveContainer" containerID="418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95"
Jul 07 19:26:48.440244 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:26:48.440227    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95\": container with ID starting with 418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95 not found: ID does not exist" containerID="418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95"
Jul 07 19:26:48.440320 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.440253    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95"} err="failed to get container status \"418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95\": rpc error: code = NotFound desc = could not find container \"418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95\": container with ID starting with 418a299cf768222f213ed34011f46b44f146db6062ae32f7086201938fbaac95 not found: ID does not exist"
Jul 07 19:26:48.452607 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.452585    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"]
Jul 07 19:26:48.457799 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.457775    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/auth-test-model-44233f-kserve-7b5464c79-4f44q"]
Jul 07 19:26:48.517161 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.517141    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96b21ebd-0f45-4c4a-bdea-e45a931b060b-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:48.517161 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.517162    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96b21ebd-0f45-4c4a-bdea-e45a931b060b-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:48.517309 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.517172    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n6bz\" (UniqueName: \"kubernetes.io/projected/96b21ebd-0f45-4c4a-bdea-e45a931b060b-kube-api-access-6n6bz\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:48.842663 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:48.842626    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5" podUID="24fdebe7-9069-43ab-914b-21f84b7cf5f7" containerName="main" containerID="cri-o://bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2" gracePeriod=45
Jul 07 19:26:49.087103 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.087080    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:26:49.224420 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224387    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-model-cache\") pod \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") "
Jul 07 19:26:49.224621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224448    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-dshm\") pod \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") "
Jul 07 19:26:49.224621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224476    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-home\") pod \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") "
Jul 07 19:26:49.224621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224501    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tls-certs\") pod \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") "
Jul 07 19:26:49.224621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224537    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tmp-dir\") pod \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") "
Jul 07 19:26:49.224621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224563    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn8b4\" (UniqueName: \"kubernetes.io/projected/24fdebe7-9069-43ab-914b-21f84b7cf5f7-kube-api-access-gn8b4\") pod \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\" (UID: \"24fdebe7-9069-43ab-914b-21f84b7cf5f7\") "
Jul 07 19:26:49.224839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224697    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "24fdebe7-9069-43ab-914b-21f84b7cf5f7" (UID: "24fdebe7-9069-43ab-914b-21f84b7cf5f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:49.224839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224740    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24fdebe7-9069-43ab-914b-21f84b7cf5f7" (UID: "24fdebe7-9069-43ab-914b-21f84b7cf5f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:49.224839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224757    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-home" (OuterVolumeSpecName: "home") pod "24fdebe7-9069-43ab-914b-21f84b7cf5f7" (UID: "24fdebe7-9069-43ab-914b-21f84b7cf5f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:49.224995 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224896    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:49.224995 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224917    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:49.224995 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.224933    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:49.226891 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.226861    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-dshm" (OuterVolumeSpecName: "dshm") pod "24fdebe7-9069-43ab-914b-21f84b7cf5f7" (UID: "24fdebe7-9069-43ab-914b-21f84b7cf5f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:49.226891 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.226877    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24fdebe7-9069-43ab-914b-21f84b7cf5f7-kube-api-access-gn8b4" (OuterVolumeSpecName: "kube-api-access-gn8b4") pod "24fdebe7-9069-43ab-914b-21f84b7cf5f7" (UID: "24fdebe7-9069-43ab-914b-21f84b7cf5f7"). InnerVolumeSpecName "kube-api-access-gn8b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:49.227050 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.226899    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24fdebe7-9069-43ab-914b-21f84b7cf5f7" (UID: "24fdebe7-9069-43ab-914b-21f84b7cf5f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:26:49.325565 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.325541    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24fdebe7-9069-43ab-914b-21f84b7cf5f7-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:49.325565 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.325561    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24fdebe7-9069-43ab-914b-21f84b7cf5f7-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:49.325712 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.325571    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn8b4\" (UniqueName: \"kubernetes.io/projected/24fdebe7-9069-43ab-914b-21f84b7cf5f7-kube-api-access-gn8b4\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:26:49.437057 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.437014    2562 generic.go:356] "Generic (PLEG): container finished" podID="24fdebe7-9069-43ab-914b-21f84b7cf5f7" containerID="bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2" exitCode=0
Jul 07 19:26:49.437200 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.437075    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"
Jul 07 19:26:49.437200 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.437101    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5" event={"ID":"24fdebe7-9069-43ab-914b-21f84b7cf5f7","Type":"ContainerDied","Data":"bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2"}
Jul 07 19:26:49.437200 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.437144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5" event={"ID":"24fdebe7-9069-43ab-914b-21f84b7cf5f7","Type":"ContainerDied","Data":"61fcac3c1898a90e99f8a954d1a05f608a158cfbad4742c932fc625bb02239d9"}
Jul 07 19:26:49.437200 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.437161    2562 scope.go:117] "RemoveContainer" containerID="bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2"
Jul 07 19:26:49.445375 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.445351    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b21ebd-0f45-4c4a-bdea-e45a931b060b" path="/var/lib/kubelet/pods/96b21ebd-0f45-4c4a-bdea-e45a931b060b/volumes"
Jul 07 19:26:49.446724 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.446693    2562 scope.go:117] "RemoveContainer" containerID="bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2"
Jul 07 19:26:49.446958 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:26:49.446941    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2\": container with ID starting with bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2 not found: ID does not exist" containerID="bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2"
Jul 07 19:26:49.447009 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.446969    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2"} err="failed to get container status \"bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2\": rpc error: code = NotFound desc = could not find container \"bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2\": container with ID starting with bfd7afb9663352ef52ca43a054c148681ac5be63a37a7b0b120b34000aa499c2 not found: ID does not exist"
Jul 07 19:26:49.470766 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.470738    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"]
Jul 07 19:26:49.479962 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:49.479902    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/auth-test-model-6f2191-kserve-548468b987-nc5x5"]
Jul 07 19:26:51.445277 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:51.445232    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24fdebe7-9069-43ab-914b-21f84b7cf5f7" path="/var/lib/kubelet/pods/24fdebe7-9069-43ab-914b-21f84b7cf5f7/volumes"
Jul 07 19:26:56.118303 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:56.118248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:56.118680 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:56.118327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:56.130325 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:56.130304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:26:56.240810 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:56.240776    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:26:56.484209 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:26:56.484179    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:27:07.541421 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.541389    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"]
Jul 07 19:27:07.541840 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.541710    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b21ebd-0f45-4c4a-bdea-e45a931b060b" containerName="main"
Jul 07 19:27:07.541840 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.541720    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b21ebd-0f45-4c4a-bdea-e45a931b060b" containerName="main"
Jul 07 19:27:07.541840 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.541732    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24fdebe7-9069-43ab-914b-21f84b7cf5f7" containerName="main"
Jul 07 19:27:07.541840 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.541737    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="24fdebe7-9069-43ab-914b-21f84b7cf5f7" containerName="main"
Jul 07 19:27:07.541840 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.541813    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="24fdebe7-9069-43ab-914b-21f84b7cf5f7" containerName="main"
Jul 07 19:27:07.541840 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.541823    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="96b21ebd-0f45-4c4a-bdea-e45a931b060b" containerName="main"
Jul 07 19:27:07.546311 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.546292    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.550777 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.550754    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"kube-root-ca.crt\""
Jul 07 19:27:07.551387 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.551368    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"sub-test-model-6f2191-kserve-self-signed-certs\""
Jul 07 19:27:07.551480 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.551371    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"openshift-service-ca.crt\""
Jul 07 19:27:07.551480 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.551371    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"default-dockercfg-jzxbj\""
Jul 07 19:27:07.559888 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.559868    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"]
Jul 07 19:27:07.567725 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.567700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-dshm\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.567839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.567757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4bbf2a-c341-4064-a562-ce2724e4305a-tls-certs\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.567839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.567792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-home\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.567839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.567808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-tmp-dir\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.567839 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.567832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-model-cache\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.568079 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.567854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqtxc\" (UniqueName: \"kubernetes.io/projected/7b4bbf2a-c341-4064-a562-ce2724e4305a-kube-api-access-rqtxc\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668331 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4bbf2a-c341-4064-a562-ce2724e4305a-tls-certs\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668467 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-home\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668467 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-tmp-dir\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668467 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-model-cache\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668623 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqtxc\" (UniqueName: \"kubernetes.io/projected/7b4bbf2a-c341-4064-a562-ce2724e4305a-kube-api-access-rqtxc\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668684 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-dshm\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668766 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668746    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-home\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668824 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-tmp-dir\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.668824 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.668808    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-model-cache\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.670807 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.670786    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-dshm\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.671008 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.670987    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4bbf2a-c341-4064-a562-ce2724e4305a-tls-certs\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.679315 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.679291    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqtxc\" (UniqueName: \"kubernetes.io/projected/7b4bbf2a-c341-4064-a562-ce2724e4305a-kube-api-access-rqtxc\") pod \"sub-test-model-6f2191-kserve-85c58f7df7-xrck5\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") " pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.855801 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.855717    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:07.996729 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:07.996706    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"]
Jul 07 19:27:07.998924 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:27:07.998895    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b4bbf2a_c341_4064_a562_ce2724e4305a.slice/crio-8dc2826903d40047ef192666fc46c6d4a99f3357a16887dce02b76f0e978dc0c WatchSource:0}: Error finding container 8dc2826903d40047ef192666fc46c6d4a99f3357a16887dce02b76f0e978dc0c: Status 404 returned error can't find the container with id 8dc2826903d40047ef192666fc46c6d4a99f3357a16887dce02b76f0e978dc0c
Jul 07 19:27:08.533856 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:08.533812    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5" event={"ID":"7b4bbf2a-c341-4064-a562-ce2724e4305a","Type":"ContainerStarted","Data":"95804510cc8b1034f2545f78994573df502faabc5615e3173c4598ac22ae1492"}
Jul 07 19:27:08.533856 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:08.533857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5" event={"ID":"7b4bbf2a-c341-4064-a562-ce2724e4305a","Type":"ContainerStarted","Data":"8dc2826903d40047ef192666fc46c6d4a99f3357a16887dce02b76f0e978dc0c"}
Jul 07 19:27:08.555770 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:08.555724    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5" podStartSLOduration=1.5557101389999999 podStartE2EDuration="1.555710139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:27:08.553628407 +0000 UTC m=+2191.617105105" watchObservedRunningTime="2026-07-07 19:27:08.555710139 +0000 UTC m=+2191.619186837"
Jul 07 19:27:12.026687 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:12.026647    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:27:17.856158 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:17.856126    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:17.856724 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:17.856175    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:17.868615 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:17.868590    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:18.595198 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:18.595171    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:27:27.302636 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:27.302597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:27:44.706298 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:44.706234    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"]
Jul 07 19:27:45.543745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:45.543711    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"]
Jul 07 19:27:49.023090 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.023061    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"]
Jul 07 19:27:49.026799 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.026780    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.029012 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.028994    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-44233f\"/\"rate-test-model-44233f-kserve-self-signed-certs\""
Jul 07 19:27:49.033163 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.032947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87tw\" (UniqueName: \"kubernetes.io/projected/bf799402-5323-4d00-821d-a83818ddad9b-kube-api-access-n87tw\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.033163 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.032998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf799402-5323-4d00-821d-a83818ddad9b-tls-certs\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.033163 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.033052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-dshm\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.033163 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.033093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-tmp-dir\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.033163 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.033128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-home\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.033441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.033170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-model-cache\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.037301 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.037278    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"]
Jul 07 19:27:49.134621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.134591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf799402-5323-4d00-821d-a83818ddad9b-tls-certs\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.134621 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.134625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-dshm\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.134815 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.134650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-tmp-dir\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.134815 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.134672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-home\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.134815 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.134696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-model-cache\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.134815 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.134744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n87tw\" (UniqueName: \"kubernetes.io/projected/bf799402-5323-4d00-821d-a83818ddad9b-kube-api-access-n87tw\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.135102 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.135073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-tmp-dir\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.135212 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.135126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-model-cache\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.135212 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.135177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-home\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.136913 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.136895    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-dshm\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.137031 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.137015    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf799402-5323-4d00-821d-a83818ddad9b-tls-certs\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.144445 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.144426    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87tw\" (UniqueName: \"kubernetes.io/projected/bf799402-5323-4d00-821d-a83818ddad9b-kube-api-access-n87tw\") pod \"rate-test-model-44233f-kserve-67fbb456f9-qfqpq\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") " pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.336380 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.336295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:49.472967 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.472935    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"]
Jul 07 19:27:49.474454 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:27:49.474428    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf799402_5323_4d00_821d_a83818ddad9b.slice/crio-0c1b8369194e469084417d6433f1842a03fcbae516c85d9da2951e4d12b274b6 WatchSource:0}: Error finding container 0c1b8369194e469084417d6433f1842a03fcbae516c85d9da2951e4d12b274b6: Status 404 returned error can't find the container with id 0c1b8369194e469084417d6433f1842a03fcbae516c85d9da2951e4d12b274b6
Jul 07 19:27:49.610126 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.610054    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:27:49.744253 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.744213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq" event={"ID":"bf799402-5323-4d00-821d-a83818ddad9b","Type":"ContainerStarted","Data":"45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2"}
Jul 07 19:27:49.744465 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.744255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq" event={"ID":"bf799402-5323-4d00-821d-a83818ddad9b","Type":"ContainerStarted","Data":"0c1b8369194e469084417d6433f1842a03fcbae516c85d9da2951e4d12b274b6"}
Jul 07 19:27:49.767485 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:49.767430    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq" podStartSLOduration=0.76741501 podStartE2EDuration="767.41501ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:27:49.766811169 +0000 UTC m=+2232.830287868" watchObservedRunningTime="2026-07-07 19:27:49.76741501 +0000 UTC m=+2232.830891708"
Jul 07 19:27:59.337548 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:59.337464    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:59.337548 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:59.337513    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:59.349680 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:59.349654    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:59.726952 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:59.726914    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc" podUID="44418767-5b8e-4f21-bc76-9d9f5c6137f0" containerName="main" containerID="cri-o://3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038" gracePeriod=45
Jul 07 19:27:59.811740 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:59.811711    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:27:59.979710 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:27:59.979648    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:28:00.029664 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029637    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-model-cache\") pod \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") "
Jul 07 19:28:00.029878 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tmp-dir\") pod \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") "
Jul 07 19:28:00.029878 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029757    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tls-certs\") pod \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") "
Jul 07 19:28:00.029878 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7vbm\" (UniqueName: \"kubernetes.io/projected/44418767-5b8e-4f21-bc76-9d9f5c6137f0-kube-api-access-b7vbm\") pod \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") "
Jul 07 19:28:00.029878 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029817    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-dshm\") pod \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") "
Jul 07 19:28:00.029878 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029855    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-home\") pod \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\" (UID: \"44418767-5b8e-4f21-bc76-9d9f5c6137f0\") "
Jul 07 19:28:00.030142 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029881    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "44418767-5b8e-4f21-bc76-9d9f5c6137f0" (UID: "44418767-5b8e-4f21-bc76-9d9f5c6137f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.030142 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.029975    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44418767-5b8e-4f21-bc76-9d9f5c6137f0" (UID: "44418767-5b8e-4f21-bc76-9d9f5c6137f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.030245 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.030139    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-home" (OuterVolumeSpecName: "home") pod "44418767-5b8e-4f21-bc76-9d9f5c6137f0" (UID: "44418767-5b8e-4f21-bc76-9d9f5c6137f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.030245 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.030143    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.030245 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.030175    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.031965 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.031943    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44418767-5b8e-4f21-bc76-9d9f5c6137f0" (UID: "44418767-5b8e-4f21-bc76-9d9f5c6137f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:28:00.031965 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.031941    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-dshm" (OuterVolumeSpecName: "dshm") pod "44418767-5b8e-4f21-bc76-9d9f5c6137f0" (UID: "44418767-5b8e-4f21-bc76-9d9f5c6137f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.032078 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.032038    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44418767-5b8e-4f21-bc76-9d9f5c6137f0-kube-api-access-b7vbm" (OuterVolumeSpecName: "kube-api-access-b7vbm") pod "44418767-5b8e-4f21-bc76-9d9f5c6137f0" (UID: "44418767-5b8e-4f21-bc76-9d9f5c6137f0"). InnerVolumeSpecName "kube-api-access-b7vbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:00.131226 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.131197    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44418767-5b8e-4f21-bc76-9d9f5c6137f0-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.131226 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.131222    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7vbm\" (UniqueName: \"kubernetes.io/projected/44418767-5b8e-4f21-bc76-9d9f5c6137f0-kube-api-access-b7vbm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.131226 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.131232    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.131441 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.131240    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44418767-5b8e-4f21-bc76-9d9f5c6137f0-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.564298 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.564238    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5" podUID="7b4bbf2a-c341-4064-a562-ce2724e4305a" containerName="main" containerID="cri-o://95804510cc8b1034f2545f78994573df502faabc5615e3173c4598ac22ae1492" gracePeriod=45
Jul 07 19:28:00.807366 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.807340    2562 generic.go:356] "Generic (PLEG): container finished" podID="44418767-5b8e-4f21-bc76-9d9f5c6137f0" containerID="3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038" exitCode=0
Jul 07 19:28:00.807483 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.807394    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"
Jul 07 19:28:00.807483 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.807412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc" event={"ID":"44418767-5b8e-4f21-bc76-9d9f5c6137f0","Type":"ContainerDied","Data":"3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038"}
Jul 07 19:28:00.807483 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.807450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc" event={"ID":"44418767-5b8e-4f21-bc76-9d9f5c6137f0","Type":"ContainerDied","Data":"6a74da410403fcaf778fbcebbca9b0ea7d05014c26fab96ec89162a273c6336d"}
Jul 07 19:28:00.807483 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.807468    2562 scope.go:117] "RemoveContainer" containerID="3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038"
Jul 07 19:28:00.808897 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.808869    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b4bbf2a-c341-4064-a562-ce2724e4305a" containerID="95804510cc8b1034f2545f78994573df502faabc5615e3173c4598ac22ae1492" exitCode=0
Jul 07 19:28:00.809002 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.808945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5" event={"ID":"7b4bbf2a-c341-4064-a562-ce2724e4305a","Type":"ContainerDied","Data":"95804510cc8b1034f2545f78994573df502faabc5615e3173c4598ac22ae1492"}
Jul 07 19:28:00.809002 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.808973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5" event={"ID":"7b4bbf2a-c341-4064-a562-ce2724e4305a","Type":"ContainerDied","Data":"8dc2826903d40047ef192666fc46c6d4a99f3357a16887dce02b76f0e978dc0c"}
Jul 07 19:28:00.809002 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.808993    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dc2826903d40047ef192666fc46c6d4a99f3357a16887dce02b76f0e978dc0c"
Jul 07 19:28:00.818305 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.818288    2562 scope.go:117] "RemoveContainer" containerID="3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038"
Jul 07 19:28:00.818783 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:28:00.818577    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038\": container with ID starting with 3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038 not found: ID does not exist" containerID="3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038"
Jul 07 19:28:00.818783 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.818615    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038"} err="failed to get container status \"3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038\": rpc error: code = NotFound desc = could not find container \"3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038\": container with ID starting with 3eda529dcc0b6ec0be0a17e524135809c4e446f81c6470da5f36f73c83ef8038 not found: ID does not exist"
Jul 07 19:28:00.822942 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.822925    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:28:00.833005 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.832983    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"]
Jul 07 19:28:00.837924 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.837903    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/sub-test-model-44233f-kserve-c4d776ff5-bbchc"]
Jul 07 19:28:00.937800 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.937777    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-model-cache\") pod \"7b4bbf2a-c341-4064-a562-ce2724e4305a\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") "
Jul 07 19:28:00.937948 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.937827    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4bbf2a-c341-4064-a562-ce2724e4305a-tls-certs\") pod \"7b4bbf2a-c341-4064-a562-ce2724e4305a\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") "
Jul 07 19:28:00.937948 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.937846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-home\") pod \"7b4bbf2a-c341-4064-a562-ce2724e4305a\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") "
Jul 07 19:28:00.937948 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.937900    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-dshm\") pod \"7b4bbf2a-c341-4064-a562-ce2724e4305a\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") "
Jul 07 19:28:00.937948 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.937933    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-tmp-dir\") pod \"7b4bbf2a-c341-4064-a562-ce2724e4305a\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") "
Jul 07 19:28:00.938153 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.937971    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqtxc\" (UniqueName: \"kubernetes.io/projected/7b4bbf2a-c341-4064-a562-ce2724e4305a-kube-api-access-rqtxc\") pod \"7b4bbf2a-c341-4064-a562-ce2724e4305a\" (UID: \"7b4bbf2a-c341-4064-a562-ce2724e4305a\") "
Jul 07 19:28:00.938153 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.938066    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-model-cache" (OuterVolumeSpecName: "model-cache") pod "7b4bbf2a-c341-4064-a562-ce2724e4305a" (UID: "7b4bbf2a-c341-4064-a562-ce2724e4305a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.938153 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.938122    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-home" (OuterVolumeSpecName: "home") pod "7b4bbf2a-c341-4064-a562-ce2724e4305a" (UID: "7b4bbf2a-c341-4064-a562-ce2724e4305a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.938334 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.938174    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7b4bbf2a-c341-4064-a562-ce2724e4305a" (UID: "7b4bbf2a-c341-4064-a562-ce2724e4305a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.938334 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.938304    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.938334 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.938318    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.938334 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.938331    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:00.940050 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.940024    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4bbf2a-c341-4064-a562-ce2724e4305a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7b4bbf2a-c341-4064-a562-ce2724e4305a" (UID: "7b4bbf2a-c341-4064-a562-ce2724e4305a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:28:00.940050 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.940034    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-dshm" (OuterVolumeSpecName: "dshm") pod "7b4bbf2a-c341-4064-a562-ce2724e4305a" (UID: "7b4bbf2a-c341-4064-a562-ce2724e4305a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:00.940191 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:00.940119    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4bbf2a-c341-4064-a562-ce2724e4305a-kube-api-access-rqtxc" (OuterVolumeSpecName: "kube-api-access-rqtxc") pod "7b4bbf2a-c341-4064-a562-ce2724e4305a" (UID: "7b4bbf2a-c341-4064-a562-ce2724e4305a"). InnerVolumeSpecName "kube-api-access-rqtxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:01.039419 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:01.039388    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4bbf2a-c341-4064-a562-ce2724e4305a-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:01.039419 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:01.039416    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b4bbf2a-c341-4064-a562-ce2724e4305a-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:01.039419 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:01.039426    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqtxc\" (UniqueName: \"kubernetes.io/projected/7b4bbf2a-c341-4064-a562-ce2724e4305a-kube-api-access-rqtxc\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:28:01.446529 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:01.446493    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44418767-5b8e-4f21-bc76-9d9f5c6137f0" path="/var/lib/kubelet/pods/44418767-5b8e-4f21-bc76-9d9f5c6137f0/volumes"
Jul 07 19:28:01.815863 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:01.815786    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"
Jul 07 19:28:01.833403 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:01.833376    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"]
Jul 07 19:28:01.837928 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:01.837891    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/sub-test-model-6f2191-kserve-85c58f7df7-xrck5"]
Jul 07 19:28:03.449451 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:03.447319    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b4bbf2a-c341-4064-a562-ce2724e4305a" path="/var/lib/kubelet/pods/7b4bbf2a-c341-4064-a562-ce2724e4305a/volumes"
Jul 07 19:28:04.112293 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:04.112244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:28:12.848554 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.848514    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"]
Jul 07 19:28:12.849025 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.848987    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4bbf2a-c341-4064-a562-ce2724e4305a" containerName="main"
Jul 07 19:28:12.849025 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.849005    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4bbf2a-c341-4064-a562-ce2724e4305a" containerName="main"
Jul 07 19:28:12.849025 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.849023    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44418767-5b8e-4f21-bc76-9d9f5c6137f0" containerName="main"
Jul 07 19:28:12.849184 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.849030    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="44418767-5b8e-4f21-bc76-9d9f5c6137f0" containerName="main"
Jul 07 19:28:12.849184 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.849128    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="44418767-5b8e-4f21-bc76-9d9f5c6137f0" containerName="main"
Jul 07 19:28:12.849184 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.849142    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b4bbf2a-c341-4064-a562-ce2724e4305a" containerName="main"
Jul 07 19:28:12.852084 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.852063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:12.855939 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.855904    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"openshift-service-ca.crt\""
Jul 07 19:28:12.857057 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.857038    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"kube-root-ca.crt\""
Jul 07 19:28:12.857461 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.857434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"default-dockercfg-jzxbj\""
Jul 07 19:28:12.857568 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.857460    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6f2191\"/\"rate-test-model-6f2191-kserve-self-signed-certs\""
Jul 07 19:28:12.867863 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.867840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"]
Jul 07 19:28:12.940978 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.940952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-home\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:12.941139 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.940980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-model-cache\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:12.941139 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.941019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm7h5\" (UniqueName: \"kubernetes.io/projected/44d548a4-4845-4549-b8df-8bbaf4342c69-kube-api-access-jm7h5\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:12.941139 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.941122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-tmp-dir\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:12.941241 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.941164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-dshm\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:12.941241 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:12.941207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44d548a4-4845-4549-b8df-8bbaf4342c69-tls-certs\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042123 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-dshm\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042300 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44d548a4-4845-4549-b8df-8bbaf4342c69-tls-certs\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042300 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-home\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042300 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-model-cache\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042300 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7h5\" (UniqueName: \"kubernetes.io/projected/44d548a4-4845-4549-b8df-8bbaf4342c69-kube-api-access-jm7h5\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042514 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-tmp-dir\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042624 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042600    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-home\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042762 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-model-cache\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.042762 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.042653    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-tmp-dir\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.044520 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.044488    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-dshm\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.044778 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.044756    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44d548a4-4845-4549-b8df-8bbaf4342c69-tls-certs\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.051147 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.051126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7h5\" (UniqueName: \"kubernetes.io/projected/44d548a4-4845-4549-b8df-8bbaf4342c69-kube-api-access-jm7h5\") pod \"rate-test-model-6f2191-kserve-877889999-fhnsn\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") " pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.162968 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.162887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:13.319625 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.319584    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"]
Jul 07 19:28:13.320902 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:28:13.320869    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44d548a4_4845_4549_b8df_8bbaf4342c69.slice/crio-bf24677ea572493147ad839780fc06a4de5a7d6a9f57bc5862c92a93fc7c0855 WatchSource:0}: Error finding container bf24677ea572493147ad839780fc06a4de5a7d6a9f57bc5862c92a93fc7c0855: Status 404 returned error can't find the container with id bf24677ea572493147ad839780fc06a4de5a7d6a9f57bc5862c92a93fc7c0855
Jul 07 19:28:13.879440 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.879401    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn" event={"ID":"44d548a4-4845-4549-b8df-8bbaf4342c69","Type":"ContainerStarted","Data":"07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea"}
Jul 07 19:28:13.879440 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.879444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn" event={"ID":"44d548a4-4845-4549-b8df-8bbaf4342c69","Type":"ContainerStarted","Data":"bf24677ea572493147ad839780fc06a4de5a7d6a9f57bc5862c92a93fc7c0855"}
Jul 07 19:28:13.899971 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:13.899910    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn" podStartSLOduration=1.899894655 podStartE2EDuration="1.899894655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:28:13.897393348 +0000 UTC m=+2256.960870045" watchObservedRunningTime="2026-07-07 19:28:13.899894655 +0000 UTC m=+2256.963371692"
Jul 07 19:28:18.811051 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:18.811014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:28:23.163379 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:23.163339    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:23.163799 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:23.163416    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:23.175367 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:23.175341    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:23.942570 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:23.942541    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:28:32.702217 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:32.702180    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:28:47.401879 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:47.401844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:28:54.288225 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:54.288193    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"]
Jul 07 19:28:55.343501 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:28:55.343474    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"]
Jul 07 19:29:00.495869 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:00.495833    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:29:09.308160 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.308119    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq" podUID="bf799402-5323-4d00-821d-a83818ddad9b" containerName="main" containerID="cri-o://45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2" gracePeriod=45
Jul 07 19:29:09.565686 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.565625    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:29:09.716577 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716547    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-model-cache\") pod \"bf799402-5323-4d00-821d-a83818ddad9b\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") "
Jul 07 19:29:09.716745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716583    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-dshm\") pod \"bf799402-5323-4d00-821d-a83818ddad9b\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") "
Jul 07 19:29:09.716745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-home\") pod \"bf799402-5323-4d00-821d-a83818ddad9b\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") "
Jul 07 19:29:09.716745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716657    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf799402-5323-4d00-821d-a83818ddad9b-tls-certs\") pod \"bf799402-5323-4d00-821d-a83818ddad9b\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") "
Jul 07 19:29:09.716745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716711    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-tmp-dir\") pod \"bf799402-5323-4d00-821d-a83818ddad9b\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") "
Jul 07 19:29:09.716745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716739    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n87tw\" (UniqueName: \"kubernetes.io/projected/bf799402-5323-4d00-821d-a83818ddad9b-kube-api-access-n87tw\") pod \"bf799402-5323-4d00-821d-a83818ddad9b\" (UID: \"bf799402-5323-4d00-821d-a83818ddad9b\") "
Jul 07 19:29:09.717012 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716844    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf799402-5323-4d00-821d-a83818ddad9b" (UID: "bf799402-5323-4d00-821d-a83818ddad9b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:09.717012 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716896    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-home" (OuterVolumeSpecName: "home") pod "bf799402-5323-4d00-821d-a83818ddad9b" (UID: "bf799402-5323-4d00-821d-a83818ddad9b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:09.717012 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.716973    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf799402-5323-4d00-821d-a83818ddad9b" (UID: "bf799402-5323-4d00-821d-a83818ddad9b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:09.717178 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.717047    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:09.717178 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.717067    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:09.717178 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.717082    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:09.718810 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.718776    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf799402-5323-4d00-821d-a83818ddad9b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf799402-5323-4d00-821d-a83818ddad9b" (UID: "bf799402-5323-4d00-821d-a83818ddad9b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:29:09.718915 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.718841    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-dshm" (OuterVolumeSpecName: "dshm") pod "bf799402-5323-4d00-821d-a83818ddad9b" (UID: "bf799402-5323-4d00-821d-a83818ddad9b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:09.718986 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.718963    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf799402-5323-4d00-821d-a83818ddad9b-kube-api-access-n87tw" (OuterVolumeSpecName: "kube-api-access-n87tw") pod "bf799402-5323-4d00-821d-a83818ddad9b" (UID: "bf799402-5323-4d00-821d-a83818ddad9b"). InnerVolumeSpecName "kube-api-access-n87tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:09.817868 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.817795    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf799402-5323-4d00-821d-a83818ddad9b-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:09.817868 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.817819    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf799402-5323-4d00-821d-a83818ddad9b-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:09.817868 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:09.817832    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n87tw\" (UniqueName: \"kubernetes.io/projected/bf799402-5323-4d00-821d-a83818ddad9b-kube-api-access-n87tw\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:10.188792 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.188757    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf799402-5323-4d00-821d-a83818ddad9b" containerID="45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2" exitCode=0
Jul 07 19:29:10.188954 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.188795    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"
Jul 07 19:29:10.188954 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.188844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq" event={"ID":"bf799402-5323-4d00-821d-a83818ddad9b","Type":"ContainerDied","Data":"45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2"}
Jul 07 19:29:10.188954 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.188885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq" event={"ID":"bf799402-5323-4d00-821d-a83818ddad9b","Type":"ContainerDied","Data":"0c1b8369194e469084417d6433f1842a03fcbae516c85d9da2951e4d12b274b6"}
Jul 07 19:29:10.188954 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.188903    2562 scope.go:117] "RemoveContainer" containerID="45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2"
Jul 07 19:29:10.198706 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.198689    2562 scope.go:117] "RemoveContainer" containerID="45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2"
Jul 07 19:29:10.198906 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:29:10.198888    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2\": container with ID starting with 45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2 not found: ID does not exist" containerID="45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2"
Jul 07 19:29:10.198947 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.198921    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2"} err="failed to get container status \"45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2\": rpc error: code = NotFound desc = could not find container \"45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2\": container with ID starting with 45b8f838e99ab0ca1033333489d80fe7543c54c251ad29d4bb25587254808ad2 not found: ID does not exist"
Jul 07 19:29:10.210806 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.210785    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"]
Jul 07 19:29:10.215307 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.215289    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-44233f/rate-test-model-44233f-kserve-67fbb456f9-qfqpq"]
Jul 07 19:29:10.363169 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.363131    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn" podUID="44d548a4-4845-4549-b8df-8bbaf4342c69" containerName="main" containerID="cri-o://07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea" gracePeriod=45
Jul 07 19:29:10.597650 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.597622    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:29:10.725774 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.725701    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm7h5\" (UniqueName: \"kubernetes.io/projected/44d548a4-4845-4549-b8df-8bbaf4342c69-kube-api-access-jm7h5\") pod \"44d548a4-4845-4549-b8df-8bbaf4342c69\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") "
Jul 07 19:29:10.725774 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.725739    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-home\") pod \"44d548a4-4845-4549-b8df-8bbaf4342c69\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") "
Jul 07 19:29:10.725970 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.725864    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-model-cache\") pod \"44d548a4-4845-4549-b8df-8bbaf4342c69\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") "
Jul 07 19:29:10.725970 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.725920    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-tmp-dir\") pod \"44d548a4-4845-4549-b8df-8bbaf4342c69\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") "
Jul 07 19:29:10.725970 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.725955    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-dshm\") pod \"44d548a4-4845-4549-b8df-8bbaf4342c69\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") "
Jul 07 19:29:10.726135 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.725981    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44d548a4-4845-4549-b8df-8bbaf4342c69-tls-certs\") pod \"44d548a4-4845-4549-b8df-8bbaf4342c69\" (UID: \"44d548a4-4845-4549-b8df-8bbaf4342c69\") "
Jul 07 19:29:10.726135 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.725977    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-home" (OuterVolumeSpecName: "home") pod "44d548a4-4845-4549-b8df-8bbaf4342c69" (UID: "44d548a4-4845-4549-b8df-8bbaf4342c69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:10.726227 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.726105    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-model-cache" (OuterVolumeSpecName: "model-cache") pod "44d548a4-4845-4549-b8df-8bbaf4342c69" (UID: "44d548a4-4845-4549-b8df-8bbaf4342c69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:10.726227 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.726170    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44d548a4-4845-4549-b8df-8bbaf4342c69" (UID: "44d548a4-4845-4549-b8df-8bbaf4342c69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:10.726365 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.726238    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-tmp-dir\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:10.726365 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.726253    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-home\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:10.726365 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.726290    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-model-cache\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:10.727941 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.727905    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44d548a4-4845-4549-b8df-8bbaf4342c69-kube-api-access-jm7h5" (OuterVolumeSpecName: "kube-api-access-jm7h5") pod "44d548a4-4845-4549-b8df-8bbaf4342c69" (UID: "44d548a4-4845-4549-b8df-8bbaf4342c69"). InnerVolumeSpecName "kube-api-access-jm7h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:10.728055 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.728039    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44d548a4-4845-4549-b8df-8bbaf4342c69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44d548a4-4845-4549-b8df-8bbaf4342c69" (UID: "44d548a4-4845-4549-b8df-8bbaf4342c69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:29:10.728145 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.728131    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-dshm" (OuterVolumeSpecName: "dshm") pod "44d548a4-4845-4549-b8df-8bbaf4342c69" (UID: "44d548a4-4845-4549-b8df-8bbaf4342c69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:10.827283 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.827232    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44d548a4-4845-4549-b8df-8bbaf4342c69-dshm\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:10.827283 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.827258    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44d548a4-4845-4549-b8df-8bbaf4342c69-tls-certs\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:10.827283 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:10.827288    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm7h5\" (UniqueName: \"kubernetes.io/projected/44d548a4-4845-4549-b8df-8bbaf4342c69-kube-api-access-jm7h5\") on node \"ip-10-0-132-202.ec2.internal\" DevicePath \"\""
Jul 07 19:29:11.202234 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.202203    2562 generic.go:356] "Generic (PLEG): container finished" podID="44d548a4-4845-4549-b8df-8bbaf4342c69" containerID="07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea" exitCode=0
Jul 07 19:29:11.202424 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.202249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn" event={"ID":"44d548a4-4845-4549-b8df-8bbaf4342c69","Type":"ContainerDied","Data":"07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea"}
Jul 07 19:29:11.202424 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.202274    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"
Jul 07 19:29:11.202424 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.202300    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn" event={"ID":"44d548a4-4845-4549-b8df-8bbaf4342c69","Type":"ContainerDied","Data":"bf24677ea572493147ad839780fc06a4de5a7d6a9f57bc5862c92a93fc7c0855"}
Jul 07 19:29:11.202424 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.202321    2562 scope.go:117] "RemoveContainer" containerID="07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea"
Jul 07 19:29:11.211372 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.211350    2562 scope.go:117] "RemoveContainer" containerID="07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea"
Jul 07 19:29:11.211612 ip-10-0-132-202 kubenswrapper[2562]: E0707 19:29:11.211589    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea\": container with ID starting with 07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea not found: ID does not exist" containerID="07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea"
Jul 07 19:29:11.211706 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.211620    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea"} err="failed to get container status \"07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea\": rpc error: code = NotFound desc = could not find container \"07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea\": container with ID starting with 07658fd93953a1221ba92cd1809620ec203f7171b0d2bd7091b6300d51f6a0ea not found: ID does not exist"
Jul 07 19:29:11.223236 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.223214    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"]
Jul 07 19:29:11.227485 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.227465    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6f2191/rate-test-model-6f2191-kserve-877889999-fhnsn"]
Jul 07 19:29:11.445483 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.445442    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44d548a4-4845-4549-b8df-8bbaf4342c69" path="/var/lib/kubelet/pods/44d548a4-4845-4549-b8df-8bbaf4342c69/volumes"
Jul 07 19:29:11.445976 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:11.445952    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf799402-5323-4d00-821d-a83818ddad9b" path="/var/lib/kubelet/pods/bf799402-5323-4d00-821d-a83818ddad9b/volumes"
Jul 07 19:29:42.519070 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:42.519037    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9rxs8"]
Jul 07 19:29:47.458199 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:47.458165    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-989476477-z46p4_5f956065-4520-4d8b-9e6f-1f1489402001/authorino/0.log"
Jul 07 19:29:52.870064 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:52.870032    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pvxfq_6ac06b0f-c681-445c-a1ee-2535c7fed694/server/0.log"
Jul 07 19:29:52.989626 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:52.989582    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-97fxk_ddc5adc1-a487-464b-9192-9650aa776319/manager/0.log"
Jul 07 19:29:53.232352 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:53.232321    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-tfbzp_716cd3df-87f7-468c-ba71-eab814b9ae66/copy-manifests/0.log"
Jul 07 19:29:53.244900 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:53.244870    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-tfbzp_716cd3df-87f7-468c-ba71-eab814b9ae66/manager/0.log"
Jul 07 19:29:54.279786 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.279754    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh_989d42f2-89bd-4356-8ba6-e6bc7e9ace47/util/0.log"
Jul 07 19:29:54.286033 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.286005    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh_989d42f2-89bd-4356-8ba6-e6bc7e9ace47/pull/0.log"
Jul 07 19:29:54.292048 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.292025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh_989d42f2-89bd-4356-8ba6-e6bc7e9ace47/extract/0.log"
Jul 07 19:29:54.405527 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.405505    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f_6aaf425a-f82b-4e6a-9ce2-56f3f53b4327/util/0.log"
Jul 07 19:29:54.412989 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.412963    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f_6aaf425a-f82b-4e6a-9ce2-56f3f53b4327/pull/0.log"
Jul 07 19:29:54.420299 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.420282    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f_6aaf425a-f82b-4e6a-9ce2-56f3f53b4327/extract/0.log"
Jul 07 19:29:54.533478 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.533405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6_9e9cc02f-d35f-4020-9a23-75c9318f871b/extract/0.log"
Jul 07 19:29:54.539486 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.539464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6_9e9cc02f-d35f-4020-9a23-75c9318f871b/util/0.log"
Jul 07 19:29:54.546127 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.546106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6_9e9cc02f-d35f-4020-9a23-75c9318f871b/pull/0.log"
Jul 07 19:29:54.664869 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.664849    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x_d803e664-8821-4ee1-a2b8-c81e6c6ca21d/util/0.log"
Jul 07 19:29:54.672920 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.672903    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x_d803e664-8821-4ee1-a2b8-c81e6c6ca21d/pull/0.log"
Jul 07 19:29:54.680392 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.680377    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x_d803e664-8821-4ee1-a2b8-c81e6c6ca21d/extract/0.log"
Jul 07 19:29:54.798681 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:54.798603    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-989476477-z46p4_5f956065-4520-4d8b-9e6f-1f1489402001/authorino/0.log"
Jul 07 19:29:55.520281 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:55.520230    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9rxs8_ec7672cd-6c12-47f8-987e-179d55bc15c2/limitador/0.log"
Jul 07 19:29:56.264219 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:56.264186    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-gvm2l_38d105c7-2833-48f4-a043-756e77296986/kube-auth-proxy/0.log"
Jul 07 19:29:56.874574 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:56.874528    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8647695769-hvrjk_9bbc5329-2bf0-4743-bf87-1b24d0edbe3e/router/0.log"
Jul 07 19:29:57.828154 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:29:57.828122    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-mgwgq_939b9330-515e-4cee-86bd-e9457b2ff011/main/0.log"
Jul 07 19:30:01.982178 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.982141    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nkfb/must-gather-s2l69"]
Jul 07 19:30:01.982660 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.982640    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d548a4-4845-4549-b8df-8bbaf4342c69" containerName="main"
Jul 07 19:30:01.982707 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.982662    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d548a4-4845-4549-b8df-8bbaf4342c69" containerName="main"
Jul 07 19:30:01.982707 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.982684    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf799402-5323-4d00-821d-a83818ddad9b" containerName="main"
Jul 07 19:30:01.982707 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.982690    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf799402-5323-4d00-821d-a83818ddad9b" containerName="main"
Jul 07 19:30:01.982797 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.982759    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf799402-5323-4d00-821d-a83818ddad9b" containerName="main"
Jul 07 19:30:01.982797 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.982767    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="44d548a4-4845-4549-b8df-8bbaf4342c69" containerName="main"
Jul 07 19:30:01.986206 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.986178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:01.987610 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.987587    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nkfb/must-gather-s2l69"]
Jul 07 19:30:01.988546 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.988517    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nkfb\"/\"openshift-service-ca.crt\""
Jul 07 19:30:01.989141 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.989117    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nkfb\"/\"kube-root-ca.crt\""
Jul 07 19:30:01.989230 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:01.989127    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4nkfb\"/\"default-dockercfg-br8pn\""
Jul 07 19:30:02.065601 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.065573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06d00420-7825-42f7-8843-4b8e74a481a7-must-gather-output\") pod \"must-gather-s2l69\" (UID: \"06d00420-7825-42f7-8843-4b8e74a481a7\") " pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:02.065813 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.065629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vst6z\" (UniqueName: \"kubernetes.io/projected/06d00420-7825-42f7-8843-4b8e74a481a7-kube-api-access-vst6z\") pod \"must-gather-s2l69\" (UID: \"06d00420-7825-42f7-8843-4b8e74a481a7\") " pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:02.166898 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.166857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vst6z\" (UniqueName: \"kubernetes.io/projected/06d00420-7825-42f7-8843-4b8e74a481a7-kube-api-access-vst6z\") pod \"must-gather-s2l69\" (UID: \"06d00420-7825-42f7-8843-4b8e74a481a7\") " pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:02.167083 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.166969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06d00420-7825-42f7-8843-4b8e74a481a7-must-gather-output\") pod \"must-gather-s2l69\" (UID: \"06d00420-7825-42f7-8843-4b8e74a481a7\") " pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:02.167327 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.167308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06d00420-7825-42f7-8843-4b8e74a481a7-must-gather-output\") pod \"must-gather-s2l69\" (UID: \"06d00420-7825-42f7-8843-4b8e74a481a7\") " pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:02.176797 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.176775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vst6z\" (UniqueName: \"kubernetes.io/projected/06d00420-7825-42f7-8843-4b8e74a481a7-kube-api-access-vst6z\") pod \"must-gather-s2l69\" (UID: \"06d00420-7825-42f7-8843-4b8e74a481a7\") " pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:02.295908 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.295830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nkfb/must-gather-s2l69"
Jul 07 19:30:02.431566 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.431539    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nkfb/must-gather-s2l69"]
Jul 07 19:30:02.433352 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:30:02.433326    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06d00420_7825_42f7_8843_4b8e74a481a7.slice/crio-02a2fd03d7684fa9d88dccd7a6adb8ac7d0e7a5e6ecf2022a3eef68abfceb8d0 WatchSource:0}: Error finding container 02a2fd03d7684fa9d88dccd7a6adb8ac7d0e7a5e6ecf2022a3eef68abfceb8d0: Status 404 returned error can't find the container with id 02a2fd03d7684fa9d88dccd7a6adb8ac7d0e7a5e6ecf2022a3eef68abfceb8d0
Jul 07 19:30:02.435174 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.435160    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:30:02.466894 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:02.466861    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nkfb/must-gather-s2l69" event={"ID":"06d00420-7825-42f7-8843-4b8e74a481a7","Type":"ContainerStarted","Data":"02a2fd03d7684fa9d88dccd7a6adb8ac7d0e7a5e6ecf2022a3eef68abfceb8d0"}
Jul 07 19:30:04.481124 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:04.481080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nkfb/must-gather-s2l69" event={"ID":"06d00420-7825-42f7-8843-4b8e74a481a7","Type":"ContainerStarted","Data":"82c37300c1e2558827680eea9d55b3a8bf9d10efda036cf70ea64110b8f52d89"}
Jul 07 19:30:04.481543 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:04.481139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nkfb/must-gather-s2l69" event={"ID":"06d00420-7825-42f7-8843-4b8e74a481a7","Type":"ContainerStarted","Data":"05e2332636a7fa1e8f26bb09c4b11afcb34658bd191ff7da9070dd1be4734b3b"}
Jul 07 19:30:04.498234 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:04.498163    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nkfb/must-gather-s2l69" podStartSLOduration=2.419870534 podStartE2EDuration="3.498141953s" totalImagesPullingTime="1.078271419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:30:04.497574242 +0000 UTC m=+2367.561050943" watchObservedRunningTime="2026-07-07 19:30:04.498141953 +0000 UTC m=+2367.561618667"
Jul 07 19:30:05.104733 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:05.104704    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5825v_2fa182a1-163e-474f-a336-fd278f564914/global-pull-secret-syncer/0.log"
Jul 07 19:30:05.326985 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:05.326949    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jhrk5_0afc186c-a129-4603-8e41-a82b5015ab5d/konnectivity-agent/0.log"
Jul 07 19:30:05.401927 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:05.401853    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-202.ec2.internal_c8245c94532bb8528f3a95f6fc7b39d2/haproxy/0.log"
Jul 07 19:30:09.592492 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.592452    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh_989d42f2-89bd-4356-8ba6-e6bc7e9ace47/extract/0.log"
Jul 07 19:30:09.623750 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.623716    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh_989d42f2-89bd-4356-8ba6-e6bc7e9ace47/util/0.log"
Jul 07 19:30:09.654876 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.654843    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ck7sh_989d42f2-89bd-4356-8ba6-e6bc7e9ace47/pull/0.log"
Jul 07 19:30:09.686809 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.686751    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f_6aaf425a-f82b-4e6a-9ce2-56f3f53b4327/extract/0.log"
Jul 07 19:30:09.711858 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.711829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f_6aaf425a-f82b-4e6a-9ce2-56f3f53b4327/util/0.log"
Jul 07 19:30:09.747478 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.747439    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rnt6f_6aaf425a-f82b-4e6a-9ce2-56f3f53b4327/pull/0.log"
Jul 07 19:30:09.776978 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.776920    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6_9e9cc02f-d35f-4020-9a23-75c9318f871b/extract/0.log"
Jul 07 19:30:09.805094 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.805067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6_9e9cc02f-d35f-4020-9a23-75c9318f871b/util/0.log"
Jul 07 19:30:09.849745 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.849661    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737lld6_9e9cc02f-d35f-4020-9a23-75c9318f871b/pull/0.log"
Jul 07 19:30:09.887338 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.887226    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x_d803e664-8821-4ee1-a2b8-c81e6c6ca21d/extract/0.log"
Jul 07 19:30:09.947141 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.947116    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x_d803e664-8821-4ee1-a2b8-c81e6c6ca21d/util/0.log"
Jul 07 19:30:09.975027 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:09.974996    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1djg2x_d803e664-8821-4ee1-a2b8-c81e6c6ca21d/pull/0.log"
Jul 07 19:30:10.345454 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:10.345419    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-989476477-z46p4_5f956065-4520-4d8b-9e6f-1f1489402001/authorino/0.log"
Jul 07 19:30:10.691274 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:10.691234    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9rxs8_ec7672cd-6c12-47f8-987e-179d55bc15c2/limitador/0.log"
Jul 07 19:30:12.593288 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:12.593237    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-dxk88_2f643423-faf7-4ab2-9a74-f2e47ae97560/cluster-monitoring-operator/0.log"
Jul 07 19:30:12.630937 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:12.630885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xrtgf_ac246d33-36de-4f01-8c54-4732880fe614/kube-state-metrics/0.log"
Jul 07 19:30:12.650699 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:12.650671    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xrtgf_ac246d33-36de-4f01-8c54-4732880fe614/kube-rbac-proxy-main/0.log"
Jul 07 19:30:12.679874 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:12.679832    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xrtgf_ac246d33-36de-4f01-8c54-4732880fe614/kube-rbac-proxy-self/0.log"
Jul 07 19:30:12.783883 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:12.783789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cw8d_0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a/node-exporter/0.log"
Jul 07 19:30:12.811094 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:12.811064    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cw8d_0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a/kube-rbac-proxy/0.log"
Jul 07 19:30:12.837314 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:12.837284    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8cw8d_0ffd3fd9-e8e9-4dbc-bc47-902043a8f98a/init-textfile/0.log"
Jul 07 19:30:13.392411 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:13.392379    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xlbgz_bd368f4e-5d49-4121-9228-ffa9e590a4d6/prometheus-operator/0.log"
Jul 07 19:30:13.416141 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:13.416100    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xlbgz_bd368f4e-5d49-4121-9228-ffa9e590a4d6/kube-rbac-proxy/0.log"
Jul 07 19:30:14.747301 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.747252    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"]
Jul 07 19:30:14.752802 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.752777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:14.772552 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.772524    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"]
Jul 07 19:30:14.901280 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.901237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-proc\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:14.901449 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.901305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-podres\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:14.901449 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.901332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz26h\" (UniqueName: \"kubernetes.io/projected/7e3935e5-95ba-4912-98f8-e1d4d38ca193-kube-api-access-bz26h\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:14.901449 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.901384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-lib-modules\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:14.901449 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:14.901406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-sys\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.001976 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.001886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-proc\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.002189 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.002086    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-proc\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.002483 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.002323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-podres\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.002639 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.002625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz26h\" (UniqueName: \"kubernetes.io/projected/7e3935e5-95ba-4912-98f8-e1d4d38ca193-kube-api-access-bz26h\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.003112 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.003091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-lib-modules\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.003311 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.003296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-sys\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.003459 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.003409    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-sys\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.003459 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.002435    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-podres\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.003459 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.003365    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e3935e5-95ba-4912-98f8-e1d4d38ca193-lib-modules\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.013003 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.012972    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz26h\" (UniqueName: \"kubernetes.io/projected/7e3935e5-95ba-4912-98f8-e1d4d38ca193-kube-api-access-bz26h\") pod \"perf-node-gather-daemonset-6vjq6\" (UID: \"7e3935e5-95ba-4912-98f8-e1d4d38ca193\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.066309 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.066256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.243160 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.243126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"]
Jul 07 19:30:15.246505 ip-10-0-132-202 kubenswrapper[2562]: W0707 19:30:15.246482    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e3935e5_95ba_4912_98f8_e1d4d38ca193.slice/crio-1b5617c5ba56eb9b08cd6c5e7b0740181157d0a25564cac2e308002e488ec31d WatchSource:0}: Error finding container 1b5617c5ba56eb9b08cd6c5e7b0740181157d0a25564cac2e308002e488ec31d: Status 404 returned error can't find the container with id 1b5617c5ba56eb9b08cd6c5e7b0740181157d0a25564cac2e308002e488ec31d
Jul 07 19:30:15.566856 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.566768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6" event={"ID":"7e3935e5-95ba-4912-98f8-e1d4d38ca193","Type":"ContainerStarted","Data":"f9751b49a76bea3e1a05d4a79ed0e5bda3ee81b94759ae7f2b8da780f63e395c"}
Jul 07 19:30:15.566856 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.566825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6" event={"ID":"7e3935e5-95ba-4912-98f8-e1d4d38ca193","Type":"ContainerStarted","Data":"1b5617c5ba56eb9b08cd6c5e7b0740181157d0a25564cac2e308002e488ec31d"}
Jul 07 19:30:15.567097 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.566908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:15.567977 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.567955    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/2.log"
Jul 07 19:30:15.572004 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.571983    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tgmzp_66912b97-5b97-4e57-aa13-6338876cc559/console-operator/3.log"
Jul 07 19:30:15.586084 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:15.586044    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6" podStartSLOduration=1.586030928 podStartE2EDuration="1.586030928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:30:15.584874338 +0000 UTC m=+2378.648351036" watchObservedRunningTime="2026-07-07 19:30:15.586030928 +0000 UTC m=+2378.649507626"
Jul 07 19:30:16.727722 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:16.727692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-t4cv2_c1b50a37-3900-431f-83ae-e7997ca3ed3b/volume-data-source-validator/0.log"
Jul 07 19:30:17.876824 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:17.876799    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b7n7x_b72e3ba1-083d-49bb-9362-c0dbd9928bc6/dns/0.log"
Jul 07 19:30:17.902307 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:17.902279    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b7n7x_b72e3ba1-083d-49bb-9362-c0dbd9928bc6/kube-rbac-proxy/0.log"
Jul 07 19:30:18.053664 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:18.053636    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4v245_87f6027c-6f68-4d54-bce3-fabd01651d7c/dns-node-resolver/0.log"
Jul 07 19:30:18.735776 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:18.735749    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7kgjv_e38a176c-b277-4f30-8a72-770c49b6cd02/node-ca/0.log"
Jul 07 19:30:19.981101 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:19.981075    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-gvm2l_38d105c7-2833-48f4-a043-756e77296986/kube-auth-proxy/0.log"
Jul 07 19:30:20.187081 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:20.187054    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8647695769-hvrjk_9bbc5329-2bf0-4743-bf87-1b24d0edbe3e/router/0.log"
Jul 07 19:30:20.935585 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:20.935551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8fdgx_46abbced-4c33-43e0-b8f4-2bcdf4464edf/serve-healthcheck-canary/0.log"
Jul 07 19:30:21.438311 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:21.438280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-hz6b4_c0ee4d04-87c0-4489-89ee-b85237a6398a/insights-operator/0.log"
Jul 07 19:30:21.440841 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:21.440820    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-hz6b4_c0ee4d04-87c0-4489-89ee-b85237a6398a/insights-operator/1.log"
Jul 07 19:30:21.464234 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:21.464205    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jbws_6b91fee1-1f10-40f8-b3a9-94bb8bbe854b/kube-rbac-proxy/0.log"
Jul 07 19:30:21.487956 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:21.487921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jbws_6b91fee1-1f10-40f8-b3a9-94bb8bbe854b/exporter/0.log"
Jul 07 19:30:21.514254 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:21.514226    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jbws_6b91fee1-1f10-40f8-b3a9-94bb8bbe854b/extractor/0.log"
Jul 07 19:30:21.586063 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:21.586032    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-6vjq6"
Jul 07 19:30:24.408419 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:24.408387    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pvxfq_6ac06b0f-c681-445c-a1ee-2535c7fed694/server/0.log"
Jul 07 19:30:24.491224 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:24.491192    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-97fxk_ddc5adc1-a487-464b-9192-9650aa776319/manager/0.log"
Jul 07 19:30:24.642687 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:24.642657    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-tfbzp_716cd3df-87f7-468c-ba71-eab814b9ae66/manager/0.log"
Jul 07 19:30:24.664083 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:24.664046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-tfbzp_716cd3df-87f7-468c-ba71-eab814b9ae66/copy-manifests/0.log"
Jul 07 19:30:25.416629 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:25.416600    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-gvm2l_38d105c7-2833-48f4-a043-756e77296986/kube-auth-proxy/0.log"
Jul 07 19:30:25.584508 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:25.584479    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8647695769-hvrjk_9bbc5329-2bf0-4743-bf87-1b24d0edbe3e/router/0.log"
Jul 07 19:30:26.167289 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:26.167186    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-564669cfc7-9vvs7_0f70f204-b58f-4ca3-aeaa-17b665a36e0e/manager/0.log"
Jul 07 19:30:27.013347 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:27.013252    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-gvm2l_38d105c7-2833-48f4-a043-756e77296986/kube-auth-proxy/0.log"
Jul 07 19:30:27.186036 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:27.186003    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8647695769-hvrjk_9bbc5329-2bf0-4743-bf87-1b24d0edbe3e/router/0.log"
Jul 07 19:30:31.449703 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:31.449666    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-m68sl_5588527f-2b7a-47e2-95d3-0f10164a6c5f/kube-storage-version-migrator-operator/1.log"
Jul 07 19:30:31.451304 ip-10-0-132-202 kubenswrapper[2562]: I0707 19:30:31.451280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-m68sl_5588527f-2b7a-47e2-95d3-0f10164a6c5f/kube-storage-version-migrator-operator/0.log"