Jul 11 23:54:58.302307 ip-10-0-134-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 11 23:54:58.302324 ip-10-0-134-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 11 23:54:58.302338 ip-10-0-134-216 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 11 23:54:58.303077 ip-10-0-134-216 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 11 23:55:07.713290 ip-10-0-134-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 11 23:55:07.713309 ip-10-0-134-216 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d23907d313954f2793d508f8340e680a --
Jul 11 23:56:52.065401 ip-10-0-134-216 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.493489    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501388    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501415    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501419    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501423    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501426    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501429    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501432    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:56:52.606097 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501435    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:56:52.584384 ip-10-0-134-216 systemd[1]: Started Kubernetes Kubelet.
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501438    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501442    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501445    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501448    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501452    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501457    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501460    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501465    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501470    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501473    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501477    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501488    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501492    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501496    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501499    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501502    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501505    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501508    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501511    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:56:52.608635 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501514    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501517    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501520    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501523    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501526    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501530    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501533    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501536    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501540    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501543    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501546    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501549    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501552    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501555    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501558    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501561    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501564    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501570    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501575    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:56:52.609732 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501578    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501581    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501583    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501586    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501589    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501592    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501595    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501598    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501601    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501604    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501606    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501609    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501612    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501616    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501619    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501622    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501624    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501627    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501629    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501632    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:56:52.611057 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501635    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501637    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501642    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501646    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501650    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501655    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501658    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501662    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501665    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501668    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501672    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501675    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501678    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501681    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501684    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501687    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501690    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501693    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501695    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:56:52.612310 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501698    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501701    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501704    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501707    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501709    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501713    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501715    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501718    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501721    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501723    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501726    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501728    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501731    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.501734    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504016    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504028    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504032    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504035    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504038    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504042    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:56:52.613404 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504047    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504050    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504054    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504056    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504059    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504062    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504065    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504068    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504071    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504074    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504077    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504080    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504082    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504086    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504088    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504091    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504094    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504120    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504125    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504128    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:56:52.614551 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504132    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504136    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504139    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504142    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504145    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504148    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504151    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504154    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504157    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504160    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504163    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504166    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504169    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504172    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504175    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504177    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504183    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504187    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504191    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504193    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:56:52.615441 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504196    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504199    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504201    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504205    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504208    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504216    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504219    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504222    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504225    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504227    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504230    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504233    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504235    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504238    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504241    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504244    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504246    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504249    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504252    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:56:52.616911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504255    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504258    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504261    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504263    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504267    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504270    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504273    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504278    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504280    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504283    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504286    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504289    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504291    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504294    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504297    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504299    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504302    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504305    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504309    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504313    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:56:52.618132 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504316    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504320    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504324    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504328    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504331    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504346    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504351    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504354    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504358    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504360    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504363    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504366    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504369    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504372    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504860    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504865    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504868    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504871    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504877    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:56:52.619487 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504880    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504882    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504885    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504889    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504892    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504895    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504898    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504901    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504904    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504907    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504909    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504914    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504917    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504920    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504923    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504926    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504929    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504932    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504934    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504937    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:56:52.622605 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504940    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504942    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504945    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504948    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504950    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504953    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504957    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504961    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504965    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504968    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504971    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504975    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504979    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504981    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504984    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504987    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504990    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504993    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504996    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.504999    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:56:52.623742 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505002    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505004    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505007    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505011    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505018    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505021    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505028    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505031    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505034    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505037    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505040    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505043    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505047    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505050    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505053    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505056    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505059    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505062    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505065    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505068    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:56:52.624882 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505071    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505074    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505077    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505079    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505083    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505087    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505090    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505092    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505095    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505098    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505119    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505122    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505125    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505127    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505138    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505144    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505147    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505150    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505154    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:56:52.626448 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505157    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505160    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505163    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505166    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505169    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505172    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505174    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505177    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505180    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505184    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505187    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505190    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505193    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505196    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.505198    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505295    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505305    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505320    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505326    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505337    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505341    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 23:56:52.627384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505346    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505351    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505354    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505358    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505362    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505365    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505369    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505375    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505378    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505381    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505386    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505390    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505397    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505400    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505404    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505407    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505411    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505415    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505418    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505422    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505426    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505429    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505432    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505435    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 23:56:52.628541 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505439    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505442    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505448    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505451    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505454    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505458    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505461    2583 flags.go:64] FLAG: --enable-server="true"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505471    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505479    2583 flags.go:64] FLAG: --event-burst="100"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505482    2583 flags.go:64] FLAG: --event-qps="50"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505485    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505489    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505492    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505496    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505499    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505504    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505508    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505511    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505516    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505519    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505522    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505525    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505528    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505532    2583 flags.go:64] FLAG: --feature-gates=""
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505536    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 23:56:52.630169 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505539    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505543    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505546    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505549    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505553    2583 flags.go:64] FLAG: --help="false"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505556    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505559    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505563    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505566    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505569    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505573    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505576    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505579    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505583    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505586    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505596    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505600    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505603    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505606    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505609    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505612    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505615    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505620    2583 flags.go:64] FLAG: --lock-file=""
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505622    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 23:56:52.631512 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505626    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505631    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505637    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505640    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505643    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505646    2583 flags.go:64] FLAG: --logging-format="text"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505649    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505653    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505657    2583 flags.go:64] FLAG: --manifest-url=""
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505660    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505665    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505668    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505673    2583 flags.go:64] FLAG: --max-pods="110"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505676    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505680    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505683    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505686    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505689    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505692    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505696    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505707    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505710    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505714    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 23:56:52.632894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505718    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505727    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505734    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505737    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505740    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505743    2583 flags.go:64] FLAG: --port="10250"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505747    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505750    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-057b3070ca6c0f2ee"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505755    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505758    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505763    2583 flags.go:64] FLAG: --register-node="true"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505766    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505770    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505773    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505776    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505779    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505783    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505787    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505790    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505793    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505796    2583 flags.go:64] FLAG: --runonce="false"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505799    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505803    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505806    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505809    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 23:56:52.634077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505812    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505816    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505819    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505823    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505826    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505829    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505832    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505836    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505839    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505848    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505851    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505857    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505860    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505863    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505870    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505875    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505878    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505883    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505886    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505890    2583 flags.go:64] FLAG: --v="2"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505894    2583 flags.go:64] FLAG: --version="false"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505899    2583 flags.go:64] FLAG: --vmodule=""
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505903    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.505906    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506066    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:56:52.635528 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506070    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506074    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506077    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506080    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506083    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506086    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506089    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506092    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506094    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506097    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506116    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506119    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506159    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506164    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506167    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506171    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506174    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506188    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506191    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506194    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:56:52.636922 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506199    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506203    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506207    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506210    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506213    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506216    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506219    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506222    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506225    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506228    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506231    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506233    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506236    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506239    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506241    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506245    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506248    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506251    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506254    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506258    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:56:52.638319 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506260    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506263    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506266    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506269    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506272    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506275    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506279    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506284    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506286    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506289    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506300    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506303    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506306    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506309    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506312    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506315    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506318    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506321    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506323    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:56:52.639464 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506326    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506329    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506332    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506335    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506337    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506340    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506343    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506346    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506349    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506353    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506355    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506358    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506360    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506363    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506366    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506369    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506372    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506376    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506380    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:56:52.640614 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506383    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506386    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506389    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506392    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506395    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506404    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506408    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506412    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506414    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506417    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506420    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506423    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506425    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506428    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506431    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506433    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506436    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506439    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506442    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:56:52.641757 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.506444    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.507084    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.515348    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.515374    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.515395    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.515403    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515483    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515489    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515493    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515496    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515500    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515503    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515506    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515510    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:56:52.642911 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515513    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515517    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515520    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515522    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515525    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515528    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515531    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515535    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515537    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515541    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515544    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515547    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515550    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515553    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515556    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515559    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515561    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515564    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515569    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515573    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:56:52.643839 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515576    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515581    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515583    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515587    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515589    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515592    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515595    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515598    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515601    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515604    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515606    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515610    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515613    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515615    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515619    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515622    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515624    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515627    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515630    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515633    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:56:52.645665 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515636    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515641    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515645    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515649    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515651    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515654    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515657    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515660    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515663    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515666    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515669    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515672    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515675    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515677    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515681    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515683    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515686    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515689    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515692    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515695    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:56:52.646781 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515698    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515702    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515706    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515709    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515716    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515719    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515722    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515725    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515728    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515730    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515733    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515736    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515739    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515741    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515744    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515747    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515750    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515752    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515756    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:56:52.648590 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515758    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515761    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515764    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515767    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515770    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515773    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515776    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515779    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515782    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515785    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515788    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515791    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.515797    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515943    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515949    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 23:56:52.649508 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515953    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515956    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515959    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515964    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515967    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515970    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515974    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515977    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515980    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515983    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515986    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515990    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515992    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515996    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.515999    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516002    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516005    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516007    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516010    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 23:56:52.650678 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516012    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516015    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516018    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516021    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516024    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516026    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516029    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516032    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516035    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516039    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516041    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516046    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516048    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516051    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516054    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516056    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516061    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516064    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516066    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516069    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 23:56:52.651647 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516072    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516074    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516077    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516079    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516082    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516085    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516088    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516090    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516093    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516096    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516120    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516124    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516127    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516130    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516133    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516136    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516139    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516142    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516145    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516148    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 23:56:52.652628 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516152    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516155    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516157    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516162    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516164    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516169    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516172    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516175    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516181    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516184    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516187    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516190    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516193    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516195    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516198    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516201    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516206    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516210    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516213    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 23:56:52.653572 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516217    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516221    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516224    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516227    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516230    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516233    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516236    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516239    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516241    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516244    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516247    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516250    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516252    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516255    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516259    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516261    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516266    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516268    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 23:56:52.655874 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:52.516271    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.516277    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.516444    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.520351    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.521717    2583 server.go:1019] "Starting client certificate rotation"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.521833    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.521884    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.524343    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.525856    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.539024    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.541506    2583 log.go:25] "Validated CRI v1 image API"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.542589    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 23:56:52.657019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.546256    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 838adbf5-ed9e-4648-a3f3-54c4fee8578c:/dev/nvme0n1p4 e25121c5-016f-4c3d-bb65-a93697e053f0:/dev/nvme0n1p3]
Jul 11 23:56:52.658370 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.546278    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 23:56:52.658370 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.555633    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.556356    2583 manager.go:216] Machine: {Timestamp:2026-07-11 23:56:52.554939368 +0000 UTC m=+0.357848249 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100308 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aa593a0078415e045312777f5a818 SystemUUID:ec2aa593-a007-8415-e045-312777f5a818 BootID:d23907d3-1395-4f27-93d5-08f8340e680a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:b8:c2:30:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:b8:c2:30:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:8e:b2:23:a6:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.556502    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.556633    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.560912    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.560982    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.561759    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.561772    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.561787    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.562465    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.563939    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.567569    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.567915    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.567978    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.567998    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.568016    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.568035    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.568049    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 23:56:52.908317 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.568665    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.568709    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.572912    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575457    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575492    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575701    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575714    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575720    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575726    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575735    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.575741    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576084    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576107    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576118    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576124    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576134    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576142    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576944    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.576952    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.580893    2583 server.go:1268] "Started kubelet"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.581031    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.581040    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.581157    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.584120    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.585125    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.585250    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.586471    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.586884    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-216.ec2.internal.18c16193462c8386  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-216.ec2.internal,UID:ip-10-0-134-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-216.ec2.internal,},FirstTimestamp:2026-07-11 23:56:52.58083623 +0000 UTC m=+0.383745215,LastTimestamp:2026-07-11 23:56:52.58083623 +0000 UTC m=+0.383745215,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-216.ec2.internal,}"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.588596    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.589115    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.592974    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.592975    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.593313    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.593810    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.593812    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.593839    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.593991    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594000    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594291    2583 factory.go:55] Registering systemd factory
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594309    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594673    2583 factory.go:153] Registering CRI-O factory
Jul 11 23:56:52.932275 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594701    2583 factory.go:223] Registration of the crio container factory successfully
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594768    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594800    2583 factory.go:103] Registering Raw factory
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.594814    2583 manager.go:1196] Started watching for new ooms in manager
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.595651    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.595768    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.595792    2583 manager.go:349] Starting recovery of all containers
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.611429    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fhbqf"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.611461    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fhbqf"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.622169    2583 manager.go:354] Recovery completed
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.628582    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.631173    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.631214    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.631226    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.631956    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.631969    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.631970    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.632021    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.632940    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.632973    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.632983    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.633697    2583 policy_none.go:49] "None policy: Start"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.633713    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.633725    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.635280    2583 policy_none.go:47] "Start"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.661195    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-216.ec2.internal.18c16193492cefa0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-216.ec2.internal,UID:ip-10-0-134-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-216.ec2.internal,},FirstTimestamp:2026-07-11 23:56:52.631195552 +0000 UTC m=+0.434104433,LastTimestamp:2026-07-11 23:56:52.631195552 +0000 UTC m=+0.434104433,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-216.ec2.internal,}"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.693760    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.694045    2583 manager.go:337] "Starting Device Plugin manager"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.694121    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.694136    2583 server.go:87] "Starting device plugin registration server"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.694476    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.694490    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.694634    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.694716    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.694725    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.695296    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.695345    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.773715    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.775208    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 23:56:52.933978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.775256    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.775295    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.775339    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.777891    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.795151    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.796359    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.796394    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.796406    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.796433    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.801567    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-216.ec2.internal\" not found" node="ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.803441    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.803470    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-216.ec2.internal\": node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.825089    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.878682    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"]
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.878780    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.880021    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.880057    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.880072    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.882201    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.882365    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.882402    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.883169    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.883178    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.883198    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.883199    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.883207    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.883215    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.885072    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.885096    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.885938    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.885971    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.885982    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.894242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.894315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.935342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.894352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/555b18a426b488b1398d4227fda6ee59-config\") pod \"kube-apiserver-proxy-ip-10-0-134-216.ec2.internal\" (UID: \"555b18a426b488b1398d4227fda6ee59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.936541 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.919389    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-216.ec2.internal\" not found" node="ip-10-0-134-216.ec2.internal"
Jul 11 23:56:52.936541 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.925404    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:52.936541 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:52.925854    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-216.ec2.internal\" not found" node="ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.995281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.995334    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/555b18a426b488b1398d4227fda6ee59-config\") pod \"kube-apiserver-proxy-ip-10-0-134-216.ec2.internal\" (UID: \"555b18a426b488b1398d4227fda6ee59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.995352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.995289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.995405    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/555b18a426b488b1398d4227fda6ee59-config\") pod \"kube-apiserver-proxy-ip-10-0-134-216.ec2.internal\" (UID: \"555b18a426b488b1398d4227fda6ee59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:52.995391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.026466    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.198137 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.128105    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.442795 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.222021    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.442795 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.228240    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.442795 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.229419    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:53.442795 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.329108    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.442795 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.431229    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.643142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.521620    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 23:56:53.643142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.521825    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 23:56:53.643142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.531645    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.643142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.616686    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 23:51:52 +0000 UTC" deadline="2028-04-02 03:09:55.10172419 +0000 UTC"
Jul 11 23:56:53.643142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.616737    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15123h13m1.484991182s"
Jul 11 23:56:53.643142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.631838    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.856268 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.721974    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:56:53.856268 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.732196    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.856268 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.832312    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.917447 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.917416    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:56:53.932667 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:53.932614    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:53.947051 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:53.946996    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555b18a426b488b1398d4227fda6ee59.slice/crio-b027916ee09eedcc9fe4855e1bdd3c2b7e7b6e633f92bbd4a78d7e3b782ed991 WatchSource:0}: Error finding container b027916ee09eedcc9fe4855e1bdd3c2b7e7b6e633f92bbd4a78d7e3b782ed991: Status 404 returned error can't find the container with id b027916ee09eedcc9fe4855e1bdd3c2b7e7b6e633f92bbd4a78d7e3b782ed991
Jul 11 23:56:53.947230 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:53.947205    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5e62cf154ddbdbbccda45b7fc44e8f.slice/crio-dc27a268c692684dffe21dc89d18f7ce216aa37b28aa0307c576faa093ee5da8 WatchSource:0}: Error finding container dc27a268c692684dffe21dc89d18f7ce216aa37b28aa0307c576faa093ee5da8: Status 404 returned error can't find the container with id dc27a268c692684dffe21dc89d18f7ce216aa37b28aa0307c576faa093ee5da8
Jul 11 23:56:53.953741 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:53.953704    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 23:56:54.033017 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.032978    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 11 23:56:54.086571 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.086537    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:56:54.093612 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.093575    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:54.102987 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.102964    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 23:56:54.103973 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.103958    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 11 23:56:54.118092 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.118062    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 23:56:54.571128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.571073    2583 apiserver.go:52] "Watching apiserver"
Jul 11 23:56:54.583504 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.582978    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-bsh7p","openshift-dns/node-resolver-pmjfs","openshift-image-registry/node-ca-bk6s9","openshift-multus/multus-additional-cni-plugins-42stw","openshift-network-diagnostics/network-check-target-gngl6","openshift-network-operator/iptables-alerter-kt8vh","openshift-ovn-kubernetes/ovnkube-node-7hqx6","kube-system/global-pull-secret-syncer-hzf8m","kube-system/konnectivity-agent-dllr7","kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal","openshift-multus/multus-vg9rz","openshift-multus/network-metrics-daemon-72xrz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"]
Jul 11 23:56:54.584700 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.582126    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 23:56:54.586593 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.586567    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.588638 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.588604    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.588995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.588971    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 23:56:54.589122 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.588999    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wm9tk\""
Jul 11 23:56:54.589122 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.589106    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 23:56:54.590811 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.590787    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mkwd\""
Jul 11 23:56:54.591393 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.590996    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 23:56:54.591393 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.591134    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 23:56:54.591393 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.591355    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.593432 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.593413    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 23:56:54.593905 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.593885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 23:56:54.594116 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.594100    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 23:56:54.594350 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.594319    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bcljm\""
Jul 11 23:56:54.595019 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.595000    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 23:56:54.595835 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.595817    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:54.595940 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.595916    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:56:54.597086 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.596554    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.600160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.599413    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 23:56:54.600160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.599431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.600160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.599621    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 23:56:54.600160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.599681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 23:56:54.600160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.599838    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dv9nd\""
Jul 11 23:56:54.600160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.599951    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 23:56:54.601805 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.601786    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.602358 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.602216    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 23:56:54.603791 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.603300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 23:56:54.603791 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.603311    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 23:56:54.603791 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.603478    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 23:56:54.603791 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.603505    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 23:56:54.603791 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.603628    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 23:56:54.603791 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.603704    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lz5t4\""
Jul 11 23:56:54.604208 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.604189    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q7gl5\""
Jul 11 23:56:54.604634 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.604605    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:56:54.604863 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.604844    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 23:56:54.604997 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.604973    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.605103 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.605077    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:56:54.605262 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-daemon-config\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605326 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqh2s\" (UniqueName: \"kubernetes.io/projected/44efc80d-74e9-44dc-a0d2-be7d54a11c37-kube-api-access-rqh2s\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.605326 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-registration-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.605417 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-device-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.605417 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.605417 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-cni-bin\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605417 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44efc80d-74e9-44dc-a0d2-be7d54a11c37-hosts-file\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-socket-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gb2s\" (UniqueName: \"kubernetes.io/projected/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-kube-api-access-6gb2s\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c4ms\" (UniqueName: \"kubernetes.io/projected/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-kube-api-access-2c4ms\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605537    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-system-cni-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-os-release\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-kubelet\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-cni-multus\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605669    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-hostroot\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-socket-dir-parent\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/446412df-b4fa-40e1-b83f-ab84c0733f54-agent-certs\") pod \"konnectivity-agent-dllr7\" (UID: \"446412df-b4fa-40e1-b83f-ab84c0733f54\") " pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.605760 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/446412df-b4fa-40e1-b83f-ab84c0733f54-konnectivity-ca\") pod \"konnectivity-agent-dllr7\" (UID: \"446412df-b4fa-40e1-b83f-ab84c0733f54\") " pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-sys-fs\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605797    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-cnibin\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44efc80d-74e9-44dc-a0d2-be7d54a11c37-tmp-dir\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-cni-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c043f6b-5c14-4d22-b644-f469c65f3c3e-cni-binary-copy\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605920    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdlp\" (UniqueName: \"kubernetes.io/projected/2c043f6b-5c14-4d22-b644-f469c65f3c3e-kube-api-access-zfdlp\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-netns\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.605977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-multus-certs\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.606001    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.606126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-k8s-cni-cncf-io\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.606154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-conf-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606241 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.606184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-etc-kubernetes\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.606774 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.606669    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:54.609022 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.608996    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.609813 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.609789    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 23:56:54.610487 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.610471    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:54.610581 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.610542    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:56:54.611355 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.611334    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:56:54.612384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.611825    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 23:56:54.612384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.611867    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqlrj\""
Jul 11 23:56:54.612384 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.612083    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 23:56:54.613341 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.613322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.615676 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.615654    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv9tn\""
Jul 11 23:56:54.615993 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.615976    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 23:56:54.616349 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.616325    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 23:56:54.619073 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.619028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.621915 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.621479    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 23:56:54.621915 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.621644    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 23:56:54.621915 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.621714    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 23:56:54.621915 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.621811    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-crkvg\""
Jul 11 23:56:54.636170 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.636132    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rqwqc"
Jul 11 23:56:54.636851 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.636822    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rqwqc"
Jul 11 23:56:54.696844 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.696748    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 23:56:54.707249 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-ovn\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.707439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqh2s\" (UniqueName: \"kubernetes.io/projected/44efc80d-74e9-44dc-a0d2-be7d54a11c37-kube-api-access-rqh2s\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.707439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-registration-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.707439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-device-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.707439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-cni-bin\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.707439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707376    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-lib-modules\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.707439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-tuned\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.707439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44efc80d-74e9-44dc-a0d2-be7d54a11c37-hosts-file\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-socket-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-system-cni-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-os-release\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-kubelet\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zllqb\" (UniqueName: \"kubernetes.io/projected/cad83c12-f125-4b3b-8f23-d9dc346897c4-kube-api-access-zllqb\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-run\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-system-cni-dir\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-systemd\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.707771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-log-socket\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-socket-dir-parent\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-cnibin\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-system-cni-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44efc80d-74e9-44dc-a0d2-be7d54a11c37-tmp-dir\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-cni-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c043f6b-5c14-4d22-b644-f469c65f3c3e-cni-binary-copy\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-os-release\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysconfig\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707942    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8111f40c-5c61-4622-8d2f-74f8912f1517-ovn-node-metrics-cert\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-multus-certs\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.707988    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysctl-conf\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020df34c-91fe-445d-951f-bb7c6a1694b7-host\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-systemd-units\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-socket-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-k8s-cni-cncf-io\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e31c781-af27-43f5-ba5c-91fe3e687053-kubelet-config\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.708182 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708114    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-device-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-modprobe-d\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-registration-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-kubernetes\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-cni-bin\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708204    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysctl-d\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44efc80d-74e9-44dc-a0d2-be7d54a11c37-hosts-file\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708266    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-multus-certs\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708269    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-kubelet\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708299    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-socket-dir-parent\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-sys\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-kubelet\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708341    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-cnibin\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-cni-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-daemon-config\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-cnibin\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.709128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8gr8\" (UniqueName: \"kubernetes.io/projected/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-kube-api-access-w8gr8\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708536    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfkn4\" (UniqueName: \"kubernetes.io/projected/f09f9cdf-3e60-4775-81bb-8d054e27021a-kube-api-access-zfkn4\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-slash\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708610    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-etc-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708650    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44efc80d-74e9-44dc-a0d2-be7d54a11c37-tmp-dir\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-env-overrides\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gb2s\" (UniqueName: \"kubernetes.io/projected/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-kube-api-access-6gb2s\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708895    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c4ms\" (UniqueName: \"kubernetes.io/projected/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-kube-api-access-2c4ms\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e31c781-af27-43f5-ba5c-91fe3e687053-dbus\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708928    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c043f6b-5c14-4d22-b644-f469c65f3c3e-cni-binary-copy\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708948    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-var-lib-kubelet\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-run-ovn-kubernetes\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.708998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-cni-netd\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.709910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-cni-multus\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-k8s-cni-cncf-io\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-hostroot\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-hostroot\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-daemon-config\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709236    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-var-lib-cni-multus\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cad83c12-f125-4b3b-8f23-d9dc346897c4-host-slash\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-host\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-os-release\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-var-lib-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709416    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-cni-bin\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdlp\" (UniqueName: \"kubernetes.io/projected/2c043f6b-5c14-4d22-b644-f469c65f3c3e-kube-api-access-zfdlp\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/446412df-b4fa-40e1-b83f-ab84c0733f54-agent-certs\") pod \"konnectivity-agent-dllr7\" (UID: \"446412df-b4fa-40e1-b83f-ab84c0733f54\") " pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/446412df-b4fa-40e1-b83f-ab84c0733f54-konnectivity-ca\") pod \"konnectivity-agent-dllr7\" (UID: \"446412df-b4fa-40e1-b83f-ab84c0733f54\") " pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-sys-fs\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.710694 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-ovnkube-config\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-ovnkube-script-lib\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zzpm\" (UniqueName: \"kubernetes.io/projected/8111f40c-5c61-4622-8d2f-74f8912f1517-kube-api-access-2zzpm\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-cni-binary-copy\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/020df34c-91fe-445d-951f-bb7c6a1694b7-serviceca\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709795    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-node-log\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-netns\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709868    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-systemd\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-conf-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.709983    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-etc-kubernetes\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwqlq\" (UniqueName: \"kubernetes.io/projected/020df34c-91fe-445d-951f-bb7c6a1694b7-kube-api-access-zwqlq\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-run-netns\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cad83c12-f125-4b3b-8f23-d9dc346897c4-iptables-alerter-script\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.711493 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-tmp\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/446412df-b4fa-40e1-b83f-ab84c0733f54-konnectivity-ca\") pod \"konnectivity-agent-dllr7\" (UID: \"446412df-b4fa-40e1-b83f-ab84c0733f54\") " pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710342    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-host-run-netns\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-sys-fs\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710383    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-multus-conf-dir\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c043f6b-5c14-4d22-b644-f469c65f3c3e-etc-kubernetes\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.710713    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.710730    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:54.712362 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.710834    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs podName:fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b nodeName:}" failed. No retries permitted until 2026-07-11 23:56:55.210802848 +0000 UTC m=+3.013711733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs") pod "network-metrics-daemon-72xrz" (UID: "fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:54.716693 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.716493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/446412df-b4fa-40e1-b83f-ab84c0733f54-agent-certs\") pod \"konnectivity-agent-dllr7\" (UID: \"446412df-b4fa-40e1-b83f-ab84c0733f54\") " pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.717454 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.717426    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqh2s\" (UniqueName: \"kubernetes.io/projected/44efc80d-74e9-44dc-a0d2-be7d54a11c37-kube-api-access-rqh2s\") pod \"node-resolver-pmjfs\" (UID: \"44efc80d-74e9-44dc-a0d2-be7d54a11c37\") " pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.721485 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.721460    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdlp\" (UniqueName: \"kubernetes.io/projected/2c043f6b-5c14-4d22-b644-f469c65f3c3e-kube-api-access-zfdlp\") pod \"multus-vg9rz\" (UID: \"2c043f6b-5c14-4d22-b644-f469c65f3c3e\") " pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.721485 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.721477    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c4ms\" (UniqueName: \"kubernetes.io/projected/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-kube-api-access-2c4ms\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:54.723712 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.723683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gb2s\" (UniqueName: \"kubernetes.io/projected/c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce-kube-api-access-6gb2s\") pod \"aws-ebs-csi-driver-node-85tv9\" (UID: \"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.782873 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.782807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal" event={"ID":"555b18a426b488b1398d4227fda6ee59","Type":"ContainerStarted","Data":"b027916ee09eedcc9fe4855e1bdd3c2b7e7b6e633f92bbd4a78d7e3b782ed991"}
Jul 11 23:56:54.784409 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.784339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" event={"ID":"0e5e62cf154ddbdbbccda45b7fc44e8f","Type":"ContainerStarted","Data":"dc27a268c692684dffe21dc89d18f7ce216aa37b28aa0307c576faa093ee5da8"}
Jul 11 23:56:54.810862 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.810821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cad83c12-f125-4b3b-8f23-d9dc346897c4-host-slash\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.810874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-host\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.810903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-os-release\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.810925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.810950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-var-lib-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.810971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-cni-bin\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.810999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-ovnkube-config\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-ovnkube-script-lib\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811060    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zzpm\" (UniqueName: \"kubernetes.io/projected/8111f40c-5c61-4622-8d2f-74f8912f1517-kube-api-access-2zzpm\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-cni-binary-copy\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811150    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/020df34c-91fe-445d-951f-bb7c6a1694b7-serviceca\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-node-log\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-systemd\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwqlq\" (UniqueName: \"kubernetes.io/projected/020df34c-91fe-445d-951f-bb7c6a1694b7-kube-api-access-zwqlq\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-run-netns\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cad83c12-f125-4b3b-8f23-d9dc346897c4-iptables-alerter-script\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-tmp\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-ovn\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-lib-modules\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-tuned\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zllqb\" (UniqueName: \"kubernetes.io/projected/cad83c12-f125-4b3b-8f23-d9dc346897c4-kube-api-access-zllqb\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-run\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-system-cni-dir\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.811575 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-systemd\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-log-socket\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysconfig\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8111f40c-5c61-4622-8d2f-74f8912f1517-ovn-node-metrics-cert\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cad83c12-f125-4b3b-8f23-d9dc346897c4-host-slash\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysctl-conf\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020df34c-91fe-445d-951f-bb7c6a1694b7-host\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-host\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-systemd-units\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e31c781-af27-43f5-ba5c-91fe3e687053-kubelet-config\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-os-release\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-modprobe-d\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-kubernetes\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysctl-d\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-sys\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811881    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-kubelet\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-cnibin\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.812411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8gr8\" (UniqueName: \"kubernetes.io/projected/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-kube-api-access-w8gr8\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.811998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfkn4\" (UniqueName: \"kubernetes.io/projected/f09f9cdf-3e60-4775-81bb-8d054e27021a-kube-api-access-zfkn4\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-slash\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-etc-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-env-overrides\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-system-cni-dir\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e31c781-af27-43f5-ba5c-91fe3e687053-dbus\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812276    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-var-lib-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-var-lib-kubelet\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-systemd\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-run-ovn-kubernetes\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812353    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-cni-netd\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysctl-d\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-modprobe-d\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.813221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-sys\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812450    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e31c781-af27-43f5-ba5c-91fe3e687053-dbus\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812465    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812541    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-node-log\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysconfig\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.812634    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-lib-modules\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.812698    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.812764    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret podName:2e31c781-af27-43f5-ba5c-91fe3e687053 nodeName:}" failed. No retries permitted until 2026-07-11 23:56:55.31274258 +0000 UTC m=+3.115651448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret") pod "global-pull-secret-syncer-hzf8m" (UID: "2e31c781-af27-43f5-ba5c-91fe3e687053") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813010    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-systemd\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813031    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/020df34c-91fe-445d-951f-bb7c6a1694b7-serviceca\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813157    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-ovnkube-config\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-log-socket\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813375    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e31c781-af27-43f5-ba5c-91fe3e687053-kubelet-config\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-cni-binary-copy\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-ovn\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-kubernetes\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.814083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-run-netns\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814885 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.813729    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-ovnkube-script-lib\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814885 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.814246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cad83c12-f125-4b3b-8f23-d9dc346897c4-iptables-alerter-script\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.814885 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.814311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-slash\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814885 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.814688    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8111f40c-5c61-4622-8d2f-74f8912f1517-env-overrides\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814885 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.814769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-run-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.814885 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.814840    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-var-lib-kubelet\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.815191 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.814887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-run-ovn-kubernetes\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.815191 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-run\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.815292 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-cni-netd\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.815292 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815272    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-cni-bin\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.815389 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815310    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f09f9cdf-3e60-4775-81bb-8d054e27021a-cnibin\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.815389 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815325    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.815389 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815385    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020df34c-91fe-445d-951f-bb7c6a1694b7-host\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.815530 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815426    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-etc-openvswitch\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.815530 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815450    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-sysctl-conf\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.815530 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815470    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-host-kubelet\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.815530 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.815484    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8111f40c-5c61-4622-8d2f-74f8912f1517-systemd-units\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.816226 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.816202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-etc-tuned\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.816812 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.816790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8111f40c-5c61-4622-8d2f-74f8912f1517-ovn-node-metrics-cert\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.817167 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.817144    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:56:54.817254 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.817179    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:56:54.817254 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.817195    2583 projected.go:196] Error preparing data for projected volume kube-api-access-frfnh for pod openshift-network-diagnostics/network-check-target-gngl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:54.817396 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:54.817285    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh podName:aa91b425-bf1c-455f-a674-2bc69adc2488 nodeName:}" failed. No retries permitted until 2026-07-11 23:56:55.317262585 +0000 UTC m=+3.120171466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-frfnh" (UniqueName: "kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh") pod "network-check-target-gngl6" (UID: "aa91b425-bf1c-455f-a674-2bc69adc2488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:54.818090 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.818022    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-tmp\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.822350 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.821861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8gr8\" (UniqueName: \"kubernetes.io/projected/9854ab9c-9fe7-40f5-ad8d-7989e7b5037c-kube-api-access-w8gr8\") pod \"tuned-bsh7p\" (UID: \"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c\") " pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.822864 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.822837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwqlq\" (UniqueName: \"kubernetes.io/projected/020df34c-91fe-445d-951f-bb7c6a1694b7-kube-api-access-zwqlq\") pod \"node-ca-bk6s9\" (UID: \"020df34c-91fe-445d-951f-bb7c6a1694b7\") " pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:54.825625 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.825329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f09f9cdf-3e60-4775-81bb-8d054e27021a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.825625 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.825524    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfkn4\" (UniqueName: \"kubernetes.io/projected/f09f9cdf-3e60-4775-81bb-8d054e27021a-kube-api-access-zfkn4\") pod \"multus-additional-cni-plugins-42stw\" (UID: \"f09f9cdf-3e60-4775-81bb-8d054e27021a\") " pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.835806 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.835777    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zllqb\" (UniqueName: \"kubernetes.io/projected/cad83c12-f125-4b3b-8f23-d9dc346897c4-kube-api-access-zllqb\") pod \"iptables-alerter-kt8vh\" (UID: \"cad83c12-f125-4b3b-8f23-d9dc346897c4\") " pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.837542 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.837506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zzpm\" (UniqueName: \"kubernetes.io/projected/8111f40c-5c61-4622-8d2f-74f8912f1517-kube-api-access-2zzpm\") pod \"ovnkube-node-7hqx6\" (UID: \"8111f40c-5c61-4622-8d2f-74f8912f1517\") " pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.901893 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.901684    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:56:54.911203 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.911163    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pmjfs"
Jul 11 23:56:54.922289 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.922257    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9"
Jul 11 23:56:54.931883 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.931850    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 23:56:54.940170 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.940137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vg9rz"
Jul 11 23:56:54.950697 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.950668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:56:54.959977 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.959801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsh7p"
Jul 11 23:56:54.968941 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.968907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kt8vh"
Jul 11 23:56:54.979150 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.979114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-42stw"
Jul 11 23:56:54.984285 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:54.984259    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk6s9"
Jul 11 23:56:55.215823 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:55.215786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:55.216011 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.215908    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:55.216011 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.215969    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs podName:fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b nodeName:}" failed. No retries permitted until 2026-07-11 23:56:56.215954581 +0000 UTC m=+4.018863446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs") pod "network-metrics-daemon-72xrz" (UID: "fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:55.317073 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:55.317018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:55.317258 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.317198    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:55.317309 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.317273    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret podName:2e31c781-af27-43f5-ba5c-91fe3e687053 nodeName:}" failed. No retries permitted until 2026-07-11 23:56:56.317254812 +0000 UTC m=+4.120163676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret") pod "global-pull-secret-syncer-hzf8m" (UID: "2e31c781-af27-43f5-ba5c-91fe3e687053") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:55.418139 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:55.418100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:55.418317 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.418275    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:56:55.418317 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.418296    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:56:55.418317 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.418306    2583 projected.go:196] Error preparing data for projected volume kube-api-access-frfnh for pod openshift-network-diagnostics/network-check-target-gngl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:55.418426 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:55.418371    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh podName:aa91b425-bf1c-455f-a674-2bc69adc2488 nodeName:}" failed. No retries permitted until 2026-07-11 23:56:56.41834533 +0000 UTC m=+4.221254194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-frfnh" (UniqueName: "kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh") pod "network-check-target-gngl6" (UID: "aa91b425-bf1c-455f-a674-2bc69adc2488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:55.642028 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:55.641928    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 23:51:54 +0000 UTC" deadline="2028-03-26 01:06:02.643087998 +0000 UTC"
Jul 11 23:56:55.642028 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:55.641970    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14953h9m7.001123366s"
Jul 11 23:56:55.917819 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.917787    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9854ab9c_9fe7_40f5_ad8d_7989e7b5037c.slice/crio-73fa8781c47c2450017c6dfa35f44b64580805a174feea15d56268ce4051a6a7 WatchSource:0}: Error finding container 73fa8781c47c2450017c6dfa35f44b64580805a174feea15d56268ce4051a6a7: Status 404 returned error can't find the container with id 73fa8781c47c2450017c6dfa35f44b64580805a174feea15d56268ce4051a6a7
Jul 11 23:56:55.919164 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.919130    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44efc80d_74e9_44dc_a0d2_be7d54a11c37.slice/crio-70566b9e285bdd7d0b3977cbf157802deaf94d8330a625c6a4d25264df615387 WatchSource:0}: Error finding container 70566b9e285bdd7d0b3977cbf157802deaf94d8330a625c6a4d25264df615387: Status 404 returned error can't find the container with id 70566b9e285bdd7d0b3977cbf157802deaf94d8330a625c6a4d25264df615387
Jul 11 23:56:55.920187 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.920160    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8111f40c_5c61_4622_8d2f_74f8912f1517.slice/crio-6b24fe4ca98dae22cd5f80ae7078cda65ece5c653cb05b6bfea29cec1fbd932e WatchSource:0}: Error finding container 6b24fe4ca98dae22cd5f80ae7078cda65ece5c653cb05b6bfea29cec1fbd932e: Status 404 returned error can't find the container with id 6b24fe4ca98dae22cd5f80ae7078cda65ece5c653cb05b6bfea29cec1fbd932e
Jul 11 23:56:55.921656 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.921490    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020df34c_91fe_445d_951f_bb7c6a1694b7.slice/crio-273104beafb228143f88e01e8c68f0e6d62c33a3f16eb1dd1f7759b39a8189d3 WatchSource:0}: Error finding container 273104beafb228143f88e01e8c68f0e6d62c33a3f16eb1dd1f7759b39a8189d3: Status 404 returned error can't find the container with id 273104beafb228143f88e01e8c68f0e6d62c33a3f16eb1dd1f7759b39a8189d3
Jul 11 23:56:55.925662 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.925620    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c043f6b_5c14_4d22_b644_f469c65f3c3e.slice/crio-5a3d1ba7be642b88b5132551e96978a540ad95dc13d2eb47221c3b343f9fc33f WatchSource:0}: Error finding container 5a3d1ba7be642b88b5132551e96978a540ad95dc13d2eb47221c3b343f9fc33f: Status 404 returned error can't find the container with id 5a3d1ba7be642b88b5132551e96978a540ad95dc13d2eb47221c3b343f9fc33f
Jul 11 23:56:55.926775 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.926743    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad83c12_f125_4b3b_8f23_d9dc346897c4.slice/crio-76f8fc0366fe7173a8daa0f12a5bf006161c32e550c46c33ab555d289ee3870a WatchSource:0}: Error finding container 76f8fc0366fe7173a8daa0f12a5bf006161c32e550c46c33ab555d289ee3870a: Status 404 returned error can't find the container with id 76f8fc0366fe7173a8daa0f12a5bf006161c32e550c46c33ab555d289ee3870a
Jul 11 23:56:55.928136 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.927920    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09f9cdf_3e60_4775_81bb_8d054e27021a.slice/crio-74da24ed10be8f06629d903880b9fa498a2c7581d5a0a582f86b64d0e2a16a76 WatchSource:0}: Error finding container 74da24ed10be8f06629d903880b9fa498a2c7581d5a0a582f86b64d0e2a16a76: Status 404 returned error can't find the container with id 74da24ed10be8f06629d903880b9fa498a2c7581d5a0a582f86b64d0e2a16a76
Jul 11 23:56:55.932080 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:56:55.932022    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446412df_b4fa_40e1_b83f_ab84c0733f54.slice/crio-7e99756dfd35de6a452f7eecd0b8e2aa9df3aa529079d8eebe94ffba8f83d7b3 WatchSource:0}: Error finding container 7e99756dfd35de6a452f7eecd0b8e2aa9df3aa529079d8eebe94ffba8f83d7b3: Status 404 returned error can't find the container with id 7e99756dfd35de6a452f7eecd0b8e2aa9df3aa529079d8eebe94ffba8f83d7b3
Jul 11 23:56:56.225137 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.224909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:56.225335 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.225100    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:56.225335 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.225291    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs podName:fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b nodeName:}" failed. No retries permitted until 2026-07-11 23:56:58.225273483 +0000 UTC m=+6.028182360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs") pod "network-metrics-daemon-72xrz" (UID: "fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:56.325869 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.325831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:56.326090 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.325965    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:56.326090 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.326031    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret podName:2e31c781-af27-43f5-ba5c-91fe3e687053 nodeName:}" failed. No retries permitted until 2026-07-11 23:56:58.326012295 +0000 UTC m=+6.128921179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret") pod "global-pull-secret-syncer-hzf8m" (UID: "2e31c781-af27-43f5-ba5c-91fe3e687053") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:56.426458 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.426416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:56.426681 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.426650    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:56:56.426681 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.426677    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:56:56.426822 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.426690    2583 projected.go:196] Error preparing data for projected volume kube-api-access-frfnh for pod openshift-network-diagnostics/network-check-target-gngl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:56.426822 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.426757    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh podName:aa91b425-bf1c-455f-a674-2bc69adc2488 nodeName:}" failed. No retries permitted until 2026-07-11 23:56:58.426739431 +0000 UTC m=+6.229648298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-frfnh" (UniqueName: "kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh") pod "network-check-target-gngl6" (UID: "aa91b425-bf1c-455f-a674-2bc69adc2488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:56.643231 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.643147    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 23:51:54 +0000 UTC" deadline="2027-12-14 04:38:22.997206369 +0000 UTC"
Jul 11 23:56:56.643231 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.643191    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12484h41m26.354019784s"
Jul 11 23:56:56.777943 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.777854    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:56.778146 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.778010    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:56:56.778502 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.778476    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:56.778605 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.778585    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:56:56.778670 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.778651    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:56.778736 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:56.778719    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:56:56.819836 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.819753    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal" event={"ID":"555b18a426b488b1398d4227fda6ee59","Type":"ContainerStarted","Data":"5600a05ee166a9c68f41007a98e06340691dec729c819348604d938b051a80fb"}
Jul 11 23:56:56.839769 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.839566    2583 generic.go:356] "Generic (PLEG): container finished" podID="0e5e62cf154ddbdbbccda45b7fc44e8f" containerID="98513778ba2d5a7df2afb960832b10f9d860fd8fa43f20144882482ddd732ab2" exitCode=0
Jul 11 23:56:56.839769 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.839704    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" event={"ID":"0e5e62cf154ddbdbbccda45b7fc44e8f","Type":"ContainerDied","Data":"98513778ba2d5a7df2afb960832b10f9d860fd8fa43f20144882482ddd732ab2"}
Jul 11 23:56:56.843790 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.843746    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9" event={"ID":"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce","Type":"ContainerStarted","Data":"a77fa6efdd9b11a37213fccb20959b7f53111006359e422acc5fb788017cdce9"}
Jul 11 23:56:56.853701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.853420    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kt8vh" event={"ID":"cad83c12-f125-4b3b-8f23-d9dc346897c4","Type":"ContainerStarted","Data":"76f8fc0366fe7173a8daa0f12a5bf006161c32e550c46c33ab555d289ee3870a"}
Jul 11 23:56:56.856544 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.856481    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal" podStartSLOduration=2.8564577079999998 podStartE2EDuration="2.856457708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:56:56.836017795 +0000 UTC m=+4.638926683" watchObservedRunningTime="2026-07-11 23:56:56.856457708 +0000 UTC m=+4.659366596"
Jul 11 23:56:56.878073 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.877897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"6b24fe4ca98dae22cd5f80ae7078cda65ece5c653cb05b6bfea29cec1fbd932e"}
Jul 11 23:56:56.886357 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.886256    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsh7p" event={"ID":"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c","Type":"ContainerStarted","Data":"73fa8781c47c2450017c6dfa35f44b64580805a174feea15d56268ce4051a6a7"}
Jul 11 23:56:56.897891 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.897786    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dllr7" event={"ID":"446412df-b4fa-40e1-b83f-ab84c0733f54","Type":"ContainerStarted","Data":"7e99756dfd35de6a452f7eecd0b8e2aa9df3aa529079d8eebe94ffba8f83d7b3"}
Jul 11 23:56:56.910923 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.910885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerStarted","Data":"74da24ed10be8f06629d903880b9fa498a2c7581d5a0a582f86b64d0e2a16a76"}
Jul 11 23:56:56.926107 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.925991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vg9rz" event={"ID":"2c043f6b-5c14-4d22-b644-f469c65f3c3e","Type":"ContainerStarted","Data":"5a3d1ba7be642b88b5132551e96978a540ad95dc13d2eb47221c3b343f9fc33f"}
Jul 11 23:56:56.936215 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.936134    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk6s9" event={"ID":"020df34c-91fe-445d-951f-bb7c6a1694b7","Type":"ContainerStarted","Data":"273104beafb228143f88e01e8c68f0e6d62c33a3f16eb1dd1f7759b39a8189d3"}
Jul 11 23:56:56.940899 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:56.940814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pmjfs" event={"ID":"44efc80d-74e9-44dc-a0d2-be7d54a11c37","Type":"ContainerStarted","Data":"70566b9e285bdd7d0b3977cbf157802deaf94d8330a625c6a4d25264df615387"}
Jul 11 23:56:57.964732 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:57.964677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" event={"ID":"0e5e62cf154ddbdbbccda45b7fc44e8f","Type":"ContainerStarted","Data":"3c4e03c9af498d793755c67e20a088ec7f8cd3db04a50e8ee7d50a44d0fda279"}
Jul 11 23:56:58.245471 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:58.244829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:58.245471 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.245079    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:58.245471 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.245158    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs podName:fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b nodeName:}" failed. No retries permitted until 2026-07-11 23:57:02.245137032 +0000 UTC m=+10.048045915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs") pod "network-metrics-daemon-72xrz" (UID: "fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:56:58.345872 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:58.345831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:58.346099 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.346081    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:58.346183 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.346171    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret podName:2e31c781-af27-43f5-ba5c-91fe3e687053 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:02.346150454 +0000 UTC m=+10.149059324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret") pod "global-pull-secret-syncer-hzf8m" (UID: "2e31c781-af27-43f5-ba5c-91fe3e687053") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:56:58.446590 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:58.446549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:58.446789 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.446771    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:56:58.446848 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.446792    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:56:58.446848 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.446834    2583 projected.go:196] Error preparing data for projected volume kube-api-access-frfnh for pod openshift-network-diagnostics/network-check-target-gngl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:58.446953 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.446900    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh podName:aa91b425-bf1c-455f-a674-2bc69adc2488 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:02.446878934 +0000 UTC m=+10.249787804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-frfnh" (UniqueName: "kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh") pod "network-check-target-gngl6" (UID: "aa91b425-bf1c-455f-a674-2bc69adc2488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:56:58.778638 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:58.778600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:56:58.778831 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.778753    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:56:58.779254 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:58.779231    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:56:58.779394 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.779369    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:56:58.779453 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:56:58.779437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:56:58.779538 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:56:58.779520    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:00.778511 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:00.778422    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:00.778933 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:00.778562    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:00.778995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:00.778979    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:00.779131 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:00.779102    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:00.779245 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:00.779167    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:00.779299 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:00.779245    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:02.282319 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:02.282275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:02.282750 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.282460    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:02.282750 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.282535    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs podName:fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b nodeName:}" failed. No retries permitted until 2026-07-11 23:57:10.282512117 +0000 UTC m=+18.085421000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs") pod "network-metrics-daemon-72xrz" (UID: "fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:02.383606 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:02.383568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:02.383756 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.383723    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:02.383811 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.383796    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret podName:2e31c781-af27-43f5-ba5c-91fe3e687053 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:10.383776161 +0000 UTC m=+18.186685031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret") pod "global-pull-secret-syncer-hzf8m" (UID: "2e31c781-af27-43f5-ba5c-91fe3e687053") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:02.484494 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:02.484448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:02.484709 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.484680    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:02.484709 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.484704    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:02.484820 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.484718    2583 projected.go:196] Error preparing data for projected volume kube-api-access-frfnh for pod openshift-network-diagnostics/network-check-target-gngl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:02.484820 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.484789    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh podName:aa91b425-bf1c-455f-a674-2bc69adc2488 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:10.4847688 +0000 UTC m=+18.287677683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-frfnh" (UniqueName: "kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh") pod "network-check-target-gngl6" (UID: "aa91b425-bf1c-455f-a674-2bc69adc2488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:02.777433 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:02.777353    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:02.777433 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:02.777353    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:02.778639 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.778599    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:02.778785 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:02.778731    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:02.778785 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.778755    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:02.778887 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:02.778832    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:04.776313 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:04.776274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:04.776821 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:04.776286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:04.776821 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:04.776417    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:04.776821 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:04.776447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:04.776821 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:04.776563    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:04.776821 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:04.776661    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:06.776478 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:06.776440    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:06.776978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:06.776488    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:06.776978 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:06.776440    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:06.776978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:06.776594    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:06.776978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:06.776714    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:06.776978 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:06.776783    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:08.776320 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:08.776274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:08.776768 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:08.776274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:08.776768 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:08.776433    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:08.776768 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:08.776284    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:08.776768 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:08.776517    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:08.776768 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:08.776593    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:10.352767 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:10.352725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:10.353340 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.352865    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:10.353340 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.352934    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs podName:fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b nodeName:}" failed. No retries permitted until 2026-07-11 23:57:26.352915323 +0000 UTC m=+34.155824189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs") pod "network-metrics-daemon-72xrz" (UID: "fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:10.453733 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:10.453688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:10.453913 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.453844    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:10.453960 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.453918    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret podName:2e31c781-af27-43f5-ba5c-91fe3e687053 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:26.45389946 +0000 UTC m=+34.256808343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret") pod "global-pull-secret-syncer-hzf8m" (UID: "2e31c781-af27-43f5-ba5c-91fe3e687053") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:10.555134 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:10.555088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:10.555342 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.555310    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:10.555397 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.555344    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:10.555397 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.555360    2583 projected.go:196] Error preparing data for projected volume kube-api-access-frfnh for pod openshift-network-diagnostics/network-check-target-gngl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:10.555477 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.555426    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh podName:aa91b425-bf1c-455f-a674-2bc69adc2488 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:26.555411401 +0000 UTC m=+34.358320266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-frfnh" (UniqueName: "kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh") pod "network-check-target-gngl6" (UID: "aa91b425-bf1c-455f-a674-2bc69adc2488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:10.776517 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:10.776472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:10.776731 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:10.776472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:10.776731 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.776638    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:10.776731 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:10.776490    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:10.776731 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.776678    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:10.776943 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:10.776795    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:12.777030 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:12.776988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:12.777519 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:12.777129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:12.777519 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:12.777142    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:12.777519 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:12.777246    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:12.777519 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:12.777309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:12.777519 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:12.777378    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:14.776427 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:14.776386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:14.776866 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:14.776530    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:14.776866 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:14.776386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:14.776866 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:14.776633    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:14.776866 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:14.776386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:14.776866 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:14.776692    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:16.004889 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.004473    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9" event={"ID":"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce","Type":"ContainerStarted","Data":"8cef506c713cd44076cdea03d0c3b6a5c6dd279f5767fca4070597502758596b"}
Jul 11 23:57:16.009952 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.009914    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"c77415d12a74a35f8022767d7c1e9fc0184f82d31a4b7242dc8a6abd7d7da950"}
Jul 11 23:57:16.010161 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.010012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"4032ac444a4130572050adba7fbbdcde9514d81ffb94ddd167ebce9ed44cb169"}
Jul 11 23:57:16.010161 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.010104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"ee8549f4e887749444cda64063a2396d873133e1be24e832246fd2beef6a47bf"}
Jul 11 23:57:16.010161 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.010144    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"fa07df604c82755f7546c53edd67b13441c7d66d9ba6cb26a34ba2a452c1a618"}
Jul 11 23:57:16.010316 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.010181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"73f83675ee4bc4efcd6b25b19f62549fdce6cc96b097e80bab9bf5a11d2eb8ba"}
Jul 11 23:57:16.010316 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.010229    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"04f99aa7fc746a925002056fcc21e3504feedea00d8767dd0b6243bdc2bf4cf1"}
Jul 11 23:57:16.011627 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.011585    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsh7p" event={"ID":"9854ab9c-9fe7-40f5-ad8d-7989e7b5037c","Type":"ContainerStarted","Data":"08dc8921ab1e9f6e10c0f2a398364895b0f615018e9ce9b537ae266962807fe4"}
Jul 11 23:57:16.013237 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.013201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dllr7" event={"ID":"446412df-b4fa-40e1-b83f-ab84c0733f54","Type":"ContainerStarted","Data":"1d3e86631b3b7a4dd277a98e1a9093733807cff1e8e444c690101c7127bc1d4a"}
Jul 11 23:57:16.014926 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.014900    2583 generic.go:356] "Generic (PLEG): container finished" podID="f09f9cdf-3e60-4775-81bb-8d054e27021a" containerID="30a4695738ee28c2bc5809dfcacbbfc035eb349b10dbd284e075cb118f83eeee" exitCode=0
Jul 11 23:57:16.015203 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.014971    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerDied","Data":"30a4695738ee28c2bc5809dfcacbbfc035eb349b10dbd284e075cb118f83eeee"}
Jul 11 23:57:16.016761 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.016735    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vg9rz" event={"ID":"2c043f6b-5c14-4d22-b644-f469c65f3c3e","Type":"ContainerStarted","Data":"6ca7ae8089dca30f75aa9bc0f8074c95b5a89492eaf8740fb289a91bd0ee4899"}
Jul 11 23:57:16.018302 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.018271    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk6s9" event={"ID":"020df34c-91fe-445d-951f-bb7c6a1694b7","Type":"ContainerStarted","Data":"dc154e596d26aef24c61c0c2018edc7be88c728d8ff315d69b2f64aa2fd538fa"}
Jul 11 23:57:16.019894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.019862    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pmjfs" event={"ID":"44efc80d-74e9-44dc-a0d2-be7d54a11c37","Type":"ContainerStarted","Data":"5936b81691e67e462639c8229c74270c66b42445c9d1cb1d7b329112a5129d53"}
Jul 11 23:57:16.027634 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.027576    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" podStartSLOduration=22.027553466 podStartE2EDuration="22.027553466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:56:57.983684403 +0000 UTC m=+5.786593291" watchObservedRunningTime="2026-07-11 23:57:16.027553466 +0000 UTC m=+23.830462353"
Jul 11 23:57:16.027855 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.027826    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bsh7p" podStartSLOduration=3.889077677 podStartE2EDuration="23.02781803s" totalImagesPullingTime="19.138740353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:16.026963719 +0000 UTC m=+23.829872610" watchObservedRunningTime="2026-07-11 23:57:16.02781803 +0000 UTC m=+23.830726918"
Jul 11 23:57:16.040827 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.040729    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bk6s9" podStartSLOduration=3.929588864 podStartE2EDuration="23.040681252s" totalImagesPullingTime="19.111092388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:16.040141426 +0000 UTC m=+23.843050313" watchObservedRunningTime="2026-07-11 23:57:16.040681252 +0000 UTC m=+23.843590138"
Jul 11 23:57:16.053463 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.053398    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pmjfs" podStartSLOduration=8.637981047 podStartE2EDuration="24.053375779s" totalImagesPullingTime="15.415394732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:16.053195702 +0000 UTC m=+23.856104588" watchObservedRunningTime="2026-07-11 23:57:16.053375779 +0000 UTC m=+23.856284667"
Jul 11 23:57:16.079113 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.079026    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vg9rz" podStartSLOduration=4.910606591 podStartE2EDuration="24.079000787s" totalImagesPullingTime="19.168394196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:16.078955177 +0000 UTC m=+23.881864065" watchObservedRunningTime="2026-07-11 23:57:16.079000787 +0000 UTC m=+23.881909672"
Jul 11 23:57:16.111723 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.111651    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dllr7" podStartSLOduration=8.709605999 podStartE2EDuration="24.111630191s" totalImagesPullingTime="15.402024192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:16.111029386 +0000 UTC m=+23.913938274" watchObservedRunningTime="2026-07-11 23:57:16.111630191 +0000 UTC m=+23.914539075"
Jul 11 23:57:16.609063 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.609019    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 23:57:16.708403 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.708216    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T23:57:16.609054206Z","UUID":"60f8f1c3-ebed-4cff-b558-5ca23fba52b0","Handler":null,"Name":"","Endpoint":""}
Jul 11 23:57:16.710052 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.710011    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 23:57:16.710212 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.710072    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 23:57:16.779557 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.779528    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:16.779789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.779640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:16.779789 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:16.779649    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:16.779789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:16.779671    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:16.779965 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:16.779780    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:16.779965 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:16.779904    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:17.024852 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:17.024758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9" event={"ID":"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce","Type":"ContainerStarted","Data":"ed5a5cafe7c16428c775605fa17f1f019a0a54b97289c4e49e4a69af796b2191"}
Jul 11 23:57:17.026721 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:17.026669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kt8vh" event={"ID":"cad83c12-f125-4b3b-8f23-d9dc346897c4","Type":"ContainerStarted","Data":"c898d2d3324ae6879fb66de107c19c01b2fed5437612dac2d99229f0d1ad6249"}
Jul 11 23:57:17.041841 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:17.041771    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kt8vh" podStartSLOduration=4.939014243 podStartE2EDuration="24.041751426s" totalImagesPullingTime="19.102737183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:17.041204481 +0000 UTC m=+24.844113371" watchObservedRunningTime="2026-07-11 23:57:17.041751426 +0000 UTC m=+24.844660313"
Jul 11 23:57:18.034301 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:18.034239    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"0a4b3a6628ed919701961877dfc9dd1909562ed8a418b39f4511e5e098e4d111"}
Jul 11 23:57:18.037440 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:18.037372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9" event={"ID":"c6b4d9cc-e190-4fc3-990b-a0e0a2a2f2ce","Type":"ContainerStarted","Data":"b90828cab81e8f1350d560679debfc1773728ce144c7e72fc6249cdf1de88e2d"}
Jul 11 23:57:18.057588 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:18.057521    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85tv9" podStartSLOduration=4.683428894 podStartE2EDuration="26.05749627s" totalImagesPullingTime="21.374067376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:18.05647543 +0000 UTC m=+25.859384318" watchObservedRunningTime="2026-07-11 23:57:18.05749627 +0000 UTC m=+25.860405159"
Jul 11 23:57:18.775851 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:18.775796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:18.776083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:18.775858    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:18.776083 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:18.775796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:18.776083 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:18.775959    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:18.776253 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:18.776072    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:18.776253 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:18.776169    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:19.570558 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:19.570107    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:57:19.571075 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:19.570962    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:57:20.042445 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:20.042413    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:57:20.042956 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:20.042932    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dllr7"
Jul 11 23:57:20.775810 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:20.775596    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:20.776740 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:20.775594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:20.776740 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:20.775911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:20.776740 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:20.775625    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:20.776740 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:20.775981    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:20.776740 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:20.776105    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:21.048103 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:21.047970    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" event={"ID":"8111f40c-5c61-4622-8d2f-74f8912f1517","Type":"ContainerStarted","Data":"72b425c3b1ab8192eaf5eab9ed7925a8967394034416aab8e52d25e4016efc9d"}
Jul 11 23:57:21.049122 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:21.048883    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:57:21.052650 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:21.052612    2583 generic.go:356] "Generic (PLEG): container finished" podID="f09f9cdf-3e60-4775-81bb-8d054e27021a" containerID="d75846d144acb1296750a9cf1b28fd7f7a46d7d2d2c1f2d0638d9779590e3789" exitCode=0
Jul 11 23:57:21.052832 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:21.052715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerDied","Data":"d75846d144acb1296750a9cf1b28fd7f7a46d7d2d2c1f2d0638d9779590e3789"}
Jul 11 23:57:21.068960 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:21.068927    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:57:21.075390 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:21.075337    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" podStartSLOduration=8.88493986 podStartE2EDuration="28.075321278s" totalImagesPullingTime="19.190381418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:21.074754861 +0000 UTC m=+28.877663748" watchObservedRunningTime="2026-07-11 23:57:21.075321278 +0000 UTC m=+28.878230165"
Jul 11 23:57:22.054658 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.054632    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 11 23:57:22.055194 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.055066    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:57:22.071065 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.071021    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:57:22.731129 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.731088    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hzf8m"]
Jul 11 23:57:22.731337 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.731246    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:22.731414 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:22.731339    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:22.734853 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.734805    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gngl6"]
Jul 11 23:57:22.735119 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.734947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:22.735119 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:22.735050    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:22.735641 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.735605    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-72xrz"]
Jul 11 23:57:22.735767 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:22.735732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:22.735878 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:22.735852    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:23.059259 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:23.059162    2583 generic.go:356] "Generic (PLEG): container finished" podID="f09f9cdf-3e60-4775-81bb-8d054e27021a" containerID="cd4b30b59320c45022821858a0a7e3ae0ba2b733e70906b76f5f8e0fe2b72f59" exitCode=0
Jul 11 23:57:23.059722 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:23.059253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerDied","Data":"cd4b30b59320c45022821858a0a7e3ae0ba2b733e70906b76f5f8e0fe2b72f59"}
Jul 11 23:57:23.059722 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:23.059340    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 11 23:57:24.061139 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:24.061109    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 11 23:57:24.546842 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:24.546804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:57:24.775779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:24.775739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:24.775989 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:24.775739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:24.775989 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:24.775865    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:24.775989 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:24.775962    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:24.775989 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:24.775739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:24.776201 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:24.776084    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:25.065830 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:25.065741    2583 generic.go:356] "Generic (PLEG): container finished" podID="f09f9cdf-3e60-4775-81bb-8d054e27021a" containerID="2bb768c10e2fb0daa69f45f22515f762001f1193eac2f981130d4b3643430616" exitCode=0
Jul 11 23:57:25.066199 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:25.065820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerDied","Data":"2bb768c10e2fb0daa69f45f22515f762001f1193eac2f981130d4b3643430616"}
Jul 11 23:57:25.083439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:25.083393    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6" podUID="8111f40c-5c61-4622-8d2f-74f8912f1517" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 11 23:57:26.375064 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:26.374787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:26.375064 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.375056    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:26.375572 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.375144    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs podName:fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b nodeName:}" failed. No retries permitted until 2026-07-11 23:57:58.375124711 +0000 UTC m=+66.178033807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs") pod "network-metrics-daemon-72xrz" (UID: "fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 23:57:26.476402 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:26.476357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:26.476580 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.476552    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:26.476668 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.476651    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret podName:2e31c781-af27-43f5-ba5c-91fe3e687053 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:58.476628499 +0000 UTC m=+66.279537384 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret") pod "global-pull-secret-syncer-hzf8m" (UID: "2e31c781-af27-43f5-ba5c-91fe3e687053") : object "kube-system"/"original-pull-secret" not registered
Jul 11 23:57:26.577142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:26.577099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:26.577332 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.577308    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 23:57:26.577394 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.577339    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 23:57:26.577394 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.577355    2583 projected.go:196] Error preparing data for projected volume kube-api-access-frfnh for pod openshift-network-diagnostics/network-check-target-gngl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:26.577505 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.577444    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh podName:aa91b425-bf1c-455f-a674-2bc69adc2488 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:58.577421989 +0000 UTC m=+66.380330860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-frfnh" (UniqueName: "kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh") pod "network-check-target-gngl6" (UID: "aa91b425-bf1c-455f-a674-2bc69adc2488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 23:57:26.775946 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:26.775907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:26.776183 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:26.775907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:26.776183 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:26.775907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:26.776183 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.776075    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:26.776183 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.776128    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:26.776414 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:26.776207    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:28.775873 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:28.775840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:28.776399 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:28.775837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:28.776399 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:28.775992    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72xrz" podUID="fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b"
Jul 11 23:57:28.776399 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:28.775837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:28.776399 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:28.776072    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzf8m" podUID="2e31c781-af27-43f5-ba5c-91fe3e687053"
Jul 11 23:57:28.776399 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:28.776133    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gngl6" podUID="aa91b425-bf1c-455f-a674-2bc69adc2488"
Jul 11 23:57:28.990842 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:28.990802    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeReady"
Jul 11 23:57:28.991030 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:28.990978    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 23:57:29.023918 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.023868    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"]
Jul 11 23:57:29.029654 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.029618    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"]
Jul 11 23:57:29.029847 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.029714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.032436 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.032383    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 11 23:57:29.032601 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.032473    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.033873 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.033451    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 11 23:57:29.033873 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.033544    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.033873 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.033575    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w6886\""
Jul 11 23:57:29.033873 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.033811    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6546b5747c-7grk2"]
Jul 11 23:57:29.034184 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.034023    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.036945 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.036914    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.037270 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.037233    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 11 23:57:29.037400 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.037379    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 11 23:57:29.037617 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.037600    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.040766 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.039728    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"]
Jul 11 23:57:29.040766 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.039777    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5xrjv"]
Jul 11 23:57:29.040766 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.039947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.040766 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.040299    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k29rp\""
Jul 11 23:57:29.043502 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.043473    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 11 23:57:29.044122 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.043720    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 11 23:57:29.044122 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.043917    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 11 23:57:29.044122 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.043970    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl224\""
Jul 11 23:57:29.044723 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.044694    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"]
Jul 11 23:57:29.046088 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.045917    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.049030 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.048998    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"]
Jul 11 23:57:29.049174 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.049158    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:29.050894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.050845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 11 23:57:29.051022 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.050978    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 11 23:57:29.051603 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.051584    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.052202 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.052090    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 11 23:57:29.052419 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.052393    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.052582 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.052561    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 11 23:57:29.053607 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.052646    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.053918 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.052774    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.053918 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.052794    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kkhgr\""
Jul 11 23:57:29.053918 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.052194    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-54bds\""
Jul 11 23:57:29.055411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.054206    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-lgm9w"]
Jul 11 23:57:29.055411 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.054492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"
Jul 11 23:57:29.062789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.059887    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.062789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.060891    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"]
Jul 11 23:57:29.062789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.061007    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jng4n\""
Jul 11 23:57:29.062789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.061274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.062789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.061791    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.062789 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.062646    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 11 23:57:29.063893 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.063835    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.064148 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.064129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 11 23:57:29.064449 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.064430    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.064608 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.064564    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.064971 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.064192    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tjrcm\""
Jul 11 23:57:29.065290 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.064458    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6546b5747c-7grk2"]
Jul 11 23:57:29.065648 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.065632    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5xrjv"]
Jul 11 23:57:29.066081 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.065559    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 11 23:57:29.066361 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.066344    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"]
Jul 11 23:57:29.066534 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.066520    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"]
Jul 11 23:57:29.066717 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.066704    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lgm9w"]
Jul 11 23:57:29.066849 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.066837    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pl8ts"]
Jul 11 23:57:29.075839 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.075812    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.076235 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.076211    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.077543 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.077445    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 11 23:57:29.078181 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.077792    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fmb2l\""
Jul 11 23:57:29.078181 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.077873    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 11 23:57:29.083230 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.083205    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 11 23:57:29.083422 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.083403    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"]
Jul 11 23:57:29.083583 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.083570    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54f86fdd8d-pqx5n"]
Jul 11 23:57:29.083754 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.083739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.086569 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.086546    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 23:57:29.086893 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.086875    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 23:57:29.087176 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.087157    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pcsfw\""
Jul 11 23:57:29.087339 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.087310    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"]
Jul 11 23:57:29.087418 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.087402    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.089929 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.089908    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 11 23:57:29.090099 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.090077    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 11 23:57:29.090184 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.090113    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.090184 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.089951    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 11 23:57:29.090290 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.089996    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hbm4k\""
Jul 11 23:57:29.090290 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.090115    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 11 23:57:29.090367 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.089923    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.090634 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.090611    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"]
Jul 11 23:57:29.090790 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.090769    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:29.093464 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.093070    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 11 23:57:29.093464 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.093263    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 11 23:57:29.093464 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.093297    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c22j8\""
Jul 11 23:57:29.093896 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.093876    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g6t6w"]
Jul 11 23:57:29.094088 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.094064    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"
Jul 11 23:57:29.096239 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.096219    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.096419 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.096276    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-76xpq\""
Jul 11 23:57:29.096671 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.096651    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.097424 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.097406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"]
Jul 11 23:57:29.097586 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.097542    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"]
Jul 11 23:57:29.097687 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.097594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.097922 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.097598    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"]
Jul 11 23:57:29.098070 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.098056    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6t6w"]
Jul 11 23:57:29.098186 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.098171    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pl8ts"]
Jul 11 23:57:29.098256 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.098213    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f86fdd8d-pqx5n"]
Jul 11 23:57:29.100204 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.100183    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 23:57:29.100306 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.100207    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 23:57:29.100306 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.100238    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xw7sj\""
Jul 11 23:57:29.100306 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.100183    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 23:57:29.195492 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.195701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.195701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195537    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-installation-pull-secrets\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.195701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fsmz\" (UniqueName: \"kubernetes.io/projected/eb31f674-c7a0-4096-9cea-3600d61e9af7-kube-api-access-4fsmz\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.195701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:29.195701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-tmp-dir\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.195701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhc8w\" (UniqueName: \"kubernetes.io/projected/6b1466c8-efe1-4602-8971-7842227548b8-kube-api-access-dhc8w\") pod \"network-check-source-869dcfcdcd-9rspc\" (UID: \"6b1466c8-efe1-4602-8971-7842227548b8\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"
Jul 11 23:57:29.195701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195702    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb31f674-c7a0-4096-9cea-3600d61e9af7-tmp\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230-cert\") pod \"ingress-canary-g6t6w\" (UID: \"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230\") " pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbb3ae2c-238d-481d-a113-04517f3cdf3d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9zw\" (UniqueName: \"kubernetes.io/projected/b1c18cb5-2c53-4c43-ae24-e121141c1348-kube-api-access-5z9zw\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/175095ee-5dfc-4787-bad8-53ce2a1e707f-config\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195951    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzzrb\" (UniqueName: \"kubernetes.io/projected/b112c8c3-e2f2-4fdb-8c14-54310010d566-kube-api-access-lzzrb\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb31f674-c7a0-4096-9cea-3600d61e9af7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.195992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4884128-9626-4070-9196-631e31785a2f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:29.196018 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196008    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7p5w\" (UniqueName: \"kubernetes.io/projected/bbb3ae2c-238d-481d-a113-04517f3cdf3d-kube-api-access-p7p5w\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196029    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1c18cb5-2c53-4c43-ae24-e121141c1348-trusted-ca\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/175095ee-5dfc-4787-bad8-53ce2a1e707f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf55f\" (UniqueName: \"kubernetes.io/projected/444cdf45-412b-444f-a834-2b829956d682-kube-api-access-rf55f\") pod \"volume-data-source-validator-78495597f6-wzlm7\" (UID: \"444cdf45-412b-444f-a834-2b829956d682\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmd2\" (UniqueName: \"kubernetes.io/projected/175095ee-5dfc-4787-bad8-53ce2a1e707f-kube-api-access-mqmd2\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-default-certificate\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb31f674-c7a0-4096-9cea-3600d61e9af7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/58c932fb-0b1b-4c14-a044-ae8d727f27cb-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z72f4\" (UniqueName: \"kubernetes.io/projected/a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230-kube-api-access-z72f4\") pod \"ingress-canary-g6t6w\" (UID: \"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230\") " pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fswj6\" (UniqueName: \"kubernetes.io/projected/58c932fb-0b1b-4c14-a044-ae8d727f27cb-kube-api-access-fswj6\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5hn\" (UniqueName: \"kubernetes.io/projected/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-kube-api-access-8s5hn\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.196315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1c18cb5-2c53-4c43-ae24-e121141c1348-config\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-config-volume\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-trusted-ca\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbb3ae2c-238d-481d-a113-04517f3cdf3d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-image-registry-private-configuration\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jp8x\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-kube-api-access-7jp8x\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196406    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-certificates\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-bound-sa-token\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb31f674-c7a0-4096-9cea-3600d61e9af7-snapshots\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-564gm\" (UniqueName: \"kubernetes.io/projected/a65a8b5c-3cce-4961-bb2e-91534abad110-kube-api-access-564gm\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196475    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c18cb5-2c53-4c43-ae24-e121141c1348-serving-cert\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb31f674-c7a0-4096-9cea-3600d61e9af7-serving-cert\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84e5dccb-8a5f-48af-ad79-3eb8149727a9-ca-trust-extracted\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.196681 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.196548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-stats-auth\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.297768 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:29.297871 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-tmp-dir\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.297871 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhc8w\" (UniqueName: \"kubernetes.io/projected/6b1466c8-efe1-4602-8971-7842227548b8-kube-api-access-dhc8w\") pod \"network-check-source-869dcfcdcd-9rspc\" (UID: \"6b1466c8-efe1-4602-8971-7842227548b8\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"
Jul 11 23:57:29.297871 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb31f674-c7a0-4096-9cea-3600d61e9af7-tmp\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.297871 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297880    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230-cert\") pod \"ingress-canary-g6t6w\" (UID: \"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230\") " pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbb3ae2c-238d-481d-a113-04517f3cdf3d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9zw\" (UniqueName: \"kubernetes.io/projected/b1c18cb5-2c53-4c43-ae24-e121141c1348-kube-api-access-5z9zw\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/175095ee-5dfc-4787-bad8-53ce2a1e707f-config\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.297992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzzrb\" (UniqueName: \"kubernetes.io/projected/b112c8c3-e2f2-4fdb-8c14-54310010d566-kube-api-access-lzzrb\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb31f674-c7a0-4096-9cea-3600d61e9af7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.298026    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4884128-9626-4070-9196-631e31785a2f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:29.298106 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7p5w\" (UniqueName: \"kubernetes.io/projected/bbb3ae2c-238d-481d-a113-04517f3cdf3d-kube-api-access-p7p5w\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1c18cb5-2c53-4c43-ae24-e121141c1348-trusted-ca\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.298140    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:29.798113142 +0000 UTC m=+37.601022022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : secret "router-metrics-certs-default" not found
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/175095ee-5dfc-4787-bad8-53ce2a1e707f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.298210    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.298262    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls podName:a65a8b5c-3cce-4961-bb2e-91534abad110 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:29.798246338 +0000 UTC m=+37.601155209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls") pod "cluster-samples-operator-65db858894-tqmbc" (UID: "a65a8b5c-3cce-4961-bb2e-91534abad110") : secret "samples-operator-tls" not found
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf55f\" (UniqueName: \"kubernetes.io/projected/444cdf45-412b-444f-a834-2b829956d682-kube-api-access-rf55f\") pod \"volume-data-source-validator-78495597f6-wzlm7\" (UID: \"444cdf45-412b-444f-a834-2b829956d682\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.298316    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.298329    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6546b5747c-7grk2: secret "image-registry-tls" not found
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.298366    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls podName:84e5dccb-8a5f-48af-ad79-3eb8149727a9 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:29.798353747 +0000 UTC m=+37.601262632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls") pod "image-registry-6546b5747c-7grk2" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9") : secret "image-registry-tls" not found
Jul 11 23:57:29.298517 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmd2\" (UniqueName: \"kubernetes.io/projected/175095ee-5dfc-4787-bad8-53ce2a1e707f-kube-api-access-mqmd2\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/175095ee-5dfc-4787-bad8-53ce2a1e707f-config\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298747    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb31f674-c7a0-4096-9cea-3600d61e9af7-tmp\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298139    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-tmp-dir\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-default-certificate\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb31f674-c7a0-4096-9cea-3600d61e9af7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/58c932fb-0b1b-4c14-a044-ae8d727f27cb-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z72f4\" (UniqueName: \"kubernetes.io/projected/a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230-kube-api-access-z72f4\") pod \"ingress-canary-g6t6w\" (UID: \"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230\") " pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fswj6\" (UniqueName: \"kubernetes.io/projected/58c932fb-0b1b-4c14-a044-ae8d727f27cb-kube-api-access-fswj6\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.299077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.298996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5hn\" (UniqueName: \"kubernetes.io/projected/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-kube-api-access-8s5hn\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.299550 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1c18cb5-2c53-4c43-ae24-e121141c1348-trusted-ca\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.299550 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299532    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb31f674-c7a0-4096-9cea-3600d61e9af7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.299655 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299578    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1c18cb5-2c53-4c43-ae24-e121141c1348-config\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.299655 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-config-volume\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.299655 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-trusted-ca\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.299804 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbb3ae2c-238d-481d-a113-04517f3cdf3d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.299804 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-image-registry-private-configuration\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.299804 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jp8x\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-kube-api-access-7jp8x\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.299804 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-certificates\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.299804 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-bound-sa-token\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.299804 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb31f674-c7a0-4096-9cea-3600d61e9af7-snapshots\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-564gm\" (UniqueName: \"kubernetes.io/projected/a65a8b5c-3cce-4961-bb2e-91534abad110-kube-api-access-564gm\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c18cb5-2c53-4c43-ae24-e121141c1348-serving-cert\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb31f674-c7a0-4096-9cea-3600d61e9af7-serving-cert\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299922    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4884128-9626-4070-9196-631e31785a2f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84e5dccb-8a5f-48af-ad79-3eb8149727a9-ca-trust-extracted\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.299981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-stats-auth\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.300115 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.300023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.300488 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.300122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.300488 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.300151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-installation-pull-secrets\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.300488 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.300162    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-config-volume\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.300488 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.300178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fsmz\" (UniqueName: \"kubernetes.io/projected/eb31f674-c7a0-4096-9cea-3600d61e9af7-kube-api-access-4fsmz\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.300488 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.300272    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84e5dccb-8a5f-48af-ad79-3eb8149727a9-ca-trust-extracted\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.300956 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.300807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1c18cb5-2c53-4c43-ae24-e121141c1348-config\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.301097 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.301077    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:29.301164 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.301137    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls podName:e787a0be-5ca5-40bc-b7a9-1a509c40d23e nodeName:}" failed. No retries permitted until 2026-07-11 23:57:29.801120682 +0000 UTC m=+37.604029565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls") pod "dns-default-pl8ts" (UID: "e787a0be-5ca5-40bc-b7a9-1a509c40d23e") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:29.301233 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.301173    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-trusted-ca\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.302861 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.301647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb31f674-c7a0-4096-9cea-3600d61e9af7-snapshots\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.302861 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.301956    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb31f674-c7a0-4096-9cea-3600d61e9af7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.302861 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.302405    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:29.802385802 +0000 UTC m=+37.605294683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : configmap references non-existent config key: service-ca.crt
Jul 11 23:57:29.302861 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.302482    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:29.302861 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.302521    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls podName:58c932fb-0b1b-4c14-a044-ae8d727f27cb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:29.80250929 +0000 UTC m=+37.605418154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-d4gkv" (UID: "58c932fb-0b1b-4c14-a044-ae8d727f27cb") : secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:29.302861 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.302686    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/58c932fb-0b1b-4c14-a044-ae8d727f27cb-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.303247 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.303166    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 23:57:29.303247 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.303215    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert podName:b4884128-9626-4070-9196-631e31785a2f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:29.803198907 +0000 UTC m=+37.606107788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-z2mxp" (UID: "b4884128-9626-4070-9196-631e31785a2f") : secret "networking-console-plugin-cert" not found
Jul 11 23:57:29.304012 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.303682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-certificates\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.304234 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.304209    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbb3ae2c-238d-481d-a113-04517f3cdf3d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.305699 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.304549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/175095ee-5dfc-4787-bad8-53ce2a1e707f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.305699 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.304789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbb3ae2c-238d-481d-a113-04517f3cdf3d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.305699 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.305126    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-stats-auth\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.305699 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.305657    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230-cert\") pod \"ingress-canary-g6t6w\" (UID: \"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230\") " pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.306864 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.306836    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-installation-pull-secrets\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.306864 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.306856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb31f674-c7a0-4096-9cea-3600d61e9af7-serving-cert\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.307610 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.307201    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1c18cb5-2c53-4c43-ae24-e121141c1348-serving-cert\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.307610 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.307586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-default-certificate\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.309635 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.309564    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-image-registry-private-configuration\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.310102 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.310053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5hn\" (UniqueName: \"kubernetes.io/projected/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-kube-api-access-8s5hn\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.312284 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.312211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf55f\" (UniqueName: \"kubernetes.io/projected/444cdf45-412b-444f-a834-2b829956d682-kube-api-access-rf55f\") pod \"volume-data-source-validator-78495597f6-wzlm7\" (UID: \"444cdf45-412b-444f-a834-2b829956d682\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"
Jul 11 23:57:29.312284 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.312244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9zw\" (UniqueName: \"kubernetes.io/projected/b1c18cb5-2c53-4c43-ae24-e121141c1348-kube-api-access-5z9zw\") pod \"console-operator-7866497494-lgm9w\" (UID: \"b1c18cb5-2c53-4c43-ae24-e121141c1348\") " pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.313648 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.313615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7p5w\" (UniqueName: \"kubernetes.io/projected/bbb3ae2c-238d-481d-a113-04517f3cdf3d-kube-api-access-p7p5w\") pod \"kube-storage-version-migrator-operator-799cb7f958-tv62b\" (UID: \"bbb3ae2c-238d-481d-a113-04517f3cdf3d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.313750 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.313677    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z72f4\" (UniqueName: \"kubernetes.io/projected/a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230-kube-api-access-z72f4\") pod \"ingress-canary-g6t6w\" (UID: \"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230\") " pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.314375 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.314272    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fsmz\" (UniqueName: \"kubernetes.io/projected/eb31f674-c7a0-4096-9cea-3600d61e9af7-kube-api-access-4fsmz\") pod \"insights-operator-68d9dd94cf-5xrjv\" (UID: \"eb31f674-c7a0-4096-9cea-3600d61e9af7\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.315622 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.314900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fswj6\" (UniqueName: \"kubernetes.io/projected/58c932fb-0b1b-4c14-a044-ae8d727f27cb-kube-api-access-fswj6\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.315622 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.314962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmd2\" (UniqueName: \"kubernetes.io/projected/175095ee-5dfc-4787-bad8-53ce2a1e707f-kube-api-access-mqmd2\") pod \"service-ca-operator-7695fc6c8c-wpn8c\" (UID: \"175095ee-5dfc-4787-bad8-53ce2a1e707f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.315622 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.315347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-bound-sa-token\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.315622 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.315367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhc8w\" (UniqueName: \"kubernetes.io/projected/6b1466c8-efe1-4602-8971-7842227548b8-kube-api-access-dhc8w\") pod \"network-check-source-869dcfcdcd-9rspc\" (UID: \"6b1466c8-efe1-4602-8971-7842227548b8\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"
Jul 11 23:57:29.315622 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.315420    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzzrb\" (UniqueName: \"kubernetes.io/projected/b112c8c3-e2f2-4fdb-8c14-54310010d566-kube-api-access-lzzrb\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.315622 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.315577    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jp8x\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-kube-api-access-7jp8x\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.316904 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.316857    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-564gm\" (UniqueName: \"kubernetes.io/projected/a65a8b5c-3cce-4961-bb2e-91534abad110-kube-api-access-564gm\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:29.354025 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.353980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"
Jul 11 23:57:29.369112 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.369078    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"
Jul 11 23:57:29.403168 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.402835    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv"
Jul 11 23:57:29.411460 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.411421    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"
Jul 11 23:57:29.420476 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.420428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:29.461261 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.460861    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"
Jul 11 23:57:29.465369 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.465326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6t6w"
Jul 11 23:57:29.532055 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.531890    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b"]
Jul 11 23:57:29.535360 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.535275    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c"]
Jul 11 23:57:29.739370 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.739325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5xrjv"]
Jul 11 23:57:29.742283 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.742249    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc"]
Jul 11 23:57:29.753946 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.753916    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6t6w"]
Jul 11 23:57:29.756216 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.756186    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lgm9w"]
Jul 11 23:57:29.764165 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.764135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7"]
Jul 11 23:57:29.767689 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:29.767657    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c18cb5_2c53_4c43_ae24_e121141c1348.slice/crio-91fcefdabdc84f10975700db710bbf1b7554bd2f11d0431c374f55d4e90be575 WatchSource:0}: Error finding container 91fcefdabdc84f10975700db710bbf1b7554bd2f11d0431c374f55d4e90be575: Status 404 returned error can't find the container with id 91fcefdabdc84f10975700db710bbf1b7554bd2f11d0431c374f55d4e90be575
Jul 11 23:57:29.768472 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:29.768443    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1466c8_efe1_4602_8971_7842227548b8.slice/crio-303560f96615cf552edd6e63ea653b04aa8444179754cb7210b6184b53cef832 WatchSource:0}: Error finding container 303560f96615cf552edd6e63ea653b04aa8444179754cb7210b6184b53cef832: Status 404 returned error can't find the container with id 303560f96615cf552edd6e63ea653b04aa8444179754cb7210b6184b53cef832
Jul 11 23:57:29.769453 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:29.769425    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb31f674_c7a0_4096_9cea_3600d61e9af7.slice/crio-f47e288db8db374fb41fba593aecd169ec76cf3e9eb11c267c36269a68ca6c5e WatchSource:0}: Error finding container f47e288db8db374fb41fba593aecd169ec76cf3e9eb11c267c36269a68ca6c5e: Status 404 returned error can't find the container with id f47e288db8db374fb41fba593aecd169ec76cf3e9eb11c267c36269a68ca6c5e
Jul 11 23:57:29.770389 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:29.770287    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2cd73c3_c8a4_4fd0_90d4_c0a1d1ab0230.slice/crio-143089ea41036dc6c20e25b52cd40abd528bcdccb57e6f2dbc83fac60cb02c13 WatchSource:0}: Error finding container 143089ea41036dc6c20e25b52cd40abd528bcdccb57e6f2dbc83fac60cb02c13: Status 404 returned error can't find the container with id 143089ea41036dc6c20e25b52cd40abd528bcdccb57e6f2dbc83fac60cb02c13
Jul 11 23:57:29.771476 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:29.771388    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444cdf45_412b_444f_a834_2b829956d682.slice/crio-cb9bdb31ae3efd9e670f6700af4e2b4fae0bad074c0f70f50ab61fd328a7b7cd WatchSource:0}: Error finding container cb9bdb31ae3efd9e670f6700af4e2b4fae0bad074c0f70f50ab61fd328a7b7cd: Status 404 returned error can't find the container with id cb9bdb31ae3efd9e670f6700af4e2b4fae0bad074c0f70f50ab61fd328a7b7cd
Jul 11 23:57:29.809260 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.809220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.809271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.809314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.809365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809386    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.809432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809450    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809501    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809455    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls podName:a65a8b5c-3cce-4961-bb2e-91534abad110 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:30.809433481 +0000 UTC m=+38.612342346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls") pod "cluster-samples-operator-65db858894-tqmbc" (UID: "a65a8b5c-3cce-4961-bb2e-91534abad110") : secret "samples-operator-tls" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809456    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809516    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809548    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:30.809532322 +0000 UTC m=+38.612441193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : secret "router-metrics-certs-default" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809525    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6546b5747c-7grk2: secret "image-registry-tls" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809563    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert podName:b4884128-9626-4070-9196-631e31785a2f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:30.809557188 +0000 UTC m=+38.612466053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-z2mxp" (UID: "b4884128-9626-4070-9196-631e31785a2f") : secret "networking-console-plugin-cert" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809577    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls podName:e787a0be-5ca5-40bc-b7a9-1a509c40d23e nodeName:}" failed. No retries permitted until 2026-07-11 23:57:30.809571519 +0000 UTC m=+38.612480383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls") pod "dns-default-pl8ts" (UID: "e787a0be-5ca5-40bc-b7a9-1a509c40d23e") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809589    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls podName:84e5dccb-8a5f-48af-ad79-3eb8149727a9 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:30.809582976 +0000 UTC m=+38.612491841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls") pod "image-registry-6546b5747c-7grk2" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9") : secret "image-registry-tls" not found
Jul 11 23:57:29.810142 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.809629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:29.810607 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:29.809649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:29.810607 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809741    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:30.80973097 +0000 UTC m=+38.612639853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : configmap references non-existent config key: service-ca.crt
Jul 11 23:57:29.810607 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809746    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:29.810607 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:29.809783    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls podName:58c932fb-0b1b-4c14-a044-ae8d727f27cb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:30.809769795 +0000 UTC m=+38.612678689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-d4gkv" (UID: "58c932fb-0b1b-4c14-a044-ae8d727f27cb") : secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:30.086335 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.086226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lgm9w" event={"ID":"b1c18cb5-2c53-4c43-ae24-e121141c1348","Type":"ContainerStarted","Data":"91fcefdabdc84f10975700db710bbf1b7554bd2f11d0431c374f55d4e90be575"}
Jul 11 23:57:30.087747 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.087712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c" event={"ID":"175095ee-5dfc-4787-bad8-53ce2a1e707f","Type":"ContainerStarted","Data":"73dbda45eee0e2dad25a3cea606914ebed312e18b799379d02625bfd29e10d6d"}
Jul 11 23:57:30.089099 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.089062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6t6w" event={"ID":"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230","Type":"ContainerStarted","Data":"143089ea41036dc6c20e25b52cd40abd528bcdccb57e6f2dbc83fac60cb02c13"}
Jul 11 23:57:30.090409 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.090369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc" event={"ID":"6b1466c8-efe1-4602-8971-7842227548b8","Type":"ContainerStarted","Data":"303560f96615cf552edd6e63ea653b04aa8444179754cb7210b6184b53cef832"}
Jul 11 23:57:30.095327 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.094431    2583 generic.go:356] "Generic (PLEG): container finished" podID="f09f9cdf-3e60-4775-81bb-8d054e27021a" containerID="9b9b78317b1e1b8283a7ff37bed7ced94728a23b5c2c7c90df1056719f351acf" exitCode=0
Jul 11 23:57:30.095327 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.095294    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerDied","Data":"9b9b78317b1e1b8283a7ff37bed7ced94728a23b5c2c7c90df1056719f351acf"}
Jul 11 23:57:30.099374 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.099296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7" event={"ID":"444cdf45-412b-444f-a834-2b829956d682","Type":"ContainerStarted","Data":"cb9bdb31ae3efd9e670f6700af4e2b4fae0bad074c0f70f50ab61fd328a7b7cd"}
Jul 11 23:57:30.102055 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.102002    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv" event={"ID":"eb31f674-c7a0-4096-9cea-3600d61e9af7","Type":"ContainerStarted","Data":"f47e288db8db374fb41fba593aecd169ec76cf3e9eb11c267c36269a68ca6c5e"}
Jul 11 23:57:30.104417 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.104376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b" event={"ID":"bbb3ae2c-238d-481d-a113-04517f3cdf3d","Type":"ContainerStarted","Data":"df7f66a10ece25d50e43c16622e0c0358a06b9098e8b82917d122757116b6397"}
Jul 11 23:57:30.778696 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.776180    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:30.778696 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.776928    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:30.778696 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.777737    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:30.782337 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.780947    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 23:57:30.782337 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.781988    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbvsd\""
Jul 11 23:57:30.782337 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.782165    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 23:57:30.782337 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.782279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7t5sz\""
Jul 11 23:57:30.821529 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.821488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.821572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.821671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.821719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.821743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.821780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:30.821815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.821956    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 23:57:30.822077 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822058    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:32.822017663 +0000 UTC m=+40.624926541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : secret "router-metrics-certs-default" not found
Jul 11 23:57:30.822572 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822548    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:30.822624 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822577    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6546b5747c-7grk2: secret "image-registry-tls" not found
Jul 11 23:57:30.822678 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822630    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls podName:84e5dccb-8a5f-48af-ad79-3eb8149727a9 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:32.822611502 +0000 UTC m=+40.625520380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls") pod "image-registry-6546b5747c-7grk2" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9") : secret "image-registry-tls" not found
Jul 11 23:57:30.822739 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822705    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:30.822794 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822740    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls podName:e787a0be-5ca5-40bc-b7a9-1a509c40d23e nodeName:}" failed. No retries permitted until 2026-07-11 23:57:32.822727736 +0000 UTC m=+40.625636616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls") pod "dns-default-pl8ts" (UID: "e787a0be-5ca5-40bc-b7a9-1a509c40d23e") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:30.822854 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822800    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 23:57:30.822854 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822833    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert podName:b4884128-9626-4070-9196-631e31785a2f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:32.822821631 +0000 UTC m=+40.625730497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-z2mxp" (UID: "b4884128-9626-4070-9196-631e31785a2f") : secret "networking-console-plugin-cert" not found
Jul 11 23:57:30.822968 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822893    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:30.822968 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822925    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls podName:58c932fb-0b1b-4c14-a044-ae8d727f27cb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:32.822914808 +0000 UTC m=+40.625823675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-d4gkv" (UID: "58c932fb-0b1b-4c14-a044-ae8d727f27cb") : secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:30.823116 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.822999    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:32.822988487 +0000 UTC m=+40.625897366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : configmap references non-existent config key: service-ca.crt
Jul 11 23:57:30.823116 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.823074    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 23:57:30.823116 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:30.823108    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls podName:a65a8b5c-3cce-4961-bb2e-91534abad110 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:32.823097803 +0000 UTC m=+40.626006682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls") pod "cluster-samples-operator-65db858894-tqmbc" (UID: "a65a8b5c-3cce-4961-bb2e-91534abad110") : secret "samples-operator-tls" not found
Jul 11 23:57:31.121220 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:31.120069    2583 generic.go:356] "Generic (PLEG): container finished" podID="f09f9cdf-3e60-4775-81bb-8d054e27021a" containerID="b1c8c25d6faaab5edcfa607435dc41a05d122b931ca7fb335caa9f1eb66a34e6" exitCode=0
Jul 11 23:57:31.121220 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:31.120149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerDied","Data":"b1c8c25d6faaab5edcfa607435dc41a05d122b931ca7fb335caa9f1eb66a34e6"}
Jul 11 23:57:32.849301 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:32.849072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:32.849356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849274    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849386    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6546b5747c-7grk2: secret "image-registry-tls" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:32.849422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849457    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls podName:84e5dccb-8a5f-48af-ad79-3eb8149727a9 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.84943282 +0000 UTC m=+44.652341711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls") pod "image-registry-6546b5747c-7grk2" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9") : secret "image-registry-tls" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:32.849506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849513    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849570    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:32.849541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849537    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849611    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert podName:b4884128-9626-4070-9196-631e31785a2f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.849592635 +0000 UTC m=+44.652501525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-z2mxp" (UID: "b4884128-9626-4070-9196-631e31785a2f") : secret "networking-console-plugin-cert" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849635    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls podName:58c932fb-0b1b-4c14-a044-ae8d727f27cb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.849625621 +0000 UTC m=+44.652534489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-d4gkv" (UID: "58c932fb-0b1b-4c14-a044-ae8d727f27cb") : secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849653    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.849644729 +0000 UTC m=+44.652553595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : configmap references non-existent config key: service-ca.crt
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849670    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls podName:e787a0be-5ca5-40bc-b7a9-1a509c40d23e nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.84966138 +0000 UTC m=+44.652570251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls") pod "dns-default-pl8ts" (UID: "e787a0be-5ca5-40bc-b7a9-1a509c40d23e") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:32.849829 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:32.849709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:32.850487 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:32.849748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:32.850487 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849864    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 23:57:32.850487 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849902    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.849891056 +0000 UTC m=+44.652799932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : secret "router-metrics-certs-default" not found
Jul 11 23:57:32.850487 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849919    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 23:57:32.850487 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:32.849991    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls podName:a65a8b5c-3cce-4961-bb2e-91534abad110 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:36.849979273 +0000 UTC m=+44.652888138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls") pod "cluster-samples-operator-65db858894-tqmbc" (UID: "a65a8b5c-3cce-4961-bb2e-91534abad110") : secret "samples-operator-tls" not found
Jul 11 23:57:34.133757 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:34.133719    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-42stw" event={"ID":"f09f9cdf-3e60-4775-81bb-8d054e27021a","Type":"ContainerStarted","Data":"d14b94636fb9b95d37d7a14b13cfe0dc30a94569e2f6df2035cc2f03b74e820d"}
Jul 11 23:57:34.155582 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:34.155531    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-42stw" podStartSLOduration=10.990772937 podStartE2EDuration="41.155511579s" totalImagesPullingTime="30.164738642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:34.154235442 +0000 UTC m=+41.957144330" watchObservedRunningTime="2026-07-11 23:57:34.155511579 +0000 UTC m=+41.958420466"
Jul 11 23:57:36.891536 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:36.891476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:36.891536 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:36.891546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:36.891604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891644    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:36.891681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891715    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:44.891694036 +0000 UTC m=+52.694602922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : secret "router-metrics-certs-default" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891741    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:36.891755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891766    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6546b5747c-7grk2: secret "image-registry-tls" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:36.891787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891799    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891822    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls podName:84e5dccb-8a5f-48af-ad79-3eb8149727a9 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:44.891804683 +0000 UTC m=+52.694713574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls") pod "image-registry-6546b5747c-7grk2" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9") : secret "image-registry-tls" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891748    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891894    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891911    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:44.891899142 +0000 UTC m=+52.694808008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : configmap references non-existent config key: service-ca.crt
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891944    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls podName:e787a0be-5ca5-40bc-b7a9-1a509c40d23e nodeName:}" failed. No retries permitted until 2026-07-11 23:57:44.891934052 +0000 UTC m=+52.694842919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls") pod "dns-default-pl8ts" (UID: "e787a0be-5ca5-40bc-b7a9-1a509c40d23e") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:36.892133 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891958    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert podName:b4884128-9626-4070-9196-631e31785a2f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:44.891949897 +0000 UTC m=+52.694858762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-z2mxp" (UID: "b4884128-9626-4070-9196-631e31785a2f") : secret "networking-console-plugin-cert" not found
Jul 11 23:57:36.892744 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.891974    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls podName:58c932fb-0b1b-4c14-a044-ae8d727f27cb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:44.891965976 +0000 UTC m=+52.694874842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-d4gkv" (UID: "58c932fb-0b1b-4c14-a044-ae8d727f27cb") : secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:36.892744 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:36.891992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:36.892744 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.892163    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 23:57:36.892744 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:36.892221    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls podName:a65a8b5c-3cce-4961-bb2e-91534abad110 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:44.89220574 +0000 UTC m=+52.695114622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls") pod "cluster-samples-operator-65db858894-tqmbc" (UID: "a65a8b5c-3cce-4961-bb2e-91534abad110") : secret "samples-operator-tls" not found
Jul 11 23:57:38.156838 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.156788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c" event={"ID":"175095ee-5dfc-4787-bad8-53ce2a1e707f","Type":"ContainerStarted","Data":"e96d42af0ce4858b760c9630edaeed1da22b09ab4f2c6e016091f2cea83bcaf4"}
Jul 11 23:57:38.159812 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.159776    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6t6w" event={"ID":"a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230","Type":"ContainerStarted","Data":"a8810dad40ec234e1a8a54c387eeb6fa9c900dc52d8f78a937b4f4799c0bf669"}
Jul 11 23:57:38.161573 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.161536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc" event={"ID":"6b1466c8-efe1-4602-8971-7842227548b8","Type":"ContainerStarted","Data":"ce6c309c9434685eaefcb8044b0cd11a23471f945277f2dad86b816d04fc4e60"}
Jul 11 23:57:38.163195 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.163166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7" event={"ID":"444cdf45-412b-444f-a834-2b829956d682","Type":"ContainerStarted","Data":"7048510db3ef168e780bd6dc09540cb5f842ef6f111f7d7826197ddad38f2a52"}
Jul 11 23:57:38.164826 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.164795    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv" event={"ID":"eb31f674-c7a0-4096-9cea-3600d61e9af7","Type":"ContainerStarted","Data":"7b46172a2aa37b35b6b2334c0328a02edc58b1a984e20550fd8eb6ad419ecb52"}
Jul 11 23:57:38.167001 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.166971    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b" event={"ID":"bbb3ae2c-238d-481d-a113-04517f3cdf3d","Type":"ContainerStarted","Data":"43cdd3a34ec28ef27fe85344294154ababc389a87a4420d718f6a8bf55cc2f55"}
Jul 11 23:57:38.169532 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.169506    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/0.log"
Jul 11 23:57:38.169658 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.169549    2583 generic.go:356] "Generic (PLEG): container finished" podID="b1c18cb5-2c53-4c43-ae24-e121141c1348" containerID="64143a67322aa8694e9451d5001a1fc03b631754089c09885de434988d73234f" exitCode=255
Jul 11 23:57:38.169658 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.169581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lgm9w" event={"ID":"b1c18cb5-2c53-4c43-ae24-e121141c1348","Type":"ContainerDied","Data":"64143a67322aa8694e9451d5001a1fc03b631754089c09885de434988d73234f"}
Jul 11 23:57:38.169894 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.169878    2583 scope.go:117] "RemoveContainer" containerID="64143a67322aa8694e9451d5001a1fc03b631754089c09885de434988d73234f"
Jul 11 23:57:38.195094 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.195017    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c" podStartSLOduration=29.223267194 podStartE2EDuration="37.19499604s" totalImagesPullingTime="7.971728846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:38.173845878 +0000 UTC m=+45.976754766" watchObservedRunningTime="2026-07-11 23:57:38.19499604 +0000 UTC m=+45.997904927"
Jul 11 23:57:38.195663 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.195628    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b" podStartSLOduration=29.224363029 podStartE2EDuration="37.195614971s" totalImagesPullingTime="7.971251942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:38.194819554 +0000 UTC m=+45.997728441" watchObservedRunningTime="2026-07-11 23:57:38.195614971 +0000 UTC m=+45.998523859"
Jul 11 23:57:38.212425 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.212361    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv" podStartSLOduration=29.463769718 podStartE2EDuration="37.212340401s" totalImagesPullingTime="7.748570683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:38.210680327 +0000 UTC m=+46.013589214" watchObservedRunningTime="2026-07-11 23:57:38.212340401 +0000 UTC m=+46.015249290"
Jul 11 23:57:38.245963 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.245077    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wzlm7" podStartSLOduration=29.746211158 podStartE2EDuration="37.245023816s" totalImagesPullingTime="7.498812658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:38.229122106 +0000 UTC m=+46.032030995" watchObservedRunningTime="2026-07-11 23:57:38.245023816 +0000 UTC m=+46.047932705"
Jul 11 23:57:38.245963 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.245838    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g6t6w" podStartSLOduration=1.488844726 podStartE2EDuration="9.245825039s" totalImagesPullingTime="7.756980313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:38.243702199 +0000 UTC m=+46.046611098" watchObservedRunningTime="2026-07-11 23:57:38.245825039 +0000 UTC m=+46.048733921"
Jul 11 23:57:38.278454 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.278397    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9rspc" podStartSLOduration=29.529069077 podStartE2EDuration="37.278374991s" totalImagesPullingTime="7.749305914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:38.275974304 +0000 UTC m=+46.078883190" watchObservedRunningTime="2026-07-11 23:57:38.278374991 +0000 UTC m=+46.081283912"
Jul 11 23:57:38.815672 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.815630    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-shmrx"]
Jul 11 23:57:38.838420 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.838327    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shmrx"]
Jul 11 23:57:38.838581 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.838477    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:38.841376 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.841085    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 23:57:38.841376 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.841088    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 23:57:38.841376 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.841177    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f56l4\""
Jul 11 23:57:38.914596 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.914516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:38.914755 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.914612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:38.914755 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.914667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5953328f-6a94-4f49-9343-535a7b265a73-crio-socket\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:38.914755 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.914701    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkhvs\" (UniqueName: \"kubernetes.io/projected/5953328f-6a94-4f49-9343-535a7b265a73-kube-api-access-rkhvs\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:38.914886 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:38.914854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5953328f-6a94-4f49-9343-535a7b265a73-data-volume\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.016300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5953328f-6a94-4f49-9343-535a7b265a73-data-volume\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016559 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.016499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016559 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.016530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016685 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.016570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5953328f-6a94-4f49-9343-535a7b265a73-crio-socket\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016685 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.016614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkhvs\" (UniqueName: \"kubernetes.io/projected/5953328f-6a94-4f49-9343-535a7b265a73-kube-api-access-rkhvs\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016784 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.016730    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:39.016784 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.016754    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5953328f-6a94-4f49-9343-535a7b265a73-data-volume\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016888 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.016791    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:39.516772476 +0000 UTC m=+47.319681365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:39.016888 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.016818    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.016888 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.016849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5953328f-6a94-4f49-9343-535a7b265a73-crio-socket\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.016888 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.016871    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:39.516854208 +0000 UTC m=+47.319763091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.027215 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.027177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkhvs\" (UniqueName: \"kubernetes.io/projected/5953328f-6a94-4f49-9343-535a7b265a73-kube-api-access-rkhvs\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.175915 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.175884    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 11 23:57:39.176368 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.176357    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/0.log"
Jul 11 23:57:39.176422 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.176395    2583 generic.go:356] "Generic (PLEG): container finished" podID="b1c18cb5-2c53-4c43-ae24-e121141c1348" containerID="99f4f8ba95dbfc155245d7225318f8ce7a0c20d6f990debf72f7d1872d39d03a" exitCode=255
Jul 11 23:57:39.176562 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.176523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lgm9w" event={"ID":"b1c18cb5-2c53-4c43-ae24-e121141c1348","Type":"ContainerDied","Data":"99f4f8ba95dbfc155245d7225318f8ce7a0c20d6f990debf72f7d1872d39d03a"}
Jul 11 23:57:39.176692 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.176604    2583 scope.go:117] "RemoveContainer" containerID="64143a67322aa8694e9451d5001a1fc03b631754089c09885de434988d73234f"
Jul 11 23:57:39.176781 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.176764    2583 scope.go:117] "RemoveContainer" containerID="99f4f8ba95dbfc155245d7225318f8ce7a0c20d6f990debf72f7d1872d39d03a"
Jul 11 23:57:39.177158 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.176979    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lgm9w_openshift-console-operator(b1c18cb5-2c53-4c43-ae24-e121141c1348)\"" pod="openshift-console-operator/console-operator-7866497494-lgm9w" podUID="b1c18cb5-2c53-4c43-ae24-e121141c1348"
Jul 11 23:57:39.421153 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.421109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:39.421153 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.421180    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:39.522743 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.522637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.522743 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:39.522697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:39.522972 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.522814    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.522972 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.522884    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:40.522867789 +0000 UTC m=+48.325776656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:39.522972 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.522883    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:39.522972 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:39.522956    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:40.522937413 +0000 UTC m=+48.325846301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:40.182359 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:40.182328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 11 23:57:40.182741 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:40.182692    2583 scope.go:117] "RemoveContainer" containerID="99f4f8ba95dbfc155245d7225318f8ce7a0c20d6f990debf72f7d1872d39d03a"
Jul 11 23:57:40.182901 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:40.182877    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lgm9w_openshift-console-operator(b1c18cb5-2c53-4c43-ae24-e121141c1348)\"" pod="openshift-console-operator/console-operator-7866497494-lgm9w" podUID="b1c18cb5-2c53-4c43-ae24-e121141c1348"
Jul 11 23:57:40.212224 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:40.212171    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pmjfs_44efc80d-74e9-44dc-a0d2-be7d54a11c37/dns-node-resolver/0.log"
Jul 11 23:57:40.544995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:40.544881    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:40.545185 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:40.545027    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:40.545185 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:40.545147    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:42.545128063 +0000 UTC m=+50.348036931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:40.545185 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:40.545169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:40.545311 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:40.545296    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:40.545359 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:40.545349    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:42.545335064 +0000 UTC m=+50.348243950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:41.187080 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:41.187024    2583 scope.go:117] "RemoveContainer" containerID="99f4f8ba95dbfc155245d7225318f8ce7a0c20d6f990debf72f7d1872d39d03a"
Jul 11 23:57:41.187526 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:41.187231    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lgm9w_openshift-console-operator(b1c18cb5-2c53-4c43-ae24-e121141c1348)\"" pod="openshift-console-operator/console-operator-7866497494-lgm9w" podUID="b1c18cb5-2c53-4c43-ae24-e121141c1348"
Jul 11 23:57:41.413677 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:41.413648    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk6s9_020df34c-91fe-445d-951f-bb7c6a1694b7/node-ca/0.log"
Jul 11 23:57:42.013239 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:42.013201    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6t6w_a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230/serve-healthcheck-canary/0.log"
Jul 11 23:57:42.566304 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:42.566249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:42.566304 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:42.566311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:42.566787 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:42.566417    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:42.566787 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:42.566439    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 23:57:42.566787 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:42.566512    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:46.566485045 +0000 UTC m=+54.369393923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : configmap "kube-rbac-proxy" not found
Jul 11 23:57:42.566787 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:42.566534    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:46.566520546 +0000 UTC m=+54.369429416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:44.989657 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:44.989604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:57:44.989657 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:44.989656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:44.989674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:44.989704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989773    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989773    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989777    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:44.989837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989846    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:00.989826489 +0000 UTC m=+68.792735354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : configmap references non-existent config key: service-ca.crt
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989904    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989911    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert podName:b4884128-9626-4070-9196-631e31785a2f nodeName:}" failed. No retries permitted until 2026-07-11 23:58:00.989890503 +0000 UTC m=+68.792799383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-z2mxp" (UID: "b4884128-9626-4070-9196-631e31785a2f") : secret "networking-console-plugin-cert" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989933    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls podName:a65a8b5c-3cce-4961-bb2e-91534abad110 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:00.989922643 +0000 UTC m=+68.792831510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls") pod "cluster-samples-operator-65db858894-tqmbc" (UID: "a65a8b5c-3cce-4961-bb2e-91534abad110") : secret "samples-operator-tls" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989950    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls podName:58c932fb-0b1b-4c14-a044-ae8d727f27cb nodeName:}" failed. No retries permitted until 2026-07-11 23:58:00.989942304 +0000 UTC m=+68.792851169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-d4gkv" (UID: "58c932fb-0b1b-4c14-a044-ae8d727f27cb") : secret "cluster-monitoring-operator-tls" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.989976    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs podName:b112c8c3-e2f2-4fdb-8c14-54310010d566 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:00.98996569 +0000 UTC m=+68.792874590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs") pod "router-default-54f86fdd8d-pqx5n" (UID: "b112c8c3-e2f2-4fdb-8c14-54310010d566") : secret "router-metrics-certs-default" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:44.990063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:44.990135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.990159    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 23:57:44.990277 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.990168    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6546b5747c-7grk2: secret "image-registry-tls" not found
Jul 11 23:57:44.990768 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.990195    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls podName:84e5dccb-8a5f-48af-ad79-3eb8149727a9 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:00.99018401 +0000 UTC m=+68.793092878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls") pod "image-registry-6546b5747c-7grk2" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9") : secret "image-registry-tls" not found
Jul 11 23:57:44.990768 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.990243    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 23:57:44.990768 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:44.990290    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls podName:e787a0be-5ca5-40bc-b7a9-1a509c40d23e nodeName:}" failed. No retries permitted until 2026-07-11 23:58:00.990278229 +0000 UTC m=+68.793187108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls") pod "dns-default-pl8ts" (UID: "e787a0be-5ca5-40bc-b7a9-1a509c40d23e") : secret "dns-default-metrics-tls" not found
Jul 11 23:57:46.607001 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:46.606949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:46.607001 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:46.607004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:46.607682 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:46.607135    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:46.607682 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:57:46.607209    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls podName:5953328f-6a94-4f49-9343-535a7b265a73 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:54.607191028 +0000 UTC m=+62.410099894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmrx" (UID: "5953328f-6a94-4f49-9343-535a7b265a73") : secret "insights-runtime-extractor-tls" not found
Jul 11 23:57:46.607682 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:46.607554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5953328f-6a94-4f49-9343-535a7b265a73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:54.690311 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:54.690262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:54.692788 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:54.692763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5953328f-6a94-4f49-9343-535a7b265a73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmrx\" (UID: \"5953328f-6a94-4f49-9343-535a7b265a73\") " pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:54.753561 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:54.753521    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f56l4\""
Jul 11 23:57:54.761782 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:54.761750    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shmrx"
Jul 11 23:57:54.931604 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:54.931562    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shmrx"]
Jul 11 23:57:54.935145 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:54.935111    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5953328f_6a94_4f49_9343_535a7b265a73.slice/crio-5b7988a63bdced0a6f45b529324b7484b89122f532f32468168aca05def145b2 WatchSource:0}: Error finding container 5b7988a63bdced0a6f45b529324b7484b89122f532f32468168aca05def145b2: Status 404 returned error can't find the container with id 5b7988a63bdced0a6f45b529324b7484b89122f532f32468168aca05def145b2
Jul 11 23:57:55.077487 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:55.077392    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7hqx6"
Jul 11 23:57:55.233871 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:55.233838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmrx" event={"ID":"5953328f-6a94-4f49-9343-535a7b265a73","Type":"ContainerStarted","Data":"5b7988a63bdced0a6f45b529324b7484b89122f532f32468168aca05def145b2"}
Jul 11 23:57:55.776344 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:55.776305    2583 scope.go:117] "RemoveContainer" containerID="99f4f8ba95dbfc155245d7225318f8ce7a0c20d6f990debf72f7d1872d39d03a"
Jul 11 23:57:56.240959 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:56.240918    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 11 23:57:56.241188 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:56.241026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lgm9w" event={"ID":"b1c18cb5-2c53-4c43-ae24-e121141c1348","Type":"ContainerStarted","Data":"0c5a976efc5dd864060a5e5058307c77397763c555a5b2d519b452a98f987dec"}
Jul 11 23:57:56.241673 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:56.241473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:56.718373 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:56.718329    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-lgm9w"
Jul 11 23:57:56.737058 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:56.736308    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-lgm9w" podStartSLOduration=47.986575939 podStartE2EDuration="55.736282586s" totalImagesPullingTime="7.749706647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:56.257584017 +0000 UTC m=+64.060492905" watchObservedRunningTime="2026-07-11 23:57:56.736282586 +0000 UTC m=+64.539191474"
Jul 11 23:57:58.428772 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.428724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:58.431433 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.431403    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 23:57:58.442460 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.442424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b-metrics-certs\") pod \"network-metrics-daemon-72xrz\" (UID: \"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b\") " pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:58.529906 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.529858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:58.532793 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.532757    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 23:57:58.543221 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.543134    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e31c781-af27-43f5-ba5c-91fe3e687053-original-pull-secret\") pod \"global-pull-secret-syncer-hzf8m\" (UID: \"2e31c781-af27-43f5-ba5c-91fe3e687053\") " pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:58.630957 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.630916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:58.634086 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.634050    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frfnh\" (UniqueName: \"kubernetes.io/projected/aa91b425-bf1c-455f-a674-2bc69adc2488-kube-api-access-frfnh\") pod \"network-check-target-gngl6\" (UID: \"aa91b425-bf1c-455f-a674-2bc69adc2488\") " pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:58.703394 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.703298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7t5sz\""
Jul 11 23:57:58.710921 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.710891    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:58.711089 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.710954    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbvsd\""
Jul 11 23:57:58.717980 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.717940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzf8m"
Jul 11 23:57:58.719025 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.719003    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72xrz"
Jul 11 23:57:58.919599 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.919554    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-72xrz"]
Jul 11 23:57:58.923633 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:58.923594    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb664c9d_cceb_40bf_ad4f_fa9477a7ae7b.slice/crio-d562786a56bc5e9247fbbeba47f601c3bc9024a67d995bd0bcffdd1b76b28481 WatchSource:0}: Error finding container d562786a56bc5e9247fbbeba47f601c3bc9024a67d995bd0bcffdd1b76b28481: Status 404 returned error can't find the container with id d562786a56bc5e9247fbbeba47f601c3bc9024a67d995bd0bcffdd1b76b28481
Jul 11 23:57:58.934583 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.933180    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gngl6"]
Jul 11 23:57:58.939954 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:57:58.939882    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa91b425_bf1c_455f_a674_2bc69adc2488.slice/crio-79e1486d4812af8e0a0d905dc092aec0abb207a745db06b71858a341fbf12c9f WatchSource:0}: Error finding container 79e1486d4812af8e0a0d905dc092aec0abb207a745db06b71858a341fbf12c9f: Status 404 returned error can't find the container with id 79e1486d4812af8e0a0d905dc092aec0abb207a745db06b71858a341fbf12c9f
Jul 11 23:57:58.957095 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:58.957058    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hzf8m"]
Jul 11 23:57:59.255946 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:59.255815    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gngl6" event={"ID":"aa91b425-bf1c-455f-a674-2bc69adc2488","Type":"ContainerStarted","Data":"d626ec5e8a9fd44753b607c200a2ebd8d0f5bcac36518dda2413bf89d9a6f22a"}
Jul 11 23:57:59.255946 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:59.255885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gngl6" event={"ID":"aa91b425-bf1c-455f-a674-2bc69adc2488","Type":"ContainerStarted","Data":"79e1486d4812af8e0a0d905dc092aec0abb207a745db06b71858a341fbf12c9f"}
Jul 11 23:57:59.255946 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:59.255940    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:57:59.257824 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:59.257778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmrx" event={"ID":"5953328f-6a94-4f49-9343-535a7b265a73","Type":"ContainerStarted","Data":"1e074c3ea3f4701b23a7fbed8c9ed035d5ee556d559aafe9b17eba6b07ed9f3b"}
Jul 11 23:57:59.259127 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:59.259074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72xrz" event={"ID":"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b","Type":"ContainerStarted","Data":"d562786a56bc5e9247fbbeba47f601c3bc9024a67d995bd0bcffdd1b76b28481"}
Jul 11 23:57:59.260710 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:59.260677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hzf8m" event={"ID":"2e31c781-af27-43f5-ba5c-91fe3e687053","Type":"ContainerStarted","Data":"7789a5cf85459ecccb07922a6e4f35e5f7492fa03f1a2e7dd79b98727b15aec7"}
Jul 11 23:57:59.270719 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:57:59.270647    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gngl6" podStartSLOduration=66.270619065 podStartE2EDuration="1m6.270619065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:59.270284966 +0000 UTC m=+67.073193845" watchObservedRunningTime="2026-07-11 23:57:59.270619065 +0000 UTC m=+67.073527952"
Jul 11 23:58:00.174324 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.174279    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"]
Jul 11 23:58:00.179406 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.179372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.188740 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.186454    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 11 23:58:00.188740 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.186813    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 11 23:58:00.188740 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.187092    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 11 23:58:00.188740 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.187332    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 11 23:58:00.190175 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.190147    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"]
Jul 11 23:58:00.249869 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.249825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmpz\" (UniqueName: \"kubernetes.io/projected/1e79706e-3439-4f94-817c-39dff6f28c1d-kube-api-access-tpmpz\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.250087 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.249965    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e79706e-3439-4f94-817c-39dff6f28c1d-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.250087 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.250022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e79706e-3439-4f94-817c-39dff6f28c1d-tmp\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.271129 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.271090    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmrx" event={"ID":"5953328f-6a94-4f49-9343-535a7b265a73","Type":"ContainerStarted","Data":"28c06827f392f5aae32626aeaf9cb61f5fd2ec1f6fbfed5bc523d61499325e1a"}
Jul 11 23:58:00.274487 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.274456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72xrz" event={"ID":"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b","Type":"ContainerStarted","Data":"ac3e575e134ba94e3196db255040919ca41ca3274f34a2dc8d1b366b94a2d3d2"}
Jul 11 23:58:00.277638 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.277603    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-tvs9q"]
Jul 11 23:58:00.282501 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.282466    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-tvs9q"
Jul 11 23:58:00.287746 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.286465    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 11 23:58:00.287746 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.286878    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9vx95\""
Jul 11 23:58:00.287746 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.287131    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 11 23:58:00.298729 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.298644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-tvs9q"]
Jul 11 23:58:00.350702 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.350664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e79706e-3439-4f94-817c-39dff6f28c1d-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.350913 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.350753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e79706e-3439-4f94-817c-39dff6f28c1d-tmp\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.350913 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.350820    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfjp\" (UniqueName: \"kubernetes.io/projected/0f72ae0d-9075-497b-bc70-c7a22f07a94d-kube-api-access-tpfjp\") pod \"downloads-68c9cbb497-tvs9q\" (UID: \"0f72ae0d-9075-497b-bc70-c7a22f07a94d\") " pod="openshift-console/downloads-68c9cbb497-tvs9q"
Jul 11 23:58:00.350913 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.350870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmpz\" (UniqueName: \"kubernetes.io/projected/1e79706e-3439-4f94-817c-39dff6f28c1d-kube-api-access-tpmpz\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.351403 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.351377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e79706e-3439-4f94-817c-39dff6f28c1d-tmp\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.359114 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.358885    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e79706e-3439-4f94-817c-39dff6f28c1d-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.365198 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.365147    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmpz\" (UniqueName: \"kubernetes.io/projected/1e79706e-3439-4f94-817c-39dff6f28c1d-kube-api-access-tpmpz\") pod \"klusterlet-addon-workmgr-74d659649f-hcx4c\" (UID: \"1e79706e-3439-4f94-817c-39dff6f28c1d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.451959 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.451914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfjp\" (UniqueName: \"kubernetes.io/projected/0f72ae0d-9075-497b-bc70-c7a22f07a94d-kube-api-access-tpfjp\") pod \"downloads-68c9cbb497-tvs9q\" (UID: \"0f72ae0d-9075-497b-bc70-c7a22f07a94d\") " pod="openshift-console/downloads-68c9cbb497-tvs9q"
Jul 11 23:58:00.466235 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.466189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfjp\" (UniqueName: \"kubernetes.io/projected/0f72ae0d-9075-497b-bc70-c7a22f07a94d-kube-api-access-tpfjp\") pod \"downloads-68c9cbb497-tvs9q\" (UID: \"0f72ae0d-9075-497b-bc70-c7a22f07a94d\") " pod="openshift-console/downloads-68c9cbb497-tvs9q"
Jul 11 23:58:00.499983 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.499943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:00.606558 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.606304    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-tvs9q"
Jul 11 23:58:00.685573 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.685525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"]
Jul 11 23:58:00.695092 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:00.695029    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e79706e_3439_4f94_817c_39dff6f28c1d.slice/crio-e5d6664008c6f82d7a65337fe603d146308caafc480ce9950a6fbcd8badf16b4 WatchSource:0}: Error finding container e5d6664008c6f82d7a65337fe603d146308caafc480ce9950a6fbcd8badf16b4: Status 404 returned error can't find the container with id e5d6664008c6f82d7a65337fe603d146308caafc480ce9950a6fbcd8badf16b4
Jul 11 23:58:00.809405 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:00.809366    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-tvs9q"]
Jul 11 23:58:00.814373 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:00.814331    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f72ae0d_9075_497b_bc70_c7a22f07a94d.slice/crio-515898b0526eeed623dd3946e1b363f51be9c77ba565c8426c18b9bc33f8ccf9 WatchSource:0}: Error finding container 515898b0526eeed623dd3946e1b363f51be9c77ba565c8426c18b9bc33f8ccf9: Status 404 returned error can't find the container with id 515898b0526eeed623dd3946e1b363f51be9c77ba565c8426c18b9bc33f8ccf9
Jul 11 23:58:01.058435 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.058319    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:58:01.058435 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.058386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:58:01.058435 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.058418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:01.058698 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.058458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:58:01.058698 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.058522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:01.058698 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.058570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:58:01.058698 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.058613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:58:01.059722 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.059654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b112c8c3-e2f2-4fdb-8c14-54310010d566-service-ca-bundle\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:01.061875 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.061804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e787a0be-5ca5-40bc-b7a9-1a509c40d23e-metrics-tls\") pod \"dns-default-pl8ts\" (UID: \"e787a0be-5ca5-40bc-b7a9-1a509c40d23e\") " pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:58:01.062202 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.062171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a65a8b5c-3cce-4961-bb2e-91534abad110-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tqmbc\" (UID: \"a65a8b5c-3cce-4961-bb2e-91534abad110\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:58:01.062295 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.062180    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58c932fb-0b1b-4c14-a044-ae8d727f27cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-d4gkv\" (UID: \"58c932fb-0b1b-4c14-a044-ae8d727f27cb\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:58:01.062345 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.062317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4884128-9626-4070-9196-631e31785a2f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-z2mxp\" (UID: \"b4884128-9626-4070-9196-631e31785a2f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:58:01.062465 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.062441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"image-registry-6546b5747c-7grk2\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") " pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:58:01.062872 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.062851    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b112c8c3-e2f2-4fdb-8c14-54310010d566-metrics-certs\") pod \"router-default-54f86fdd8d-pqx5n\" (UID: \"b112c8c3-e2f2-4fdb-8c14-54310010d566\") " pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:01.190443 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.190400    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kkhgr\""
Jul 11 23:58:01.198104 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.198070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"
Jul 11 23:58:01.199315 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.199279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl224\""
Jul 11 23:58:01.207431 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.207380    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:58:01.230960 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.230916    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fmb2l\""
Jul 11 23:58:01.237832 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.237790    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pcsfw\""
Jul 11 23:58:01.238746 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.238707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"
Jul 11 23:58:01.246260 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.246218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:58:01.247331 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.247304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hbm4k\""
Jul 11 23:58:01.255242 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.255206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:01.255674 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.255434    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c22j8\""
Jul 11 23:58:01.262780 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.262735    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"
Jul 11 23:58:01.281052 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.281003    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-tvs9q" event={"ID":"0f72ae0d-9075-497b-bc70-c7a22f07a94d","Type":"ContainerStarted","Data":"515898b0526eeed623dd3946e1b363f51be9c77ba565c8426c18b9bc33f8ccf9"}
Jul 11 23:58:01.283786 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.283698    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72xrz" event={"ID":"fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b","Type":"ContainerStarted","Data":"2318731d61ba785b7cba425fac22ba7dfa7973a1812026553a18a3c416726d5f"}
Jul 11 23:58:01.285303 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.285232    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c" event={"ID":"1e79706e-3439-4f94-817c-39dff6f28c1d","Type":"ContainerStarted","Data":"e5d6664008c6f82d7a65337fe603d146308caafc480ce9950a6fbcd8badf16b4"}
Jul 11 23:58:01.302981 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:01.302801    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-72xrz" podStartSLOduration=68.091425568 podStartE2EDuration="1m9.302773412s" totalImagesPullingTime="1.211347844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:01.300598936 +0000 UTC m=+69.103507825" watchObservedRunningTime="2026-07-11 23:58:01.302773412 +0000 UTC m=+69.105682304"
Jul 11 23:58:04.805523 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:04.805424    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-z2mxp"]
Jul 11 23:58:04.810472 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:04.810004    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4884128_9626_4070_9196_631e31785a2f.slice/crio-037f0fb14d4b20dc628ac936ece4ac4c868929047ec7881848c6758f2a2f12e4 WatchSource:0}: Error finding container 037f0fb14d4b20dc628ac936ece4ac4c868929047ec7881848c6758f2a2f12e4: Status 404 returned error can't find the container with id 037f0fb14d4b20dc628ac936ece4ac4c868929047ec7881848c6758f2a2f12e4
Jul 11 23:58:04.816237 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:04.816172    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6546b5747c-7grk2"]
Jul 11 23:58:04.820885 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:04.820846    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e5dccb_8a5f_48af_ad79_3eb8149727a9.slice/crio-54bdb194a84fecfe5e917837a5d316dee0ec8e785f9c42487068352d9a9336fb WatchSource:0}: Error finding container 54bdb194a84fecfe5e917837a5d316dee0ec8e785f9c42487068352d9a9336fb: Status 404 returned error can't find the container with id 54bdb194a84fecfe5e917837a5d316dee0ec8e785f9c42487068352d9a9336fb
Jul 11 23:58:04.972200 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:04.971359    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc"]
Jul 11 23:58:04.973288 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:04.972656    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv"]
Jul 11 23:58:04.974986 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:04.974915    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f86fdd8d-pqx5n"]
Jul 11 23:58:04.976676 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:04.976618    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pl8ts"]
Jul 11 23:58:04.979051 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:04.978995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb112c8c3_e2f2_4fdb_8c14_54310010d566.slice/crio-676e676030178f5687637b86f474bdb15b48fc96afdf57c8a8d604a4e0aa16b6 WatchSource:0}: Error finding container 676e676030178f5687637b86f474bdb15b48fc96afdf57c8a8d604a4e0aa16b6: Status 404 returned error can't find the container with id 676e676030178f5687637b86f474bdb15b48fc96afdf57c8a8d604a4e0aa16b6
Jul 11 23:58:04.983114 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:04.983072    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode787a0be_5ca5_40bc_b7a9_1a509c40d23e.slice/crio-8df5efbdcd5f8e4ae9794b586343cd759d7b075a4d4508c199b2485a369c227b WatchSource:0}: Error finding container 8df5efbdcd5f8e4ae9794b586343cd759d7b075a4d4508c199b2485a369c227b: Status 404 returned error can't find the container with id 8df5efbdcd5f8e4ae9794b586343cd759d7b075a4d4508c199b2485a369c227b
Jul 11 23:58:05.328165 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.327983    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc" event={"ID":"a65a8b5c-3cce-4961-bb2e-91534abad110","Type":"ContainerStarted","Data":"3e4477adb8e249c71eb0772a827d4538b475f66d7d29ebdc8f5c03220dfc1770"}
Jul 11 23:58:05.332550 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.331616    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hzf8m" event={"ID":"2e31c781-af27-43f5-ba5c-91fe3e687053","Type":"ContainerStarted","Data":"ad965e291bcc075e7c677433aee00d61d344864ce2f08b98f5efbd7539757776"}
Jul 11 23:58:05.337477 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.336243    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n" event={"ID":"b112c8c3-e2f2-4fdb-8c14-54310010d566","Type":"ContainerStarted","Data":"739dca4a04fbe8b04665fa060f93bebe471183139c4301f4f5e17f021187a973"}
Jul 11 23:58:05.337477 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.336319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n" event={"ID":"b112c8c3-e2f2-4fdb-8c14-54310010d566","Type":"ContainerStarted","Data":"676e676030178f5687637b86f474bdb15b48fc96afdf57c8a8d604a4e0aa16b6"}
Jul 11 23:58:05.340943 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.340835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl8ts" event={"ID":"e787a0be-5ca5-40bc-b7a9-1a509c40d23e","Type":"ContainerStarted","Data":"8df5efbdcd5f8e4ae9794b586343cd759d7b075a4d4508c199b2485a369c227b"}
Jul 11 23:58:05.343265 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.343168    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp" event={"ID":"b4884128-9626-4070-9196-631e31785a2f","Type":"ContainerStarted","Data":"037f0fb14d4b20dc628ac936ece4ac4c868929047ec7881848c6758f2a2f12e4"}
Jul 11 23:58:05.348636 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.347675    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hzf8m" podStartSLOduration=66.893893156 podStartE2EDuration="1m12.347653027s" totalImagesPullingTime="5.453759871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:05.347256687 +0000 UTC m=+73.150165575" watchObservedRunningTime="2026-07-11 23:58:05.347653027 +0000 UTC m=+73.150561896"
Jul 11 23:58:05.352846 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.351997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmrx" event={"ID":"5953328f-6a94-4f49-9343-535a7b265a73","Type":"ContainerStarted","Data":"78e746ada494f950f7cd8adaf0f37cd1d59512c9a8be7e48b89be89f73184614"}
Jul 11 23:58:05.359647 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.358825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6546b5747c-7grk2" event={"ID":"84e5dccb-8a5f-48af-ad79-3eb8149727a9","Type":"ContainerStarted","Data":"46401c111060b8725c0558ca0c97232918bf19dbf6bcaf545d8942a04cec21a8"}
Jul 11 23:58:05.359647 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.358896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6546b5747c-7grk2" event={"ID":"84e5dccb-8a5f-48af-ad79-3eb8149727a9","Type":"ContainerStarted","Data":"54bdb194a84fecfe5e917837a5d316dee0ec8e785f9c42487068352d9a9336fb"}
Jul 11 23:58:05.359647 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.359555    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:58:05.361716 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.361632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv" event={"ID":"58c932fb-0b1b-4c14-a044-ae8d727f27cb","Type":"ContainerStarted","Data":"cf28e62a031be35692e1621585ab0bf3a8f327448fbc10b22a6bd62c43540d0b"}
Jul 11 23:58:05.366159 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.365457    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n" podStartSLOduration=64.365435569 podStartE2EDuration="1m4.365435569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:05.365128123 +0000 UTC m=+73.168037012" watchObservedRunningTime="2026-07-11 23:58:05.365435569 +0000 UTC m=+73.168344456"
Jul 11 23:58:05.386869 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.384938    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-shmrx" podStartSLOduration=18.072179688 podStartE2EDuration="27.384912173s" totalImagesPullingTime="9.312732485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:05.384613991 +0000 UTC m=+73.187522917" watchObservedRunningTime="2026-07-11 23:58:05.384912173 +0000 UTC m=+73.187821062"
Jul 11 23:58:05.406930 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:05.406359    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6546b5747c-7grk2" podStartSLOduration=72.406333384 podStartE2EDuration="1m12.406333384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:05.404518739 +0000 UTC m=+73.207427641" watchObservedRunningTime="2026-07-11 23:58:05.406333384 +0000 UTC m=+73.209242273"
Jul 11 23:58:06.008246 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.006652    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7bd8bdf8-qrgxc"]
Jul 11 23:58:06.021125 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.019951    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7bd8bdf8-qrgxc"]
Jul 11 23:58:06.021125 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.020103    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.036087 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.034853    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 11 23:58:06.036087 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.035009    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tjm2k\""
Jul 11 23:58:06.036087 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.035210    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 11 23:58:06.036087 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.035616    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 11 23:58:06.036087 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.036080    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 11 23:58:06.039626 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.036419    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 11 23:58:06.107779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.107457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-service-ca\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.107779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.107511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-oauth-serving-cert\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.107779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.107568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-config\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.107779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.107611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-serving-cert\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.107779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.107638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-oauth-config\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.107779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.107710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns8bg\" (UniqueName: \"kubernetes.io/projected/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-kube-api-access-ns8bg\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.208992 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.208943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-config\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.209217 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.209011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-serving-cert\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.209217 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.209053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-oauth-config\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.209217 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.209125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8bg\" (UniqueName: \"kubernetes.io/projected/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-kube-api-access-ns8bg\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.209217 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.209175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-service-ca\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.209217 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.209200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-oauth-serving-cert\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.212118 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.210000    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-oauth-serving-cert\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.212118 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.210676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-config\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.212118 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.211596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-service-ca\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.224130 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.219816    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-serving-cert\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.224130 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.222628    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-oauth-config\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.224130 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.223294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8bg\" (UniqueName: \"kubernetes.io/projected/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-kube-api-access-ns8bg\") pod \"console-5f7bd8bdf8-qrgxc\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") " pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.256441 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.256406    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:06.259633 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.259551    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:06.357734 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.357383    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:06.371143 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.371073    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:06.372170 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:06.372129    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54f86fdd8d-pqx5n"
Jul 11 23:58:11.885311 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:11.885278    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7bd8bdf8-qrgxc"]
Jul 11 23:58:11.890812 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:11.890768    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0b75fb_b83d_4e8c_9e90_7dd7a524eb1f.slice/crio-1766c58dd3f8c1b4124d0402ca15a04cf4186425f5c1f7257873d1227813967d WatchSource:0}: Error finding container 1766c58dd3f8c1b4124d0402ca15a04cf4186425f5c1f7257873d1227813967d: Status 404 returned error can't find the container with id 1766c58dd3f8c1b4124d0402ca15a04cf4186425f5c1f7257873d1227813967d
Jul 11 23:58:12.401478 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.401356    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7bd8bdf8-qrgxc" event={"ID":"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f","Type":"ContainerStarted","Data":"1766c58dd3f8c1b4124d0402ca15a04cf4186425f5c1f7257873d1227813967d"}
Jul 11 23:58:12.404722 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.404606    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl8ts" event={"ID":"e787a0be-5ca5-40bc-b7a9-1a509c40d23e","Type":"ContainerStarted","Data":"8591833f3dea9881e8fd45fbddf9e33c7b48206454a1e3775b6bee9d25c98dd4"}
Jul 11 23:58:12.404722 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.404684    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl8ts" event={"ID":"e787a0be-5ca5-40bc-b7a9-1a509c40d23e","Type":"ContainerStarted","Data":"bebc4459f1332c48b67ba543a6746fba4ec88687746a0d4a3317a856bb549dc9"}
Jul 11 23:58:12.405078 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.405025    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:58:12.407675 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.407630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp" event={"ID":"b4884128-9626-4070-9196-631e31785a2f","Type":"ContainerStarted","Data":"a9ed16476ac92be0fb0ecc3fad2a26979f28ba505fbeec8f621c25b469ce893e"}
Jul 11 23:58:12.410369 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.410339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c" event={"ID":"1e79706e-3439-4f94-817c-39dff6f28c1d","Type":"ContainerStarted","Data":"9832f6af00576a82e065ef32baff082b2904a4e5700a6719a97e62fc99f11f1d"}
Jul 11 23:58:12.410785 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.410716    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:12.412745 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.412714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv" event={"ID":"58c932fb-0b1b-4c14-a044-ae8d727f27cb","Type":"ContainerStarted","Data":"2e1d67bd68f770814129b9d62c942b83bcf4c34c3b440c5bd03abf916252c469"}
Jul 11 23:58:12.412982 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.412964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c"
Jul 11 23:58:12.416160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.416067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc" event={"ID":"a65a8b5c-3cce-4961-bb2e-91534abad110","Type":"ContainerStarted","Data":"e5e590045d28369e33bb07866a0c4f472c9c666129004501a11da1c591e781fe"}
Jul 11 23:58:12.416160 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.416123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc" event={"ID":"a65a8b5c-3cce-4961-bb2e-91534abad110","Type":"ContainerStarted","Data":"45ecd385476952976eab95232ecf8ce3015b5847643b59d2a575810993203008"}
Jul 11 23:58:12.425472 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.424596    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pl8ts" podStartSLOduration=36.696188593 podStartE2EDuration="43.424572257s" totalImagesPullingTime="6.728383664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:12.424134718 +0000 UTC m=+80.227043606" watchObservedRunningTime="2026-07-11 23:58:12.424572257 +0000 UTC m=+80.227481145"
Jul 11 23:58:12.447170 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.446935    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-d4gkv" podStartSLOduration=64.739172306 podStartE2EDuration="1m11.446910439s" totalImagesPullingTime="6.707738133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:12.445373615 +0000 UTC m=+80.248282504" watchObservedRunningTime="2026-07-11 23:58:12.446910439 +0000 UTC m=+80.249819327"
Jul 11 23:58:12.467072 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.466988    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d659649f-hcx4c" podStartSLOduration=1.421269765 podStartE2EDuration="12.46696707s" totalImagesPullingTime="11.045697305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:12.465573223 +0000 UTC m=+80.268482108" watchObservedRunningTime="2026-07-11 23:58:12.46696707 +0000 UTC m=+80.269875958"
Jul 11 23:58:12.483201 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:12.482892    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-z2mxp" podStartSLOduration=55.606558623 podStartE2EDuration="1m2.482865416s" totalImagesPullingTime="6.876306793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:12.48191674 +0000 UTC m=+80.284825628" watchObservedRunningTime="2026-07-11 23:58:12.482865416 +0000 UTC m=+80.285774321"
Jul 11 23:58:15.432893 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:15.432858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7bd8bdf8-qrgxc" event={"ID":"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f","Type":"ContainerStarted","Data":"f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618"}
Jul 11 23:58:15.449998 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:15.449929    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tqmbc" podStartSLOduration=67.786524797 podStartE2EDuration="1m14.449908313s" totalImagesPullingTime="6.663383516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:12.50148083 +0000 UTC m=+80.304389717" watchObservedRunningTime="2026-07-11 23:58:15.449908313 +0000 UTC m=+83.252817239"
Jul 11 23:58:15.450433 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:15.450405    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7bd8bdf8-qrgxc" podStartSLOduration=7.235617085 podStartE2EDuration="10.450394277s" totalImagesPullingTime="3.214777192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:15.44920238 +0000 UTC m=+83.252111270" watchObservedRunningTime="2026-07-11 23:58:15.450394277 +0000 UTC m=+83.253303164"
Jul 11 23:58:16.358419 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:16.358360    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:16.358614 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:16.358453    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:16.364190 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:16.364156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:16.442630 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:16.442591    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:21.692461 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.692421    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7rl79"]
Jul 11 23:58:21.865283 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.865244    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.869396 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.869213    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 23:58:21.869396 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.869312    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 23:58:21.870015 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.869771    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 23:58:21.870015 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.869827    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qbcvt\""
Jul 11 23:58:21.870015 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.869849    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 23:58:21.966932 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.966838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94642288-d7a7-476c-8bf8-943671c75d7a-metrics-client-ca\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.966932 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.966888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvw5n\" (UniqueName: \"kubernetes.io/projected/94642288-d7a7-476c-8bf8-943671c75d7a-kube-api-access-vvw5n\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.967214 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.966934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-textfile\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.967214 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.966980    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.967214 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.967012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.967214 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.967134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-root\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.967214 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.967170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-sys\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.967214 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.967189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-tls\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:21.967214 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:21.967209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-wtmp\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.067843 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-root\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.067843 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-sys\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-tls\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-wtmp\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94642288-d7a7-476c-8bf8-943671c75d7a-metrics-client-ca\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-root\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvw5n\" (UniqueName: \"kubernetes.io/projected/94642288-d7a7-476c-8bf8-943671c75d7a-kube-api-access-vvw5n\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.068018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-textfile\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068128 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.067972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-sys\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068483 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.068129    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-wtmp\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068483 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.068167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068483 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.068201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068483 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.068440    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-textfile\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068634 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.068611    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94642288-d7a7-476c-8bf8-943671c75d7a-metrics-client-ca\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.068941 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.068890    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.071381 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.071350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.071546 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.071419    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94642288-d7a7-476c-8bf8-943671c75d7a-node-exporter-tls\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.077060 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.077007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvw5n\" (UniqueName: \"kubernetes.io/projected/94642288-d7a7-476c-8bf8-943671c75d7a-kube-api-access-vvw5n\") pod \"node-exporter-7rl79\" (UID: \"94642288-d7a7-476c-8bf8-943671c75d7a\") " pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.176970 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.176921    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7rl79"
Jul 11 23:58:22.424193 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:22.424155    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pl8ts"
Jul 11 23:58:23.276232 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:23.276188    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6546b5747c-7grk2"]
Jul 11 23:58:23.282438 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:23.282368    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:58:23.366407 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:58:23.366366    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94642288_d7a7_476c_8bf8_943671c75d7a.slice/crio-e88c1e4638bd0b0e4815729a1a9ee5cf21a024c7ff62df69896d80c10955541c WatchSource:0}: Error finding container e88c1e4638bd0b0e4815729a1a9ee5cf21a024c7ff62df69896d80c10955541c: Status 404 returned error can't find the container with id e88c1e4638bd0b0e4815729a1a9ee5cf21a024c7ff62df69896d80c10955541c
Jul 11 23:58:23.471875 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:23.471840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rl79" event={"ID":"94642288-d7a7-476c-8bf8-943671c75d7a","Type":"ContainerStarted","Data":"e88c1e4638bd0b0e4815729a1a9ee5cf21a024c7ff62df69896d80c10955541c"}
Jul 11 23:58:24.478571 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:24.478527    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-tvs9q" event={"ID":"0f72ae0d-9075-497b-bc70-c7a22f07a94d","Type":"ContainerStarted","Data":"ad52d72ff6e7f17c5f1a3238f329ec07f35e22d93ba3c4473cd0e60e7f9547d0"}
Jul 11 23:58:24.479082 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:24.478932    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-tvs9q"
Jul 11 23:58:24.489701 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:24.489663    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-tvs9q"
Jul 11 23:58:24.495606 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:24.495540    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-tvs9q" podStartSLOduration=1.602668904 podStartE2EDuration="24.495518502s" totalImagesPullingTime="22.892849598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:24.494481973 +0000 UTC m=+92.297390859" watchObservedRunningTime="2026-07-11 23:58:24.495518502 +0000 UTC m=+92.298427389"
Jul 11 23:58:24.724233 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:24.724192    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7bd8bdf8-qrgxc"]
Jul 11 23:58:25.485905 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:25.485856    2583 generic.go:356] "Generic (PLEG): container finished" podID="94642288-d7a7-476c-8bf8-943671c75d7a" containerID="35a4ae11bcfcd26c9bb3c3bf49324cc667d8fda2890517c1fc4c45c8d6344ea2" exitCode=0
Jul 11 23:58:25.486441 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:25.485941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rl79" event={"ID":"94642288-d7a7-476c-8bf8-943671c75d7a","Type":"ContainerDied","Data":"35a4ae11bcfcd26c9bb3c3bf49324cc667d8fda2890517c1fc4c45c8d6344ea2"}
Jul 11 23:58:26.493124 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:26.493076    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rl79" event={"ID":"94642288-d7a7-476c-8bf8-943671c75d7a","Type":"ContainerStarted","Data":"00896304c496cb3928e279a0d022b477c81bce6c0e1fd84cfb66873bb7b6aff7"}
Jul 11 23:58:26.493633 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:26.493151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rl79" event={"ID":"94642288-d7a7-476c-8bf8-943671c75d7a","Type":"ContainerStarted","Data":"f092997c9da71491ebde17e1688af2088a6e424e205541a0f979a4fb9a2656e5"}
Jul 11 23:58:26.517327 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:26.517254    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7rl79" podStartSLOduration=4.176905244 podStartE2EDuration="5.51723101s" totalImagesPullingTime="1.185863463s" totalInitContainerRuntime="154.462303ms" isStatefulPod=true podCreationTimestamp="2026-07-11 23:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:26.516018058 +0000 UTC m=+94.318926945" watchObservedRunningTime="2026-07-11 23:58:26.51723101 +0000 UTC m=+94.320139897"
Jul 11 23:58:30.278478 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:30.278446    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gngl6"
Jul 11 23:58:48.303147 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.303071    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6546b5747c-7grk2" podUID="84e5dccb-8a5f-48af-ad79-3eb8149727a9" containerName="registry" containerID="cri-o://46401c111060b8725c0558ca0c97232918bf19dbf6bcaf545d8942a04cec21a8" gracePeriod=30
Jul 11 23:58:48.584539 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.584499    2583 generic.go:356] "Generic (PLEG): container finished" podID="84e5dccb-8a5f-48af-ad79-3eb8149727a9" containerID="46401c111060b8725c0558ca0c97232918bf19dbf6bcaf545d8942a04cec21a8" exitCode=0
Jul 11 23:58:48.584719 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.584568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6546b5747c-7grk2" event={"ID":"84e5dccb-8a5f-48af-ad79-3eb8149727a9","Type":"ContainerDied","Data":"46401c111060b8725c0558ca0c97232918bf19dbf6bcaf545d8942a04cec21a8"}
Jul 11 23:58:48.584719 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.584614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6546b5747c-7grk2" event={"ID":"84e5dccb-8a5f-48af-ad79-3eb8149727a9","Type":"ContainerDied","Data":"54bdb194a84fecfe5e917837a5d316dee0ec8e785f9c42487068352d9a9336fb"}
Jul 11 23:58:48.584719 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.584631    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54bdb194a84fecfe5e917837a5d316dee0ec8e785f9c42487068352d9a9336fb"
Jul 11 23:58:48.589453 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.589432    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:58:48.599478 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-trusted-ca\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.599597 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-bound-sa-token\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.599597 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599513    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jp8x\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-kube-api-access-7jp8x\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.599597 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599544    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.599597 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599591    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-image-registry-private-configuration\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.599773 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599631    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-installation-pull-secrets\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.599773 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599659    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84e5dccb-8a5f-48af-ad79-3eb8149727a9-ca-trust-extracted\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.599773 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599711    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-certificates\") pod \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\" (UID: \"84e5dccb-8a5f-48af-ad79-3eb8149727a9\") "
Jul 11 23:58:48.600057 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.599968    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 23:58:48.600355 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.600313    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 23:58:48.602435 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.602375    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 23:58:48.602574 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.602476    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 23:58:48.602574 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.602546    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-kube-api-access-7jp8x" (OuterVolumeSpecName: "kube-api-access-7jp8x") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "kube-api-access-7jp8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 23:58:48.602671 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.602641    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 23:58:48.602878 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.602848    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 23:58:48.608925 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.608881    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e5dccb-8a5f-48af-ad79-3eb8149727a9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "84e5dccb-8a5f-48af-ad79-3eb8149727a9" (UID: "84e5dccb-8a5f-48af-ad79-3eb8149727a9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 23:58:48.700668 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700623    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-certificates\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:48.700668 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700663    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84e5dccb-8a5f-48af-ad79-3eb8149727a9-trusted-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:48.700668 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700674    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-bound-sa-token\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:48.700668 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700682    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jp8x\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-kube-api-access-7jp8x\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:48.700995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700691    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84e5dccb-8a5f-48af-ad79-3eb8149727a9-registry-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:48.700995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700702    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-image-registry-private-configuration\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:48.700995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700713    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84e5dccb-8a5f-48af-ad79-3eb8149727a9-installation-pull-secrets\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:48.700995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:48.700722    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84e5dccb-8a5f-48af-ad79-3eb8149727a9-ca-trust-extracted\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:49.590017 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:49.589908    2583 generic.go:356] "Generic (PLEG): container finished" podID="bbb3ae2c-238d-481d-a113-04517f3cdf3d" containerID="43cdd3a34ec28ef27fe85344294154ababc389a87a4420d718f6a8bf55cc2f55" exitCode=0
Jul 11 23:58:49.590017 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:49.589980    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b" event={"ID":"bbb3ae2c-238d-481d-a113-04517f3cdf3d","Type":"ContainerDied","Data":"43cdd3a34ec28ef27fe85344294154ababc389a87a4420d718f6a8bf55cc2f55"}
Jul 11 23:58:49.590599 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:49.590108    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6546b5747c-7grk2"
Jul 11 23:58:49.590599 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:49.590363    2583 scope.go:117] "RemoveContainer" containerID="43cdd3a34ec28ef27fe85344294154ababc389a87a4420d718f6a8bf55cc2f55"
Jul 11 23:58:49.619258 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:49.619225    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6546b5747c-7grk2"]
Jul 11 23:58:49.626271 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:49.626237    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6546b5747c-7grk2"]
Jul 11 23:58:49.757821 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:49.757773    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f7bd8bdf8-qrgxc" podUID="cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" containerName="console" containerID="cri-o://f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618" gracePeriod=15
Jul 11 23:58:50.053439 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.053394    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:50.112229 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112170    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-serving-cert\") pod \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") "
Jul 11 23:58:50.112229 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112237    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns8bg\" (UniqueName: \"kubernetes.io/projected/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-kube-api-access-ns8bg\") pod \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") "
Jul 11 23:58:50.112513 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112255    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-oauth-serving-cert\") pod \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") "
Jul 11 23:58:50.112513 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112276    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-config\") pod \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") "
Jul 11 23:58:50.112513 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112313    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-service-ca\") pod \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") "
Jul 11 23:58:50.112513 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112383    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-oauth-config\") pod \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\" (UID: \"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f\") "
Jul 11 23:58:50.112755 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112715    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-config" (OuterVolumeSpecName: "console-config") pod "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" (UID: "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 23:58:50.112806 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.112747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" (UID: "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 23:58:50.113104 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.113078    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-service-ca" (OuterVolumeSpecName: "service-ca") pod "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" (UID: "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 23:58:50.114771 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.114740    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" (UID: "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 23:58:50.115017 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.114994    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" (UID: "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 23:58:50.115117 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.115031    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-kube-api-access-ns8bg" (OuterVolumeSpecName: "kube-api-access-ns8bg") pod "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" (UID: "cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f"). InnerVolumeSpecName "kube-api-access-ns8bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 23:58:50.213779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.213726    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-oauth-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:50.213779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.213767    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:50.213779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.213777    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns8bg\" (UniqueName: \"kubernetes.io/projected/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-kube-api-access-ns8bg\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:50.213779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.213787    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-oauth-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:50.213779 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.213796    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-console-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:50.214152 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.213804    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 11 23:58:50.595342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.595243    2583 generic.go:356] "Generic (PLEG): container finished" podID="cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" containerID="f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618" exitCode=0
Jul 11 23:58:50.595342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.595294    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7bd8bdf8-qrgxc"
Jul 11 23:58:50.595342 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.595334    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7bd8bdf8-qrgxc" event={"ID":"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f","Type":"ContainerDied","Data":"f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618"}
Jul 11 23:58:50.595910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.595385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7bd8bdf8-qrgxc" event={"ID":"cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f","Type":"ContainerDied","Data":"1766c58dd3f8c1b4124d0402ca15a04cf4186425f5c1f7257873d1227813967d"}
Jul 11 23:58:50.595910 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.595406    2583 scope.go:117] "RemoveContainer" containerID="f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618"
Jul 11 23:58:50.597501 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.597476    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tv62b" event={"ID":"bbb3ae2c-238d-481d-a113-04517f3cdf3d","Type":"ContainerStarted","Data":"50c0c94649e492507e1869932923aa9f9b6ede8bdd46ec44be9da07964eeb3ef"}
Jul 11 23:58:50.610781 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.610759    2583 scope.go:117] "RemoveContainer" containerID="f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618"
Jul 11 23:58:50.611188 ip-10-0-134-216 kubenswrapper[2583]: E0711 23:58:50.611155    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618\": container with ID starting with f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618 not found: ID does not exist" containerID="f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618"
Jul 11 23:58:50.611259 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.611200    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618"} err="failed to get container status \"f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618\": rpc error: code = NotFound desc = could not find container \"f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618\": container with ID starting with f8789ea874bfcab14b4ada4d8d2d13b910e06810687da9ba317aef4c5c346618 not found: ID does not exist"
Jul 11 23:58:50.630107 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.630067    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7bd8bdf8-qrgxc"]
Jul 11 23:58:50.635405 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.635371    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7bd8bdf8-qrgxc"]
Jul 11 23:58:50.781054 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.781003    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84e5dccb-8a5f-48af-ad79-3eb8149727a9" path="/var/lib/kubelet/pods/84e5dccb-8a5f-48af-ad79-3eb8149727a9/volumes"
Jul 11 23:58:50.781455 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:50.781440    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" path="/var/lib/kubelet/pods/cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f/volumes"
Jul 11 23:58:58.630835 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:58.630795    2583 generic.go:356] "Generic (PLEG): container finished" podID="175095ee-5dfc-4787-bad8-53ce2a1e707f" containerID="e96d42af0ce4858b760c9630edaeed1da22b09ab4f2c6e016091f2cea83bcaf4" exitCode=0
Jul 11 23:58:58.631322 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:58.630877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c" event={"ID":"175095ee-5dfc-4787-bad8-53ce2a1e707f","Type":"ContainerDied","Data":"e96d42af0ce4858b760c9630edaeed1da22b09ab4f2c6e016091f2cea83bcaf4"}
Jul 11 23:58:58.631322 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:58.631298    2583 scope.go:117] "RemoveContainer" containerID="e96d42af0ce4858b760c9630edaeed1da22b09ab4f2c6e016091f2cea83bcaf4"
Jul 11 23:58:59.636843 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:58:59.636798    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wpn8c" event={"ID":"175095ee-5dfc-4787-bad8-53ce2a1e707f","Type":"ContainerStarted","Data":"d00cd44a498c627ef77ca8eee9db449456ed279acc1c4bcdd0014680cd5f1736"}
Jul 11 23:59:13.693995 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:13.693958    2583 generic.go:356] "Generic (PLEG): container finished" podID="eb31f674-c7a0-4096-9cea-3600d61e9af7" containerID="7b46172a2aa37b35b6b2334c0328a02edc58b1a984e20550fd8eb6ad419ecb52" exitCode=0
Jul 11 23:59:13.694449 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:13.694057    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv" event={"ID":"eb31f674-c7a0-4096-9cea-3600d61e9af7","Type":"ContainerDied","Data":"7b46172a2aa37b35b6b2334c0328a02edc58b1a984e20550fd8eb6ad419ecb52"}
Jul 11 23:59:13.694494 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:13.694471    2583 scope.go:117] "RemoveContainer" containerID="7b46172a2aa37b35b6b2334c0328a02edc58b1a984e20550fd8eb6ad419ecb52"
Jul 11 23:59:14.703880 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:14.703842    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xrjv" event={"ID":"eb31f674-c7a0-4096-9cea-3600d61e9af7","Type":"ContainerStarted","Data":"541f36baf8f759b1d8a6aa7bb1d576dace40cc11c13ba840ca6f03fb5bae882a"}
Jul 11 23:59:49.708741 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.708697    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7794bf947d-w8xzp"]
Jul 11 23:59:49.709300 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.709072    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" containerName="console"
Jul 11 23:59:49.709300 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.709089    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" containerName="console"
Jul 11 23:59:49.709300 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.709113    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e5dccb-8a5f-48af-ad79-3eb8149727a9" containerName="registry"
Jul 11 23:59:49.709300 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.709119    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e5dccb-8a5f-48af-ad79-3eb8149727a9" containerName="registry"
Jul 11 23:59:49.709300 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.709180    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e5dccb-8a5f-48af-ad79-3eb8149727a9" containerName="registry"
Jul 11 23:59:49.709300 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.709191    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0b75fb-b83d-4e8c-9e90-7dd7a524eb1f" containerName="console"
Jul 11 23:59:49.711590 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.711561    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.715440 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.715232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 11 23:59:49.715440 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.715260    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tjm2k\""
Jul 11 23:59:49.715440 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.715281    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 11 23:59:49.715440 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.715313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 11 23:59:49.715440 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.715315    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 11 23:59:49.715440 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.715391    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 11 23:59:49.720352 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.720322    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 11 23:59:49.725200 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.725164    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7794bf947d-w8xzp"]
Jul 11 23:59:49.809431 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.809386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-service-ca\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.809431 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.809427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-oauth-serving-cert\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.809720 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.809472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-serving-cert\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.809720 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.809552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-oauth-config\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.809720 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.809636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-config\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.809720 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.809663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-trusted-ca-bundle\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.809720 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.809689    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl2cv\" (UniqueName: \"kubernetes.io/projected/98d07540-ee66-4d06-9003-96bd6a1e88b7-kube-api-access-bl2cv\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.910425 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.910385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-serving-cert\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.910425 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.910428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-oauth-config\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.910723 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.910451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-config\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.910723 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.910472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-trusted-ca-bundle\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.910723 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.910500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl2cv\" (UniqueName: \"kubernetes.io/projected/98d07540-ee66-4d06-9003-96bd6a1e88b7-kube-api-access-bl2cv\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.910723 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.910561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-service-ca\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.910723 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.910584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-oauth-serving-cert\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.911393 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.911367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-config\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.911507 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.911415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-service-ca\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.911570 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.911548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-oauth-serving-cert\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.911615 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.911548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-trusted-ca-bundle\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.913295 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.913271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-oauth-config\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.913383 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.913320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-serving-cert\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:49.919985 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:49.919955    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl2cv\" (UniqueName: \"kubernetes.io/projected/98d07540-ee66-4d06-9003-96bd6a1e88b7-kube-api-access-bl2cv\") pod \"console-7794bf947d-w8xzp\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") " pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:50.029371 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:50.029242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7794bf947d-w8xzp"
Jul 11 23:59:50.180284 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:50.180128    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7794bf947d-w8xzp"]
Jul 11 23:59:50.183312 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:59:50.183277    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d07540_ee66_4d06_9003_96bd6a1e88b7.slice/crio-8c0b09a0f75404feb5fb996ef38264c9133dc048e239e250da77b4d6aaa590b9 WatchSource:0}: Error finding container 8c0b09a0f75404feb5fb996ef38264c9133dc048e239e250da77b4d6aaa590b9: Status 404 returned error can't find the container with id 8c0b09a0f75404feb5fb996ef38264c9133dc048e239e250da77b4d6aaa590b9
Jul 11 23:59:50.850349 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:50.850311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7794bf947d-w8xzp" event={"ID":"98d07540-ee66-4d06-9003-96bd6a1e88b7","Type":"ContainerStarted","Data":"1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7"}
Jul 11 23:59:50.850743 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:50.850366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7794bf947d-w8xzp" event={"ID":"98d07540-ee66-4d06-9003-96bd6a1e88b7","Type":"ContainerStarted","Data":"8c0b09a0f75404feb5fb996ef38264c9133dc048e239e250da77b4d6aaa590b9"}
Jul 11 23:59:50.867013 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:50.866944    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7794bf947d-w8xzp" podStartSLOduration=1.8669214790000002 podStartE2EDuration="1.866921479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:59:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:59:50.866479324 +0000 UTC m=+178.669388211" watchObservedRunningTime="2026-07-11 23:59:50.866921479 +0000 UTC m=+178.669830367"
Jul 11 23:59:57.103076 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.103022    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7794bf947d-w8xzp"]
Jul 11 23:59:57.136494 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.136456    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f5c78c89c-cnw5w"]
Jul 11 23:59:57.139294 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.139265    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.153308 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.153260    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5c78c89c-cnw5w"]
Jul 11 23:59:57.271868 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.271824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-trusted-ca-bundle\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.271868 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.271874    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-oauth-serving-cert\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.272171 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.271892    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2n87\" (UniqueName: \"kubernetes.io/projected/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-kube-api-access-c2n87\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.272171 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.271996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-service-ca\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.272171 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.272106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-serving-cert\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.272171 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.272129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-oauth-config\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.272171 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.272155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-config\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373185 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373087    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-trusted-ca-bundle\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373185 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-oauth-serving-cert\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373185 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2n87\" (UniqueName: \"kubernetes.io/projected/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-kube-api-access-c2n87\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373505 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373203    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-service-ca\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373505 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-serving-cert\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373505 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-oauth-config\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373505 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-config\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.373928 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-oauth-serving-cert\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.374055 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.373901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-service-ca\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.374120 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.374087    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-config\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.374171 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.374152    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-trusted-ca-bundle\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.376072 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.376005    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-oauth-config\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.376188 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.376147    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-serving-cert\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.382476 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.382439    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2n87\" (UniqueName: \"kubernetes.io/projected/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-kube-api-access-c2n87\") pod \"console-6f5c78c89c-cnw5w\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") " pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.452324 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.452276    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 11 23:59:57.597454 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.597420    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5c78c89c-cnw5w"]
Jul 11 23:59:57.600495 ip-10-0-134-216 kubenswrapper[2583]: W0711 23:59:57.600459    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec2c4e4_ec96_4d0a_8d30_f7ee218d3d3b.slice/crio-c3f9f89296f7d776fe375bbbc043f005782ac53993a9f9abaaff9c25ed7988c2 WatchSource:0}: Error finding container c3f9f89296f7d776fe375bbbc043f005782ac53993a9f9abaaff9c25ed7988c2: Status 404 returned error can't find the container with id c3f9f89296f7d776fe375bbbc043f005782ac53993a9f9abaaff9c25ed7988c2
Jul 11 23:59:57.881289 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.881253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5c78c89c-cnw5w" event={"ID":"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b","Type":"ContainerStarted","Data":"e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd"}
Jul 11 23:59:57.881506 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.881308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5c78c89c-cnw5w" event={"ID":"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b","Type":"ContainerStarted","Data":"c3f9f89296f7d776fe375bbbc043f005782ac53993a9f9abaaff9c25ed7988c2"}
Jul 11 23:59:57.898630 ip-10-0-134-216 kubenswrapper[2583]: I0711 23:59:57.898494    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f5c78c89c-cnw5w" podStartSLOduration=0.898474437 podStartE2EDuration="898.474437ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:59:57.896777998 +0000 UTC m=+185.699686899" watchObservedRunningTime="2026-07-11 23:59:57.898474437 +0000 UTC m=+185.701383324"
Jul 12 00:00:00.030378 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.030324    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7794bf947d-w8xzp"
Jul 12 00:00:00.146750 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.146710    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29730240-dc8wf"]
Jul 12 00:00:00.149171 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.149137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.151855 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.151821    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Jul 12 00:00:00.152017 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.151875    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-m5mnn\""
Jul 12 00:00:00.158502 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.158470    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29730240-dc8wf"]
Jul 12 00:00:00.196936 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.196891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e7e9a9-9fb6-438d-bb97-202a1e03f637-serviceca\") pod \"image-pruner-29730240-dc8wf\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") " pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.197133 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.196966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsfpp\" (UniqueName: \"kubernetes.io/projected/96e7e9a9-9fb6-438d-bb97-202a1e03f637-kube-api-access-tsfpp\") pod \"image-pruner-29730240-dc8wf\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") " pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.298270 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.298157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e7e9a9-9fb6-438d-bb97-202a1e03f637-serviceca\") pod \"image-pruner-29730240-dc8wf\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") " pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.298438 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.298306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsfpp\" (UniqueName: \"kubernetes.io/projected/96e7e9a9-9fb6-438d-bb97-202a1e03f637-kube-api-access-tsfpp\") pod \"image-pruner-29730240-dc8wf\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") " pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.298862 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.298836    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e7e9a9-9fb6-438d-bb97-202a1e03f637-serviceca\") pod \"image-pruner-29730240-dc8wf\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") " pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.306950 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.306913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsfpp\" (UniqueName: \"kubernetes.io/projected/96e7e9a9-9fb6-438d-bb97-202a1e03f637-kube-api-access-tsfpp\") pod \"image-pruner-29730240-dc8wf\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") " pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.482497 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.482458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:00.625249 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.625007    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29730240-dc8wf"]
Jul 12 00:00:00.628013 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:00:00.627983    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e7e9a9_9fb6_438d_bb97_202a1e03f637.slice/crio-e7233f8c385b71e1fd3527b137f038b024f06d47885f5f92a03f8081c7fb085f WatchSource:0}: Error finding container e7233f8c385b71e1fd3527b137f038b024f06d47885f5f92a03f8081c7fb085f: Status 404 returned error can't find the container with id e7233f8c385b71e1fd3527b137f038b024f06d47885f5f92a03f8081c7fb085f
Jul 12 00:00:00.895697 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.895606    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29730240-dc8wf" event={"ID":"96e7e9a9-9fb6-438d-bb97-202a1e03f637","Type":"ContainerStarted","Data":"193eb9acfb6d0ffc5ac1960c29aa4647429f434d3ae4496a02ed891ab680414b"}
Jul 12 00:00:00.895697 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.895664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29730240-dc8wf" event={"ID":"96e7e9a9-9fb6-438d-bb97-202a1e03f637","Type":"ContainerStarted","Data":"e7233f8c385b71e1fd3527b137f038b024f06d47885f5f92a03f8081c7fb085f"}
Jul 12 00:00:00.912828 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:00.912761    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29730240-dc8wf" podStartSLOduration=0.912740186 podStartE2EDuration="912.740186ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:00:00.911017083 +0000 UTC m=+188.713925970" watchObservedRunningTime="2026-07-12 00:00:00.912740186 +0000 UTC m=+188.715649073"
Jul 12 00:00:01.901964 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:01.901916    2583 generic.go:356] "Generic (PLEG): container finished" podID="96e7e9a9-9fb6-438d-bb97-202a1e03f637" containerID="193eb9acfb6d0ffc5ac1960c29aa4647429f434d3ae4496a02ed891ab680414b" exitCode=0
Jul 12 00:00:01.902445 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:01.901999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29730240-dc8wf" event={"ID":"96e7e9a9-9fb6-438d-bb97-202a1e03f637","Type":"ContainerDied","Data":"193eb9acfb6d0ffc5ac1960c29aa4647429f434d3ae4496a02ed891ab680414b"}
Jul 12 00:00:03.050477 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.050441    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:03.120906 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.120841    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e7e9a9-9fb6-438d-bb97-202a1e03f637-serviceca\") pod \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") "
Jul 12 00:00:03.121121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.120918    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsfpp\" (UniqueName: \"kubernetes.io/projected/96e7e9a9-9fb6-438d-bb97-202a1e03f637-kube-api-access-tsfpp\") pod \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\" (UID: \"96e7e9a9-9fb6-438d-bb97-202a1e03f637\") "
Jul 12 00:00:03.121317 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.121293    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e7e9a9-9fb6-438d-bb97-202a1e03f637-serviceca" (OuterVolumeSpecName: "serviceca") pod "96e7e9a9-9fb6-438d-bb97-202a1e03f637" (UID: "96e7e9a9-9fb6-438d-bb97-202a1e03f637"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:00:03.123121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.123087    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e7e9a9-9fb6-438d-bb97-202a1e03f637-kube-api-access-tsfpp" (OuterVolumeSpecName: "kube-api-access-tsfpp") pod "96e7e9a9-9fb6-438d-bb97-202a1e03f637" (UID: "96e7e9a9-9fb6-438d-bb97-202a1e03f637"). InnerVolumeSpecName "kube-api-access-tsfpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:00:03.222250 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.222151    2583 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e7e9a9-9fb6-438d-bb97-202a1e03f637-serviceca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:03.222250 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.222185    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsfpp\" (UniqueName: \"kubernetes.io/projected/96e7e9a9-9fb6-438d-bb97-202a1e03f637-kube-api-access-tsfpp\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:03.911847 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.911817    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29730240-dc8wf"
Jul 12 00:00:03.911847 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.911838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29730240-dc8wf" event={"ID":"96e7e9a9-9fb6-438d-bb97-202a1e03f637","Type":"ContainerDied","Data":"e7233f8c385b71e1fd3527b137f038b024f06d47885f5f92a03f8081c7fb085f"}
Jul 12 00:00:03.912142 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:03.911885    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7233f8c385b71e1fd3527b137f038b024f06d47885f5f92a03f8081c7fb085f"
Jul 12 00:00:07.453065 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:07.453008    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 12 00:00:07.453498 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:07.453111    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 12 00:00:07.458161 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:07.458129    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 12 00:00:07.933444 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:07.933402    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 12 00:00:22.124905 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.124833    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7794bf947d-w8xzp" podUID="98d07540-ee66-4d06-9003-96bd6a1e88b7" containerName="console" containerID="cri-o://1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7" gracePeriod=15
Jul 12 00:00:22.375804 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.375728    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7794bf947d-w8xzp"
Jul 12 00:00:22.489899 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.489858    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-config\") pod \"98d07540-ee66-4d06-9003-96bd6a1e88b7\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") "
Jul 12 00:00:22.490140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.489963    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl2cv\" (UniqueName: \"kubernetes.io/projected/98d07540-ee66-4d06-9003-96bd6a1e88b7-kube-api-access-bl2cv\") pod \"98d07540-ee66-4d06-9003-96bd6a1e88b7\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") "
Jul 12 00:00:22.490140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.489995    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-service-ca\") pod \"98d07540-ee66-4d06-9003-96bd6a1e88b7\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") "
Jul 12 00:00:22.490140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490019    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-oauth-config\") pod \"98d07540-ee66-4d06-9003-96bd6a1e88b7\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") "
Jul 12 00:00:22.490140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490065    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-trusted-ca-bundle\") pod \"98d07540-ee66-4d06-9003-96bd6a1e88b7\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") "
Jul 12 00:00:22.490140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490118    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-serving-cert\") pod \"98d07540-ee66-4d06-9003-96bd6a1e88b7\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") "
Jul 12 00:00:22.490392 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490151    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-oauth-serving-cert\") pod \"98d07540-ee66-4d06-9003-96bd6a1e88b7\" (UID: \"98d07540-ee66-4d06-9003-96bd6a1e88b7\") "
Jul 12 00:00:22.490392 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490373    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-config" (OuterVolumeSpecName: "console-config") pod "98d07540-ee66-4d06-9003-96bd6a1e88b7" (UID: "98d07540-ee66-4d06-9003-96bd6a1e88b7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:00:22.490651 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490608    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98d07540-ee66-4d06-9003-96bd6a1e88b7" (UID: "98d07540-ee66-4d06-9003-96bd6a1e88b7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:00:22.490651 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490621    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "98d07540-ee66-4d06-9003-96bd6a1e88b7" (UID: "98d07540-ee66-4d06-9003-96bd6a1e88b7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:00:22.490841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.490676    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-service-ca" (OuterVolumeSpecName: "service-ca") pod "98d07540-ee66-4d06-9003-96bd6a1e88b7" (UID: "98d07540-ee66-4d06-9003-96bd6a1e88b7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:00:22.492535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.492491    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d07540-ee66-4d06-9003-96bd6a1e88b7-kube-api-access-bl2cv" (OuterVolumeSpecName: "kube-api-access-bl2cv") pod "98d07540-ee66-4d06-9003-96bd6a1e88b7" (UID: "98d07540-ee66-4d06-9003-96bd6a1e88b7"). InnerVolumeSpecName "kube-api-access-bl2cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:00:22.492535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.492514    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98d07540-ee66-4d06-9003-96bd6a1e88b7" (UID: "98d07540-ee66-4d06-9003-96bd6a1e88b7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:00:22.492721 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.492610    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98d07540-ee66-4d06-9003-96bd6a1e88b7" (UID: "98d07540-ee66-4d06-9003-96bd6a1e88b7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:00:22.591337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.591290    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl2cv\" (UniqueName: \"kubernetes.io/projected/98d07540-ee66-4d06-9003-96bd6a1e88b7-kube-api-access-bl2cv\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:22.591337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.591321    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:22.591337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.591337    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-oauth-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:22.591337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.591348    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-trusted-ca-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:22.591612 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.591357    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:22.591612 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.591366    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-oauth-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:22.591612 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.591374    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98d07540-ee66-4d06-9003-96bd6a1e88b7-console-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:00:22.994289 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.994254    2583 generic.go:356] "Generic (PLEG): container finished" podID="98d07540-ee66-4d06-9003-96bd6a1e88b7" containerID="1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7" exitCode=0
Jul 12 00:00:22.994515 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.994322    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7794bf947d-w8xzp"
Jul 12 00:00:22.994515 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.994342    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7794bf947d-w8xzp" event={"ID":"98d07540-ee66-4d06-9003-96bd6a1e88b7","Type":"ContainerDied","Data":"1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7"}
Jul 12 00:00:22.994515 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.994411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7794bf947d-w8xzp" event={"ID":"98d07540-ee66-4d06-9003-96bd6a1e88b7","Type":"ContainerDied","Data":"8c0b09a0f75404feb5fb996ef38264c9133dc048e239e250da77b4d6aaa590b9"}
Jul 12 00:00:22.994515 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:22.994441    2583 scope.go:117] "RemoveContainer" containerID="1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7"
Jul 12 00:00:23.003246 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:23.003222    2583 scope.go:117] "RemoveContainer" containerID="1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7"
Jul 12 00:00:23.003599 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:00:23.003571    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7\": container with ID starting with 1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7 not found: ID does not exist" containerID="1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7"
Jul 12 00:00:23.003712 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:23.003604    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7"} err="failed to get container status \"1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7\": rpc error: code = NotFound desc = could not find container \"1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7\": container with ID starting with 1e116d997238bd08fde9f26370bebd5941366a2f0a73f5180ff9b2ddff4598d7 not found: ID does not exist"
Jul 12 00:00:23.011109 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:23.011072    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7794bf947d-w8xzp"]
Jul 12 00:00:23.014736 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:23.014696    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7794bf947d-w8xzp"]
Jul 12 00:00:24.781065 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:00:24.781012    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d07540-ee66-4d06-9003-96bd6a1e88b7" path="/var/lib/kubelet/pods/98d07540-ee66-4d06-9003-96bd6a1e88b7/volumes"
Jul 12 00:01:06.276263 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.276220    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"]
Jul 12 00:01:06.276784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.276535    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e7e9a9-9fb6-438d-bb97-202a1e03f637" containerName="image-pruner"
Jul 12 00:01:06.276784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.276550    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e7e9a9-9fb6-438d-bb97-202a1e03f637" containerName="image-pruner"
Jul 12 00:01:06.276784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.276565    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d07540-ee66-4d06-9003-96bd6a1e88b7" containerName="console"
Jul 12 00:01:06.276784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.276570    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d07540-ee66-4d06-9003-96bd6a1e88b7" containerName="console"
Jul 12 00:01:06.276784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.276638    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d07540-ee66-4d06-9003-96bd6a1e88b7" containerName="console"
Jul 12 00:01:06.276784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.276646    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e7e9a9-9fb6-438d-bb97-202a1e03f637" containerName="image-pruner"
Jul 12 00:01:06.279806 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.279782    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.282765 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.282732    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 00:01:06.283773 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.283738    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 00:01:06.283773 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.283750    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kc6sc\""
Jul 12 00:01:06.289070 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.289023    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"]
Jul 12 00:01:06.357490 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.357450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnttr\" (UniqueName: \"kubernetes.io/projected/88bf8382-deaa-455e-aa74-41767bf3a04b-kube-api-access-gnttr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.357691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.357521    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.357691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.357587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.458543 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.458505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.458543 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.458553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.458781 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.458586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnttr\" (UniqueName: \"kubernetes.io/projected/88bf8382-deaa-455e-aa74-41767bf3a04b-kube-api-access-gnttr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.458937 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.458914    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.458974 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.458948    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.467344 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.467300    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnttr\" (UniqueName: \"kubernetes.io/projected/88bf8382-deaa-455e-aa74-41767bf3a04b-kube-api-access-gnttr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.592672 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.592553    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:06.738069 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:06.738009    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"]
Jul 12 00:01:06.741238 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:01:06.741196    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bf8382_deaa_455e_aa74_41767bf3a04b.slice/crio-8377e8abd349eeb6c5be08ec487fdb9b52091ff02e9c42daa1f994d9808f2df7 WatchSource:0}: Error finding container 8377e8abd349eeb6c5be08ec487fdb9b52091ff02e9c42daa1f994d9808f2df7: Status 404 returned error can't find the container with id 8377e8abd349eeb6c5be08ec487fdb9b52091ff02e9c42daa1f994d9808f2df7
Jul 12 00:01:07.175109 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:07.175072    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9" event={"ID":"88bf8382-deaa-455e-aa74-41767bf3a04b","Type":"ContainerStarted","Data":"8377e8abd349eeb6c5be08ec487fdb9b52091ff02e9c42daa1f994d9808f2df7"}
Jul 12 00:01:14.211604 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:14.211517    2583 generic.go:356] "Generic (PLEG): container finished" podID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerID="b4247cd7bf32216908be631df66e25d82da7925db76b86e4752469fbb29b01aa" exitCode=0
Jul 12 00:01:14.212106 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:14.211605    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9" event={"ID":"88bf8382-deaa-455e-aa74-41767bf3a04b","Type":"ContainerDied","Data":"b4247cd7bf32216908be631df66e25d82da7925db76b86e4752469fbb29b01aa"}
Jul 12 00:01:17.226219 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:17.226177    2583 generic.go:356] "Generic (PLEG): container finished" podID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerID="72d759ec3b059edaf4cc93ea6cbef6af8a57077ad03d4b97f62c3f7396800dbd" exitCode=0
Jul 12 00:01:17.226654 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:17.226267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9" event={"ID":"88bf8382-deaa-455e-aa74-41767bf3a04b","Type":"ContainerDied","Data":"72d759ec3b059edaf4cc93ea6cbef6af8a57077ad03d4b97f62c3f7396800dbd"}
Jul 12 00:01:25.265172 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:25.265137    2583 generic.go:356] "Generic (PLEG): container finished" podID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerID="82e3231b2921bb15a6b5168dc76db8d00c39b4b5e951a1a4cae8c0c15a86ed24" exitCode=0
Jul 12 00:01:25.265643 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:25.265218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9" event={"ID":"88bf8382-deaa-455e-aa74-41767bf3a04b","Type":"ContainerDied","Data":"82e3231b2921bb15a6b5168dc76db8d00c39b4b5e951a1a4cae8c0c15a86ed24"}
Jul 12 00:01:26.414634 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.414601    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:26.548310 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.548212    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-bundle\") pod \"88bf8382-deaa-455e-aa74-41767bf3a04b\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") "
Jul 12 00:01:26.548310 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.548296    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnttr\" (UniqueName: \"kubernetes.io/projected/88bf8382-deaa-455e-aa74-41767bf3a04b-kube-api-access-gnttr\") pod \"88bf8382-deaa-455e-aa74-41767bf3a04b\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") "
Jul 12 00:01:26.548310 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.548315    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-util\") pod \"88bf8382-deaa-455e-aa74-41767bf3a04b\" (UID: \"88bf8382-deaa-455e-aa74-41767bf3a04b\") "
Jul 12 00:01:26.548952 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.548907    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-bundle" (OuterVolumeSpecName: "bundle") pod "88bf8382-deaa-455e-aa74-41767bf3a04b" (UID: "88bf8382-deaa-455e-aa74-41767bf3a04b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:01:26.550648 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.550621    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88bf8382-deaa-455e-aa74-41767bf3a04b-kube-api-access-gnttr" (OuterVolumeSpecName: "kube-api-access-gnttr") pod "88bf8382-deaa-455e-aa74-41767bf3a04b" (UID: "88bf8382-deaa-455e-aa74-41767bf3a04b"). InnerVolumeSpecName "kube-api-access-gnttr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:01:26.553664 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.553630    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-util" (OuterVolumeSpecName: "util") pod "88bf8382-deaa-455e-aa74-41767bf3a04b" (UID: "88bf8382-deaa-455e-aa74-41767bf3a04b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:01:26.649546 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.649496    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnttr\" (UniqueName: \"kubernetes.io/projected/88bf8382-deaa-455e-aa74-41767bf3a04b-kube-api-access-gnttr\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:01:26.649546 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.649536    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:01:26.649546 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:26.649547    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88bf8382-deaa-455e-aa74-41767bf3a04b-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:01:27.275866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:27.275834    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9"
Jul 12 00:01:27.276095 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:27.275866    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408nrg9" event={"ID":"88bf8382-deaa-455e-aa74-41767bf3a04b","Type":"ContainerDied","Data":"8377e8abd349eeb6c5be08ec487fdb9b52091ff02e9c42daa1f994d9808f2df7"}
Jul 12 00:01:27.276095 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:27.275928    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8377e8abd349eeb6c5be08ec487fdb9b52091ff02e9c42daa1f994d9808f2df7"
Jul 12 00:01:34.220684 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.220643    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"]
Jul 12 00:01:34.221121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.220951    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerName="pull"
Jul 12 00:01:34.221121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.220961    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerName="pull"
Jul 12 00:01:34.221121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.220973    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerName="util"
Jul 12 00:01:34.221121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.220979    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerName="util"
Jul 12 00:01:34.221121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.220995    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerName="extract"
Jul 12 00:01:34.221121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.221001    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerName="extract"
Jul 12 00:01:34.221121 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.221066    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="88bf8382-deaa-455e-aa74-41767bf3a04b" containerName="extract"
Jul 12 00:01:34.224772 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.224748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.227955 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.227930    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 12 00:01:34.228128 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.227930    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 12 00:01:34.228128 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.227930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4fbhg\""
Jul 12 00:01:34.240402 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.240369    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"]
Jul 12 00:01:34.413813 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.413758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c35a6d15-0dfa-4ef9-b928-472c6733bfe4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vhkjz\" (UID: \"c35a6d15-0dfa-4ef9-b928-472c6733bfe4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.413813 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.413811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjc4r\" (UniqueName: \"kubernetes.io/projected/c35a6d15-0dfa-4ef9-b928-472c6733bfe4-kube-api-access-rjc4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-vhkjz\" (UID: \"c35a6d15-0dfa-4ef9-b928-472c6733bfe4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.515406 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.515290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c35a6d15-0dfa-4ef9-b928-472c6733bfe4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vhkjz\" (UID: \"c35a6d15-0dfa-4ef9-b928-472c6733bfe4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.515406 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.515337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc4r\" (UniqueName: \"kubernetes.io/projected/c35a6d15-0dfa-4ef9-b928-472c6733bfe4-kube-api-access-rjc4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-vhkjz\" (UID: \"c35a6d15-0dfa-4ef9-b928-472c6733bfe4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.515731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.515707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c35a6d15-0dfa-4ef9-b928-472c6733bfe4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vhkjz\" (UID: \"c35a6d15-0dfa-4ef9-b928-472c6733bfe4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.523577 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.523547    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjc4r\" (UniqueName: \"kubernetes.io/projected/c35a6d15-0dfa-4ef9-b928-472c6733bfe4-kube-api-access-rjc4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-vhkjz\" (UID: \"c35a6d15-0dfa-4ef9-b928-472c6733bfe4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.536621 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.536574    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"
Jul 12 00:01:34.683451 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:34.683409    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz"]
Jul 12 00:01:34.687414 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:01:34.687379    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35a6d15_0dfa_4ef9_b928_472c6733bfe4.slice/crio-79caf3bec1f31a3dbe0ea0ca1c8c76e2c582edc81664e364da2d2deb33d65482 WatchSource:0}: Error finding container 79caf3bec1f31a3dbe0ea0ca1c8c76e2c582edc81664e364da2d2deb33d65482: Status 404 returned error can't find the container with id 79caf3bec1f31a3dbe0ea0ca1c8c76e2c582edc81664e364da2d2deb33d65482
Jul 12 00:01:35.309630 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:35.309593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz" event={"ID":"c35a6d15-0dfa-4ef9-b928-472c6733bfe4","Type":"ContainerStarted","Data":"79caf3bec1f31a3dbe0ea0ca1c8c76e2c582edc81664e364da2d2deb33d65482"}
Jul 12 00:01:38.327174 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:38.327075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz" event={"ID":"c35a6d15-0dfa-4ef9-b928-472c6733bfe4","Type":"ContainerStarted","Data":"4a6e01886af1ca706ea97e65a0e487f4a886cbbe75a1b7b20f41a11e0c034071"}
Jul 12 00:01:38.349313 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:38.349242    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vhkjz" podStartSLOduration=1.107300613 podStartE2EDuration="4.349219921s" totalImagesPullingTime="3.241919308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:01:38.347006954 +0000 UTC m=+286.149915845" watchObservedRunningTime="2026-07-12 00:01:38.349219921 +0000 UTC m=+286.152128842"
Jul 12 00:01:39.013529 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.013482    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"]
Jul 12 00:01:39.016366 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.016337    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.019613 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.019584    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 00:01:39.020250 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.020234    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 00:01:39.021147 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.021130    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kc6sc\""
Jul 12 00:01:39.033945 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.033904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"]
Jul 12 00:01:39.151439 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.151402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.151439 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.151443    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbt7p\" (UniqueName: \"kubernetes.io/projected/5b77551e-6255-4c65-bb20-9c6be3722fde-kube-api-access-cbt7p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.151681 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.151478    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.252318 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.252279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.252318 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.252323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbt7p\" (UniqueName: \"kubernetes.io/projected/5b77551e-6255-4c65-bb20-9c6be3722fde-kube-api-access-cbt7p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.252550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.252364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.252815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.252792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.252856 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.252797    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.261675 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.261642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbt7p\" (UniqueName: \"kubernetes.io/projected/5b77551e-6255-4c65-bb20-9c6be3722fde-kube-api-access-cbt7p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.326281 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.326178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:39.474806 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:39.474763    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"]
Jul 12 00:01:39.478201 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:01:39.478159    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b77551e_6255_4c65_bb20_9c6be3722fde.slice/crio-8b3ff4c086f4c00ae954c270c0ed684d78635a607c772a46b7c3640e3ab40f0f WatchSource:0}: Error finding container 8b3ff4c086f4c00ae954c270c0ed684d78635a607c772a46b7c3640e3ab40f0f: Status 404 returned error can't find the container with id 8b3ff4c086f4c00ae954c270c0ed684d78635a607c772a46b7c3640e3ab40f0f
Jul 12 00:01:40.343125 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:40.343080    2583 generic.go:356] "Generic (PLEG): container finished" podID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerID="235a09439a820728008d357665f56ff5fc4e413d1ca4cba3abde415f0722e92a" exitCode=0
Jul 12 00:01:40.343366 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:40.343204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h" event={"ID":"5b77551e-6255-4c65-bb20-9c6be3722fde","Type":"ContainerDied","Data":"235a09439a820728008d357665f56ff5fc4e413d1ca4cba3abde415f0722e92a"}
Jul 12 00:01:40.343366 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:40.343294    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h" event={"ID":"5b77551e-6255-4c65-bb20-9c6be3722fde","Type":"ContainerStarted","Data":"8b3ff4c086f4c00ae954c270c0ed684d78635a607c772a46b7c3640e3ab40f0f"}
Jul 12 00:01:43.359820 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:43.359781    2583 generic.go:356] "Generic (PLEG): container finished" podID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerID="dd0fbf2cd12af6c71fd26fde8562059583a167b35e8d1c79059902f78a8784de" exitCode=0
Jul 12 00:01:43.360352 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:43.359863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h" event={"ID":"5b77551e-6255-4c65-bb20-9c6be3722fde","Type":"ContainerDied","Data":"dd0fbf2cd12af6c71fd26fde8562059583a167b35e8d1c79059902f78a8784de"}
Jul 12 00:01:43.512329 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:01:43.512278    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b77551e_6255_4c65_bb20_9c6be3722fde.slice/crio-d7a9e894bb6984aa564143c343a037a4496d1302f2c953e416223facfa6410cc.scope\": RecentStats: unable to find data in memory cache]"
Jul 12 00:01:44.366775 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:44.366734    2583 generic.go:356] "Generic (PLEG): container finished" podID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerID="d7a9e894bb6984aa564143c343a037a4496d1302f2c953e416223facfa6410cc" exitCode=0
Jul 12 00:01:44.367211 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:44.366819    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h" event={"ID":"5b77551e-6255-4c65-bb20-9c6be3722fde","Type":"ContainerDied","Data":"d7a9e894bb6984aa564143c343a037a4496d1302f2c953e416223facfa6410cc"}
Jul 12 00:01:45.515921 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.515881    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:45.613671 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.613628    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbt7p\" (UniqueName: \"kubernetes.io/projected/5b77551e-6255-4c65-bb20-9c6be3722fde-kube-api-access-cbt7p\") pod \"5b77551e-6255-4c65-bb20-9c6be3722fde\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") "
Jul 12 00:01:45.613889 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.613700    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-bundle\") pod \"5b77551e-6255-4c65-bb20-9c6be3722fde\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") "
Jul 12 00:01:45.613889 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.613732    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-util\") pod \"5b77551e-6255-4c65-bb20-9c6be3722fde\" (UID: \"5b77551e-6255-4c65-bb20-9c6be3722fde\") "
Jul 12 00:01:45.614286 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.614256    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-bundle" (OuterVolumeSpecName: "bundle") pod "5b77551e-6255-4c65-bb20-9c6be3722fde" (UID: "5b77551e-6255-4c65-bb20-9c6be3722fde"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:01:45.616184 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.616157    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b77551e-6255-4c65-bb20-9c6be3722fde-kube-api-access-cbt7p" (OuterVolumeSpecName: "kube-api-access-cbt7p") pod "5b77551e-6255-4c65-bb20-9c6be3722fde" (UID: "5b77551e-6255-4c65-bb20-9c6be3722fde"). InnerVolumeSpecName "kube-api-access-cbt7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:01:45.618110 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.618076    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-util" (OuterVolumeSpecName: "util") pod "5b77551e-6255-4c65-bb20-9c6be3722fde" (UID: "5b77551e-6255-4c65-bb20-9c6be3722fde"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:01:45.714772 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.714729    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:01:45.714772 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.714764    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b77551e-6255-4c65-bb20-9c6be3722fde-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:01:45.714772 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:45.714773    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbt7p\" (UniqueName: \"kubernetes.io/projected/5b77551e-6255-4c65-bb20-9c6be3722fde-kube-api-access-cbt7p\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:01:46.378421 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:46.378391    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h"
Jul 12 00:01:46.378628 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:46.378381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2x9h" event={"ID":"5b77551e-6255-4c65-bb20-9c6be3722fde","Type":"ContainerDied","Data":"8b3ff4c086f4c00ae954c270c0ed684d78635a607c772a46b7c3640e3ab40f0f"}
Jul 12 00:01:46.378628 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:46.378520    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b3ff4c086f4c00ae954c270c0ed684d78635a607c772a46b7c3640e3ab40f0f"
Jul 12 00:01:49.907732 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.907694    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dc4lv"]
Jul 12 00:01:49.908131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.908004    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerName="pull"
Jul 12 00:01:49.908131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.908016    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerName="pull"
Jul 12 00:01:49.908131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.908029    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerName="extract"
Jul 12 00:01:49.908131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.908060    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerName="extract"
Jul 12 00:01:49.908131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.908068    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerName="util"
Jul 12 00:01:49.908131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.908073    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerName="util"
Jul 12 00:01:49.908337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.908147    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b77551e-6255-4c65-bb20-9c6be3722fde" containerName="extract"
Jul 12 00:01:49.911815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.911790    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:49.914392 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.914368    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 00:01:49.914392 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.914381    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 00:01:49.915585 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.915558    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6f2pv\""
Jul 12 00:01:49.920628 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.920601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dc4lv"]
Jul 12 00:01:49.951337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.951293    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfkvn\" (UniqueName: \"kubernetes.io/projected/0a8379f4-dab4-4149-ae79-6c89cfbd2320-kube-api-access-kfkvn\") pod \"cert-manager-55b4d954d5-dc4lv\" (UID: \"0a8379f4-dab4-4149-ae79-6c89cfbd2320\") " pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:49.951337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:49.951343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a8379f4-dab4-4149-ae79-6c89cfbd2320-bound-sa-token\") pod \"cert-manager-55b4d954d5-dc4lv\" (UID: \"0a8379f4-dab4-4149-ae79-6c89cfbd2320\") " pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:50.051783 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:50.051742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfkvn\" (UniqueName: \"kubernetes.io/projected/0a8379f4-dab4-4149-ae79-6c89cfbd2320-kube-api-access-kfkvn\") pod \"cert-manager-55b4d954d5-dc4lv\" (UID: \"0a8379f4-dab4-4149-ae79-6c89cfbd2320\") " pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:50.052004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:50.051794    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a8379f4-dab4-4149-ae79-6c89cfbd2320-bound-sa-token\") pod \"cert-manager-55b4d954d5-dc4lv\" (UID: \"0a8379f4-dab4-4149-ae79-6c89cfbd2320\") " pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:50.060332 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:50.060291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a8379f4-dab4-4149-ae79-6c89cfbd2320-bound-sa-token\") pod \"cert-manager-55b4d954d5-dc4lv\" (UID: \"0a8379f4-dab4-4149-ae79-6c89cfbd2320\") " pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:50.060492 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:50.060469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfkvn\" (UniqueName: \"kubernetes.io/projected/0a8379f4-dab4-4149-ae79-6c89cfbd2320-kube-api-access-kfkvn\") pod \"cert-manager-55b4d954d5-dc4lv\" (UID: \"0a8379f4-dab4-4149-ae79-6c89cfbd2320\") " pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:50.238824 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:50.238720    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dc4lv"
Jul 12 00:01:50.386470 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:50.386434    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dc4lv"]
Jul 12 00:01:50.389569 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:01:50.389538    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a8379f4_dab4_4149_ae79_6c89cfbd2320.slice/crio-a44fd19ce7830a1fb385d25d3ab333f956a5e545aaa2abf7ff3d9afaab6be7fb WatchSource:0}: Error finding container a44fd19ce7830a1fb385d25d3ab333f956a5e545aaa2abf7ff3d9afaab6be7fb: Status 404 returned error can't find the container with id a44fd19ce7830a1fb385d25d3ab333f956a5e545aaa2abf7ff3d9afaab6be7fb
Jul 12 00:01:50.397923 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:50.397881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dc4lv" event={"ID":"0a8379f4-dab4-4149-ae79-6c89cfbd2320","Type":"ContainerStarted","Data":"a44fd19ce7830a1fb385d25d3ab333f956a5e545aaa2abf7ff3d9afaab6be7fb"}
Jul 12 00:01:53.045568 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:53.045417    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:01:53.045568 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:53.045417    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:01:53.433123 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:53.057100    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 00:01:54.422179 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:54.422132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dc4lv" event={"ID":"0a8379f4-dab4-4149-ae79-6c89cfbd2320","Type":"ContainerStarted","Data":"ac983cd50cb469940cbfac223dc0216e715dd47808df27c64ef93610c4ef152e"}
Jul 12 00:01:54.438623 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:01:54.438567    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dc4lv" podStartSLOduration=2.485831503 podStartE2EDuration="5.438550694s" totalImagesPullingTime="2.952719191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:01:54.437174343 +0000 UTC m=+302.240083242" watchObservedRunningTime="2026-07-12 00:01:54.438550694 +0000 UTC m=+302.241459580"
Jul 12 00:02:02.174397 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.174351    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"]
Jul 12 00:02:02.177748 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.177715    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.180270 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.180235    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 00:02:02.180453 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.180418    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 00:02:02.181452 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.181428    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kc6sc\""
Jul 12 00:02:02.184939 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.184909    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"]
Jul 12 00:02:02.261822 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.261771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.262073 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.261896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.262073 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.261932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctlzj\" (UniqueName: \"kubernetes.io/projected/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-kube-api-access-ctlzj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.362921 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.362874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.362921 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.362922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctlzj\" (UniqueName: \"kubernetes.io/projected/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-kube-api-access-ctlzj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.363281 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.362977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.363439 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.363415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.363527 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.363451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.371004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.370957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctlzj\" (UniqueName: \"kubernetes.io/projected/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-kube-api-access-ctlzj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.488942 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.488837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:02.632390 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:02.632345    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"]
Jul 12 00:02:02.636058 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:02:02.635990    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9c7aeb_3bcb_4c1a_91cd_81110df669ab.slice/crio-99fd32b29d8431e768db2bd9287b3055db0aff0466097a7a4df03ddaf146f005 WatchSource:0}: Error finding container 99fd32b29d8431e768db2bd9287b3055db0aff0466097a7a4df03ddaf146f005: Status 404 returned error can't find the container with id 99fd32b29d8431e768db2bd9287b3055db0aff0466097a7a4df03ddaf146f005
Jul 12 00:02:03.464798 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:03.464763    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerID="fc9e69f1aeb64ff4d18de85c330b3419cf6c6e09342279279941217b1d5c7552" exitCode=0
Jul 12 00:02:03.465232 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:03.464866    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c" event={"ID":"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab","Type":"ContainerDied","Data":"fc9e69f1aeb64ff4d18de85c330b3419cf6c6e09342279279941217b1d5c7552"}
Jul 12 00:02:03.465232 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:03.464921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c" event={"ID":"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab","Type":"ContainerStarted","Data":"99fd32b29d8431e768db2bd9287b3055db0aff0466097a7a4df03ddaf146f005"}
Jul 12 00:02:03.465356 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:03.465339    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:02:04.470841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:04.470805    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerID="c720e8928f6330753fc71def1a910b61b9ca8c1222461e59fc19b5c66e8ca907" exitCode=0
Jul 12 00:02:04.471274 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:04.470894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c" event={"ID":"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab","Type":"ContainerDied","Data":"c720e8928f6330753fc71def1a910b61b9ca8c1222461e59fc19b5c66e8ca907"}
Jul 12 00:02:05.477417 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:05.477383    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerID="ce3db55bfa5a73589bbbdb5d3d8c664df67a289fbcbf571010555bb2c76bb880" exitCode=0
Jul 12 00:02:05.477857 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:05.477479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c" event={"ID":"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab","Type":"ContainerDied","Data":"ce3db55bfa5a73589bbbdb5d3d8c664df67a289fbcbf571010555bb2c76bb880"}
Jul 12 00:02:06.626477 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.626447    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:06.704292 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.704241    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctlzj\" (UniqueName: \"kubernetes.io/projected/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-kube-api-access-ctlzj\") pod \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") "
Jul 12 00:02:06.704292 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.704296    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-bundle\") pod \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") "
Jul 12 00:02:06.704543 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.704361    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-util\") pod \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\" (UID: \"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab\") "
Jul 12 00:02:06.705120 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.705090    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-bundle" (OuterVolumeSpecName: "bundle") pod "5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" (UID: "5d9c7aeb-3bcb-4c1a-91cd-81110df669ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:02:06.706519 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.706491    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-kube-api-access-ctlzj" (OuterVolumeSpecName: "kube-api-access-ctlzj") pod "5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" (UID: "5d9c7aeb-3bcb-4c1a-91cd-81110df669ab"). InnerVolumeSpecName "kube-api-access-ctlzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:02:06.710203 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.710172    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-util" (OuterVolumeSpecName: "util") pod "5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" (UID: "5d9c7aeb-3bcb-4c1a-91cd-81110df669ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:02:06.805958 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.805902    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:06.805958 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.805951    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctlzj\" (UniqueName: \"kubernetes.io/projected/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-kube-api-access-ctlzj\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:06.805958 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:06.805963    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9c7aeb-3bcb-4c1a-91cd-81110df669ab-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:07.488905 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:07.488873    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c"
Jul 12 00:02:07.488905 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:07.488902    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjk95c" event={"ID":"5d9c7aeb-3bcb-4c1a-91cd-81110df669ab","Type":"ContainerDied","Data":"99fd32b29d8431e768db2bd9287b3055db0aff0466097a7a4df03ddaf146f005"}
Jul 12 00:02:07.489165 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:07.488952    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99fd32b29d8431e768db2bd9287b3055db0aff0466097a7a4df03ddaf146f005"
Jul 12 00:02:14.649732 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.649681    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"]
Jul 12 00:02:14.650285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.650007    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerName="util"
Jul 12 00:02:14.650285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.650018    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerName="util"
Jul 12 00:02:14.650285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.650031    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerName="pull"
Jul 12 00:02:14.650285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.650066    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerName="pull"
Jul 12 00:02:14.650285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.650075    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerName="extract"
Jul 12 00:02:14.650285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.650081    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerName="extract"
Jul 12 00:02:14.650285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.650141    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9c7aeb-3bcb-4c1a-91cd-81110df669ab" containerName="extract"
Jul 12 00:02:14.652199 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.652178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.657205 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.657169    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 00:02:14.657398 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.657232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lrlqr\""
Jul 12 00:02:14.657398 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.657248    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 00:02:14.657398 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.657259    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 00:02:14.657398 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.657263    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 00:02:14.672095 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.672031    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"]
Jul 12 00:02:14.777268 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.777221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83c33e63-f2fa-4905-9d6d-0bea643a1867-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.777497 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.777292    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxngb\" (UniqueName: \"kubernetes.io/projected/83c33e63-f2fa-4905-9d6d-0bea643a1867-kube-api-access-hxngb\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.777497 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.777336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83c33e63-f2fa-4905-9d6d-0bea643a1867-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.777497 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.777364    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83c33e63-f2fa-4905-9d6d-0bea643a1867-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.777497 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.777433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83c33e63-f2fa-4905-9d6d-0bea643a1867-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.878341 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.878289    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83c33e63-f2fa-4905-9d6d-0bea643a1867-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.878561 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.878353    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83c33e63-f2fa-4905-9d6d-0bea643a1867-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.878561 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.878417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxngb\" (UniqueName: \"kubernetes.io/projected/83c33e63-f2fa-4905-9d6d-0bea643a1867-kube-api-access-hxngb\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.878684 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.878564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83c33e63-f2fa-4905-9d6d-0bea643a1867-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.878684 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.878627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83c33e63-f2fa-4905-9d6d-0bea643a1867-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.879019 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.878990    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83c33e63-f2fa-4905-9d6d-0bea643a1867-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.881005 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.880976    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83c33e63-f2fa-4905-9d6d-0bea643a1867-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.881132 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.881109    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83c33e63-f2fa-4905-9d6d-0bea643a1867-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.881211 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.881192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83c33e63-f2fa-4905-9d6d-0bea643a1867-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.886909 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.886876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxngb\" (UniqueName: \"kubernetes.io/projected/83c33e63-f2fa-4905-9d6d-0bea643a1867-kube-api-access-hxngb\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-94sfq\" (UID: \"83c33e63-f2fa-4905-9d6d-0bea643a1867\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:14.963948 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:14.963912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:15.117435 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:15.117404    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"]
Jul 12 00:02:15.120396 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:02:15.120360    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c33e63_f2fa_4905_9d6d_0bea643a1867.slice/crio-c3d8f17b7792110e8310eee00bc02500c0f666ec38a0150ef0880f05d8487843 WatchSource:0}: Error finding container c3d8f17b7792110e8310eee00bc02500c0f666ec38a0150ef0880f05d8487843: Status 404 returned error can't find the container with id c3d8f17b7792110e8310eee00bc02500c0f666ec38a0150ef0880f05d8487843
Jul 12 00:02:15.528183 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:15.528139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq" event={"ID":"83c33e63-f2fa-4905-9d6d-0bea643a1867","Type":"ContainerStarted","Data":"c3d8f17b7792110e8310eee00bc02500c0f666ec38a0150ef0880f05d8487843"}
Jul 12 00:02:18.547267 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:18.547225    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq" event={"ID":"83c33e63-f2fa-4905-9d6d-0bea643a1867","Type":"ContainerStarted","Data":"491b5f9ca9595254baf3673a1b90abd527d052ebc5bf11a5f868e70562b1c2e1"}
Jul 12 00:02:20.558654 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:20.558615    2583 generic.go:356] "Generic (PLEG): container finished" podID="83c33e63-f2fa-4905-9d6d-0bea643a1867" containerID="491b5f9ca9595254baf3673a1b90abd527d052ebc5bf11a5f868e70562b1c2e1" exitCode=0
Jul 12 00:02:20.559085 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:20.558693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq" event={"ID":"83c33e63-f2fa-4905-9d6d-0bea643a1867","Type":"ContainerDied","Data":"491b5f9ca9595254baf3673a1b90abd527d052ebc5bf11a5f868e70562b1c2e1"}
Jul 12 00:02:21.565556 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:21.565516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq" event={"ID":"83c33e63-f2fa-4905-9d6d-0bea643a1867","Type":"ContainerStarted","Data":"d0ef6fb40748c1ad958fb8a20c52ea13e4f0c1bb41b7f69a652345deaae1a429"}
Jul 12 00:02:21.566131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:21.565770    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:21.588823 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:21.588753    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq" podStartSLOduration=2.720237226 podStartE2EDuration="7.588733087s" totalImagesPullingTime="3.723014674s" totalInitContainerRuntime="1.145481187s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:21.585627794 +0000 UTC m=+329.388536682" watchObservedRunningTime="2026-07-12 00:02:21.588733087 +0000 UTC m=+329.391641974"
Jul 12 00:02:32.573285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:32.573247    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-94sfq"
Jul 12 00:02:34.717386 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.717348    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"]
Jul 12 00:02:34.723145 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.723115    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.729280 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.729252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 00:02:34.729554 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.729540    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 00:02:34.751068 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.751003    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"]
Jul 12 00:02:34.754376 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.754344    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdf045ad-b9f3-4aa6-b363-278beff09a7c-tmp\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.754553 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.754472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf045ad-b9f3-4aa6-b363-278beff09a7c-tls-certs\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.754553 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.754503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4592\" (UniqueName: \"kubernetes.io/projected/bdf045ad-b9f3-4aa6-b363-278beff09a7c-kube-api-access-q4592\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.855124 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.855076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4592\" (UniqueName: \"kubernetes.io/projected/bdf045ad-b9f3-4aa6-b363-278beff09a7c-kube-api-access-q4592\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.855324 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.855138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdf045ad-b9f3-4aa6-b363-278beff09a7c-tmp\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.855324 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.855272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf045ad-b9f3-4aa6-b363-278beff09a7c-tls-certs\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.857786 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.857742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdf045ad-b9f3-4aa6-b363-278beff09a7c-tmp\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.858006 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.857987    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf045ad-b9f3-4aa6-b363-278beff09a7c-tls-certs\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.867072 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.867014    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4592\" (UniqueName: \"kubernetes.io/projected/bdf045ad-b9f3-4aa6-b363-278beff09a7c-kube-api-access-q4592\") pod \"kube-auth-proxy-57d6f88c78-6flmm\" (UID: \"bdf045ad-b9f3-4aa6-b363-278beff09a7c\") " pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:34.963358 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.963319    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w8g2d"]
Jul 12 00:02:34.965752 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.965733    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:34.968343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.968255    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 12 00:02:34.968343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.968318    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dmxdl\""
Jul 12 00:02:34.981763 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:34.981730    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w8g2d"]
Jul 12 00:02:35.034018 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.033982    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"
Jul 12 00:02:35.057068 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.056930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4-cert\") pod \"odh-model-controller-7998c67dc4-w8g2d\" (UID: \"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:35.057068 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.057028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcsrv\" (UniqueName: \"kubernetes.io/projected/fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4-kube-api-access-fcsrv\") pod \"odh-model-controller-7998c67dc4-w8g2d\" (UID: \"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:35.157912 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.157866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4-cert\") pod \"odh-model-controller-7998c67dc4-w8g2d\" (UID: \"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:35.157912 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.157918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcsrv\" (UniqueName: \"kubernetes.io/projected/fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4-kube-api-access-fcsrv\") pod \"odh-model-controller-7998c67dc4-w8g2d\" (UID: \"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:35.160709 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.160677    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4-cert\") pod \"odh-model-controller-7998c67dc4-w8g2d\" (UID: \"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:35.166844 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.166813    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcsrv\" (UniqueName: \"kubernetes.io/projected/fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4-kube-api-access-fcsrv\") pod \"odh-model-controller-7998c67dc4-w8g2d\" (UID: \"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:35.180492 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.180456    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm"]
Jul 12 00:02:35.182900 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:02:35.182864    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf045ad_b9f3_4aa6_b363_278beff09a7c.slice/crio-adc50558a9008f95fd364a1bfb018fad6128be906a7e006996849eb67aaa9101 WatchSource:0}: Error finding container adc50558a9008f95fd364a1bfb018fad6128be906a7e006996849eb67aaa9101: Status 404 returned error can't find the container with id adc50558a9008f95fd364a1bfb018fad6128be906a7e006996849eb67aaa9101
Jul 12 00:02:35.278225 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.278118    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:35.446767 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.446717    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w8g2d"]
Jul 12 00:02:35.449020 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:02:35.448989    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa79ff9e_f2a8_4643_b5ce_015aeaeda1b4.slice/crio-267185b12a521dc16a06e5682e09c06a9dc11f818eb96cb1e1d39cf5006b8dcb WatchSource:0}: Error finding container 267185b12a521dc16a06e5682e09c06a9dc11f818eb96cb1e1d39cf5006b8dcb: Status 404 returned error can't find the container with id 267185b12a521dc16a06e5682e09c06a9dc11f818eb96cb1e1d39cf5006b8dcb
Jul 12 00:02:35.615894 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.615792    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lwgvx"]
Jul 12 00:02:35.618944 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.618923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:35.621710 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.621683    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 12 00:02:35.621881 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.621780    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-vhrgp\""
Jul 12 00:02:35.631844 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.631807    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lwgvx"]
Jul 12 00:02:35.635332 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.635291    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm" event={"ID":"bdf045ad-b9f3-4aa6-b363-278beff09a7c","Type":"ContainerStarted","Data":"adc50558a9008f95fd364a1bfb018fad6128be906a7e006996849eb67aaa9101"}
Jul 12 00:02:35.636864 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.636829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d" event={"ID":"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4","Type":"ContainerStarted","Data":"267185b12a521dc16a06e5682e09c06a9dc11f818eb96cb1e1d39cf5006b8dcb"}
Jul 12 00:02:35.662370 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.662330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad6acfff-5f4f-4fc2-a012-a531732b9647-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwgvx\" (UID: \"ad6acfff-5f4f-4fc2-a012-a531732b9647\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:35.662370 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.662381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jff5\" (UniqueName: \"kubernetes.io/projected/ad6acfff-5f4f-4fc2-a012-a531732b9647-kube-api-access-8jff5\") pod \"model-serving-api-54d89bd5fc-lwgvx\" (UID: \"ad6acfff-5f4f-4fc2-a012-a531732b9647\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:35.763699 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.763660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad6acfff-5f4f-4fc2-a012-a531732b9647-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwgvx\" (UID: \"ad6acfff-5f4f-4fc2-a012-a531732b9647\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:35.764217 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.763721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jff5\" (UniqueName: \"kubernetes.io/projected/ad6acfff-5f4f-4fc2-a012-a531732b9647-kube-api-access-8jff5\") pod \"model-serving-api-54d89bd5fc-lwgvx\" (UID: \"ad6acfff-5f4f-4fc2-a012-a531732b9647\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:35.764217 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:02:35.763909    2583 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 12 00:02:35.764217 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:02:35.763992    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6acfff-5f4f-4fc2-a012-a531732b9647-tls-certs podName:ad6acfff-5f4f-4fc2-a012-a531732b9647 nodeName:}" failed. No retries permitted until 2026-07-12 00:02:36.263966391 +0000 UTC m=+344.066875258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ad6acfff-5f4f-4fc2-a012-a531732b9647-tls-certs") pod "model-serving-api-54d89bd5fc-lwgvx" (UID: "ad6acfff-5f4f-4fc2-a012-a531732b9647") : secret "model-serving-api-tls" not found
Jul 12 00:02:35.774183 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.774149    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jff5\" (UniqueName: \"kubernetes.io/projected/ad6acfff-5f4f-4fc2-a012-a531732b9647-kube-api-access-8jff5\") pod \"model-serving-api-54d89bd5fc-lwgvx\" (UID: \"ad6acfff-5f4f-4fc2-a012-a531732b9647\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:35.928003 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.927954    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jch66"]
Jul 12 00:02:35.930864 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.930834    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:35.933547 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.933506    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 00:02:35.933547 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.933510    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gpbnt\""
Jul 12 00:02:35.933799 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.933579    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 00:02:35.933799 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.933634    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 00:02:35.933900 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.933799    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 00:02:35.942762 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.942731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jch66"]
Jul 12 00:02:35.965602 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.965545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-cacerts\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:35.965817 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.965622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:35.965817 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.965707    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:35.965817 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.965777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c4bd61-1385-4f69-91a8-a77ddc1766b8-local-certs\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:35.965974 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.965824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:35.965974 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.965899    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-token\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:35.965974 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:35.965938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxg4x\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-kube-api-access-hxg4x\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.066441 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.066400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c4bd61-1385-4f69-91a8-a77ddc1766b8-local-certs\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.066441 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.066445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.066717 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.066574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-token\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.066717 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.066608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxg4x\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-kube-api-access-hxg4x\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.066717 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.066673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-cacerts\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.066854 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.066737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.066854 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.066782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.067254 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.067219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.069139 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.069098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c4bd61-1385-4f69-91a8-a77ddc1766b8-local-certs\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.069590 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.069561    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-cacerts\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.069823 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.069790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.069915 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.069889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.075677 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.075644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-token\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.075841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.075779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxg4x\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-kube-api-access-hxg4x\") pod \"istiod-openshift-gateway-7574459656-jch66\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.245745 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.245637    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:36.269319 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.269270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad6acfff-5f4f-4fc2-a012-a531732b9647-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwgvx\" (UID: \"ad6acfff-5f4f-4fc2-a012-a531732b9647\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:36.272992 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.272924    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad6acfff-5f4f-4fc2-a012-a531732b9647-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwgvx\" (UID: \"ad6acfff-5f4f-4fc2-a012-a531732b9647\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:36.448241 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.448026    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jch66"]
Jul 12 00:02:36.452329 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:02:36.452265    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c4bd61_1385_4f69_91a8_a77ddc1766b8.slice/crio-ef13ea1bc215227046384bb83401abcfb2970863654924a9894cb579b7f06085 WatchSource:0}: Error finding container ef13ea1bc215227046384bb83401abcfb2970863654924a9894cb579b7f06085: Status 404 returned error can't find the container with id ef13ea1bc215227046384bb83401abcfb2970863654924a9894cb579b7f06085
Jul 12 00:02:36.532342 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.532166    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:36.659066 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.658916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66" event={"ID":"84c4bd61-1385-4f69-91a8-a77ddc1766b8","Type":"ContainerStarted","Data":"ef13ea1bc215227046384bb83401abcfb2970863654924a9894cb579b7f06085"}
Jul 12 00:02:36.731783 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:36.731737    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lwgvx"]
Jul 12 00:02:36.735249 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:02:36.735202    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6acfff_5f4f_4fc2_a012_a531732b9647.slice/crio-d30ac7013756f58fa6330ab2448f90df97b7b037f00bf4964a323482794b91b6 WatchSource:0}: Error finding container d30ac7013756f58fa6330ab2448f90df97b7b037f00bf4964a323482794b91b6: Status 404 returned error can't find the container with id d30ac7013756f58fa6330ab2448f90df97b7b037f00bf4964a323482794b91b6
Jul 12 00:02:37.666569 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:37.666530    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx" event={"ID":"ad6acfff-5f4f-4fc2-a012-a531732b9647","Type":"ContainerStarted","Data":"d30ac7013756f58fa6330ab2448f90df97b7b037f00bf4964a323482794b91b6"}
Jul 12 00:02:39.679387 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.679340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d" event={"ID":"fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4","Type":"ContainerStarted","Data":"4af768d8a540e53c265e65cee4cca370227769e59ab9827b0edab59f6c5fcd05"}
Jul 12 00:02:39.679944 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.679471    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:39.681172 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.681135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx" event={"ID":"ad6acfff-5f4f-4fc2-a012-a531732b9647","Type":"ContainerStarted","Data":"6e4186726903ff505dfb17362c88362e43c8ff0b73dcff64d432df3a2815d02a"}
Jul 12 00:02:39.681366 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.681236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:39.682921 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.682888    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm" event={"ID":"bdf045ad-b9f3-4aa6-b363-278beff09a7c","Type":"ContainerStarted","Data":"1887425245cbe51094a03308dbbcf2b8466a2d58f4e19761a8114f4929786271"}
Jul 12 00:02:39.695312 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.695167    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d" podStartSLOduration=1.70288266 podStartE2EDuration="5.695147987s" totalImagesPullingTime="3.992265327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:39.693952761 +0000 UTC m=+347.496861649" watchObservedRunningTime="2026-07-12 00:02:39.695147987 +0000 UTC m=+347.498056895"
Jul 12 00:02:39.711158 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.711097    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx" podStartSLOduration=1.979866746 podStartE2EDuration="4.711075983s" totalImagesPullingTime="2.731209237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:39.709335823 +0000 UTC m=+347.512244710" watchObservedRunningTime="2026-07-12 00:02:39.711075983 +0000 UTC m=+347.513984869"
Jul 12 00:02:39.723776 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:39.723715    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57d6f88c78-6flmm" podStartSLOduration=1.439658734 podStartE2EDuration="5.723693977s" totalImagesPullingTime="4.284035243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:39.723094197 +0000 UTC m=+347.526003081" watchObservedRunningTime="2026-07-12 00:02:39.723693977 +0000 UTC m=+347.526602863"
Jul 12 00:02:42.619706 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.619668    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"]
Jul 12 00:02:42.627340 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.627229    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.631815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.631772    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 12 00:02:42.632003 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.631832    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 00:02:42.632003 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.631772    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 00:02:42.632160 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.631838    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5ps4q\""
Jul 12 00:02:42.632160 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.632092    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 12 00:02:42.632160 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.631772    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 12 00:02:42.632892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.632864    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"]
Jul 12 00:02:42.737271 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.737233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c170135c-eadb-4bff-9ad0-ed62d60d63f3-metrics-cert\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.737271 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.737270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c170135c-eadb-4bff-9ad0-ed62d60d63f3-manager-config\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.737491 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.737301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c170135c-eadb-4bff-9ad0-ed62d60d63f3-cert\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.737491 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.737408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsslr\" (UniqueName: \"kubernetes.io/projected/c170135c-eadb-4bff-9ad0-ed62d60d63f3-kube-api-access-nsslr\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.838919 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.838870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c170135c-eadb-4bff-9ad0-ed62d60d63f3-metrics-cert\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.838919 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.838923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c170135c-eadb-4bff-9ad0-ed62d60d63f3-manager-config\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.839283 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.838965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c170135c-eadb-4bff-9ad0-ed62d60d63f3-cert\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.839283 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.839027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsslr\" (UniqueName: \"kubernetes.io/projected/c170135c-eadb-4bff-9ad0-ed62d60d63f3-kube-api-access-nsslr\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.839752 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.839725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c170135c-eadb-4bff-9ad0-ed62d60d63f3-manager-config\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.841887 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.841855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c170135c-eadb-4bff-9ad0-ed62d60d63f3-metrics-cert\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.842019 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.841855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c170135c-eadb-4bff-9ad0-ed62d60d63f3-cert\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.850232 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.850197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsslr\" (UniqueName: \"kubernetes.io/projected/c170135c-eadb-4bff-9ad0-ed62d60d63f3-kube-api-access-nsslr\") pod \"lws-controller-manager-6bf7bdd7c5-r9zcs\" (UID: \"c170135c-eadb-4bff-9ad0-ed62d60d63f3\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:42.939573 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:42.939525    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:43.098905 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:43.098767    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"]
Jul 12 00:02:43.101728 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:02:43.101690    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc170135c_eadb_4bff_9ad0_ed62d60d63f3.slice/crio-10ea104db5d25c88350eb9a74bcb6e1b4accc58d128d348dab14b8f3ad9cd89e WatchSource:0}: Error finding container 10ea104db5d25c88350eb9a74bcb6e1b4accc58d128d348dab14b8f3ad9cd89e: Status 404 returned error can't find the container with id 10ea104db5d25c88350eb9a74bcb6e1b4accc58d128d348dab14b8f3ad9cd89e
Jul 12 00:02:43.703709 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:43.703667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs" event={"ID":"c170135c-eadb-4bff-9ad0-ed62d60d63f3","Type":"ContainerStarted","Data":"10ea104db5d25c88350eb9a74bcb6e1b4accc58d128d348dab14b8f3ad9cd89e"}
Jul 12 00:02:45.754159 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:45.754111    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 00:02:45.754625 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:45.754190    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 12 00:02:46.237030 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.236983    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jch66"]
Jul 12 00:02:46.721313 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.721270    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs" event={"ID":"c170135c-eadb-4bff-9ad0-ed62d60d63f3","Type":"ContainerStarted","Data":"c56f55307d8449c8c4bc34f3dd81641bc13e8703af9d9a2ee27099999980434d"}
Jul 12 00:02:46.721537 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.721362    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:02:46.723111 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.723081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66" event={"ID":"84c4bd61-1385-4f69-91a8-a77ddc1766b8","Type":"ContainerStarted","Data":"260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2"}
Jul 12 00:02:46.723285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.723271    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:46.725155 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.725126    2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-jch66 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 00:02:46.725277 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.725198    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66" podUID="84c4bd61-1385-4f69-91a8-a77ddc1766b8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 00:02:46.737314 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.737246    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs" podStartSLOduration=2.091142297 podStartE2EDuration="4.737226068s" totalImagesPullingTime="2.646083771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:46.735956145 +0000 UTC m=+354.538865033" watchObservedRunningTime="2026-07-12 00:02:46.737226068 +0000 UTC m=+354.540134933"
Jul 12 00:02:46.755247 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:46.755187    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66" podStartSLOduration=2.457280901 podStartE2EDuration="11.755166096s" totalImagesPullingTime="9.297885195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:46.753689645 +0000 UTC m=+354.556598534" watchObservedRunningTime="2026-07-12 00:02:46.755166096 +0000 UTC m=+354.558075049"
Jul 12 00:02:47.728402 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:47.728353    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66" podUID="84c4bd61-1385-4f69-91a8-a77ddc1766b8" containerName="discovery" containerID="cri-o://260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2" gracePeriod=30
Jul 12 00:02:47.729258 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:47.729231    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:47.981222 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:47.981145    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:48.094928 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.094880    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-dns-cert\") pod \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") "
Jul 12 00:02:48.094928 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.094934    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxg4x\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-kube-api-access-hxg4x\") pod \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") "
Jul 12 00:02:48.095210 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.094967    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c4bd61-1385-4f69-91a8-a77ddc1766b8-local-certs\") pod \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") "
Jul 12 00:02:48.095210 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.094994    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-cacerts\") pod \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") "
Jul 12 00:02:48.095210 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.095087    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-ca-configmap\") pod \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") "
Jul 12 00:02:48.095210 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.095158    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-token\") pod \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") "
Jul 12 00:02:48.095210 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.095186    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-kubeconfig\") pod \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\" (UID: \"84c4bd61-1385-4f69-91a8-a77ddc1766b8\") "
Jul 12 00:02:48.095608 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.095557    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "84c4bd61-1385-4f69-91a8-a77ddc1766b8" (UID: "84c4bd61-1385-4f69-91a8-a77ddc1766b8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:02:48.097587 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.097537    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-cacerts" (OuterVolumeSpecName: "cacerts") pod "84c4bd61-1385-4f69-91a8-a77ddc1766b8" (UID: "84c4bd61-1385-4f69-91a8-a77ddc1766b8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:02:48.097587 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.097537    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "84c4bd61-1385-4f69-91a8-a77ddc1766b8" (UID: "84c4bd61-1385-4f69-91a8-a77ddc1766b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:02:48.097820 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.097685    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "84c4bd61-1385-4f69-91a8-a77ddc1766b8" (UID: "84c4bd61-1385-4f69-91a8-a77ddc1766b8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:02:48.097820 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.097726    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "84c4bd61-1385-4f69-91a8-a77ddc1766b8" (UID: "84c4bd61-1385-4f69-91a8-a77ddc1766b8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:02:48.097892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.097857    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c4bd61-1385-4f69-91a8-a77ddc1766b8-local-certs" (OuterVolumeSpecName: "local-certs") pod "84c4bd61-1385-4f69-91a8-a77ddc1766b8" (UID: "84c4bd61-1385-4f69-91a8-a77ddc1766b8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:02:48.097892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.097856    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-kube-api-access-hxg4x" (OuterVolumeSpecName: "kube-api-access-hxg4x") pod "84c4bd61-1385-4f69-91a8-a77ddc1766b8" (UID: "84c4bd61-1385-4f69-91a8-a77ddc1766b8"). InnerVolumeSpecName "kube-api-access-hxg4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:02:48.196318 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.196275    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-token\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:48.196318 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.196312    2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-kubeconfig\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:48.196318 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.196321    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-dns-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:48.196318 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.196330    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxg4x\" (UniqueName: \"kubernetes.io/projected/84c4bd61-1385-4f69-91a8-a77ddc1766b8-kube-api-access-hxg4x\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:48.196608 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.196339    2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c4bd61-1385-4f69-91a8-a77ddc1766b8-local-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:48.196608 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.196348    2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84c4bd61-1385-4f69-91a8-a77ddc1766b8-cacerts\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:48.196608 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.196356    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84c4bd61-1385-4f69-91a8-a77ddc1766b8-istio-csr-ca-configmap\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:02:48.734824 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.734785    2583 generic.go:356] "Generic (PLEG): container finished" podID="84c4bd61-1385-4f69-91a8-a77ddc1766b8" containerID="260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2" exitCode=0
Jul 12 00:02:48.735014 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.734848    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66"
Jul 12 00:02:48.735014 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.734877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66" event={"ID":"84c4bd61-1385-4f69-91a8-a77ddc1766b8","Type":"ContainerDied","Data":"260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2"}
Jul 12 00:02:48.735014 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.734931    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jch66" event={"ID":"84c4bd61-1385-4f69-91a8-a77ddc1766b8","Type":"ContainerDied","Data":"ef13ea1bc215227046384bb83401abcfb2970863654924a9894cb579b7f06085"}
Jul 12 00:02:48.735014 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.734952    2583 scope.go:117] "RemoveContainer" containerID="260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2"
Jul 12 00:02:48.745191 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.745167    2583 scope.go:117] "RemoveContainer" containerID="260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2"
Jul 12 00:02:48.745541 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:02:48.745521    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2\": container with ID starting with 260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2 not found: ID does not exist" containerID="260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2"
Jul 12 00:02:48.745591 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.745553    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2"} err="failed to get container status \"260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2\": rpc error: code = NotFound desc = could not find container \"260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2\": container with ID starting with 260c713e5985bc9a49ba6ea85a56011f508de88e78073f07774a0d85f2eebcc2 not found: ID does not exist"
Jul 12 00:02:48.760027 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.759982    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jch66"]
Jul 12 00:02:48.763782 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.763743    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jch66"]
Jul 12 00:02:48.782837 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:48.782802    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c4bd61-1385-4f69-91a8-a77ddc1766b8" path="/var/lib/kubelet/pods/84c4bd61-1385-4f69-91a8-a77ddc1766b8/volumes"
Jul 12 00:02:50.691196 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:50.691161    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-w8g2d"
Jul 12 00:02:50.693302 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:50.693279    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lwgvx"
Jul 12 00:02:57.730676 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:02:57.730644    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-r9zcs"
Jul 12 00:03:51.434857 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.434816    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"]
Jul 12 00:03:51.435357 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.435175    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c4bd61-1385-4f69-91a8-a77ddc1766b8" containerName="discovery"
Jul 12 00:03:51.435357 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.435187    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c4bd61-1385-4f69-91a8-a77ddc1766b8" containerName="discovery"
Jul 12 00:03:51.435357 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.435260    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c4bd61-1385-4f69-91a8-a77ddc1766b8" containerName="discovery"
Jul 12 00:03:51.438529 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.438507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.440983 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.440950    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 00:03:51.440983 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.440966    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 00:03:51.441881 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.441863    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-82w8r\""
Jul 12 00:03:51.445969 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.445924    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"]
Jul 12 00:03:51.569222 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.569175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l7kf\" (UniqueName: \"kubernetes.io/projected/5d277fe6-a122-43c8-aa7e-8f03eb533a97-kube-api-access-9l7kf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.569222 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.569230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.569505 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.569346    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.670609 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.670567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l7kf\" (UniqueName: \"kubernetes.io/projected/5d277fe6-a122-43c8-aa7e-8f03eb533a97-kube-api-access-9l7kf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.670609 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.670620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.670884 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.670668    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.671156 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.671134    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.671156 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.671148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.679582 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.679552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l7kf\" (UniqueName: \"kubernetes.io/projected/5d277fe6-a122-43c8-aa7e-8f03eb533a97-kube-api-access-9l7kf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.749247 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.749149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:51.835941 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.835897    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"]
Jul 12 00:03:51.839996 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.839964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:51.847327 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.847274    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"]
Jul 12 00:03:51.913122 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.913087    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"]
Jul 12 00:03:51.916755 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:03:51.916713    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d277fe6_a122_43c8_aa7e_8f03eb533a97.slice/crio-ce575bcb73ec3229b4d9d3b5e189c8884d67e92dc79fe687a6a8f3ae25f39edd WatchSource:0}: Error finding container ce575bcb73ec3229b4d9d3b5e189c8884d67e92dc79fe687a6a8f3ae25f39edd: Status 404 returned error can't find the container with id ce575bcb73ec3229b4d9d3b5e189c8884d67e92dc79fe687a6a8f3ae25f39edd
Jul 12 00:03:51.973975 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.973940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:51.974161 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.974002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ntpb\" (UniqueName: \"kubernetes.io/projected/1eb00d54-7e37-437e-a949-cd62a414ed2b-kube-api-access-8ntpb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:51.974161 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:51.974132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.057502 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.057460    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerID="a75c900458d3494748bb3a94662380332665ef2e39568abb1a63b6b1e80da3b6" exitCode=0
Jul 12 00:03:52.057714 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.057548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s" event={"ID":"5d277fe6-a122-43c8-aa7e-8f03eb533a97","Type":"ContainerDied","Data":"a75c900458d3494748bb3a94662380332665ef2e39568abb1a63b6b1e80da3b6"}
Jul 12 00:03:52.057714 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.057615    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s" event={"ID":"5d277fe6-a122-43c8-aa7e-8f03eb533a97","Type":"ContainerStarted","Data":"ce575bcb73ec3229b4d9d3b5e189c8884d67e92dc79fe687a6a8f3ae25f39edd"}
Jul 12 00:03:52.075199 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.075164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.075199 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.075213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.075484 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.075265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ntpb\" (UniqueName: \"kubernetes.io/projected/1eb00d54-7e37-437e-a949-cd62a414ed2b-kube-api-access-8ntpb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.075667 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.075642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.075667 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.075658    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.084075 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.084020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ntpb\" (UniqueName: \"kubernetes.io/projected/1eb00d54-7e37-437e-a949-cd62a414ed2b-kube-api-access-8ntpb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.152968 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.152929    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:52.238954 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.238908    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"]
Jul 12 00:03:52.243618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.243589    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.248179 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.248093    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"]
Jul 12 00:03:52.311006 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.310973    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"]
Jul 12 00:03:52.312924 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:03:52.312891    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb00d54_7e37_437e_a949_cd62a414ed2b.slice/crio-f2b68d0b760b89c0021d5026551e9323e5a4745a519447e4dba47b269d859d23 WatchSource:0}: Error finding container f2b68d0b760b89c0021d5026551e9323e5a4745a519447e4dba47b269d859d23: Status 404 returned error can't find the container with id f2b68d0b760b89c0021d5026551e9323e5a4745a519447e4dba47b269d859d23
Jul 12 00:03:52.379239 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.379215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.379339 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.379276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.379411 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.379387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9drs8\" (UniqueName: \"kubernetes.io/projected/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-kube-api-access-9drs8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.480854 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.480810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.481377 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.480865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9drs8\" (UniqueName: \"kubernetes.io/projected/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-kube-api-access-9drs8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.481377 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.480913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.481377 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.481357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.481377 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.481356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.489568 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.489534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9drs8\" (UniqueName: \"kubernetes.io/projected/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-kube-api-access-9drs8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.557292 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.557245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:52.643390 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.643348    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"]
Jul 12 00:03:52.651738 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.651702    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.653418 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.653380    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"]
Jul 12 00:03:52.726005 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.725962    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"]
Jul 12 00:03:52.729171 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:03:52.729126    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a5a4a3_37ac_4bd2_acbb_3be74c44dff0.slice/crio-619a8868c2b0e058478a76c2909dcc750a840cf197f51a1b5843842a38d9074e WatchSource:0}: Error finding container 619a8868c2b0e058478a76c2909dcc750a840cf197f51a1b5843842a38d9074e: Status 404 returned error can't find the container with id 619a8868c2b0e058478a76c2909dcc750a840cf197f51a1b5843842a38d9074e
Jul 12 00:03:52.784285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.784250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.784436 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.784337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.784436 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.784398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shgc\" (UniqueName: \"kubernetes.io/projected/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-kube-api-access-9shgc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.885140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.885107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.885286 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.885166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shgc\" (UniqueName: \"kubernetes.io/projected/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-kube-api-access-9shgc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.885286 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.885208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.885507 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.885482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.885578 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.885539    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.894194 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.894152    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shgc\" (UniqueName: \"kubernetes.io/projected/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-kube-api-access-9shgc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:52.967859 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:52.967815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:53.066606 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.066483    2583 generic.go:356] "Generic (PLEG): container finished" podID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerID="52f36fb21cc19ef2d38dd36fd3945b52439910bb1d91ebb3d0472624d1505fda" exitCode=0
Jul 12 00:03:53.066606 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.066577    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp" event={"ID":"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0","Type":"ContainerDied","Data":"52f36fb21cc19ef2d38dd36fd3945b52439910bb1d91ebb3d0472624d1505fda"}
Jul 12 00:03:53.066866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.066645    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp" event={"ID":"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0","Type":"ContainerStarted","Data":"619a8868c2b0e058478a76c2909dcc750a840cf197f51a1b5843842a38d9074e"}
Jul 12 00:03:53.069280 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.069243    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerID="577b4925c6a5fd6ad815cbfa340267089f48e2285d4117628c5c6fa5f8413ca4" exitCode=0
Jul 12 00:03:53.069464 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.069321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s" event={"ID":"5d277fe6-a122-43c8-aa7e-8f03eb533a97","Type":"ContainerDied","Data":"577b4925c6a5fd6ad815cbfa340267089f48e2285d4117628c5c6fa5f8413ca4"}
Jul 12 00:03:53.071950 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.071780    2583 generic.go:356] "Generic (PLEG): container finished" podID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerID="8e6a5f8f2471db5e3bfec19a980184f6ce58d5216b91e5f6a8341716d98faf06" exitCode=0
Jul 12 00:03:53.071950 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.071814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st" event={"ID":"1eb00d54-7e37-437e-a949-cd62a414ed2b","Type":"ContainerDied","Data":"8e6a5f8f2471db5e3bfec19a980184f6ce58d5216b91e5f6a8341716d98faf06"}
Jul 12 00:03:53.071950 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.071900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st" event={"ID":"1eb00d54-7e37-437e-a949-cd62a414ed2b","Type":"ContainerStarted","Data":"f2b68d0b760b89c0021d5026551e9323e5a4745a519447e4dba47b269d859d23"}
Jul 12 00:03:53.131639 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:53.131609    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"]
Jul 12 00:03:53.133741 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:03:53.133712    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe32c8cf_3cf3_40cc_8fe2_6933fe66e0f0.slice/crio-a462d690ea7a92a9a7788d220ada2aac79f1ed95bad8474b1afd1e1fe2bcd9ed WatchSource:0}: Error finding container a462d690ea7a92a9a7788d220ada2aac79f1ed95bad8474b1afd1e1fe2bcd9ed: Status 404 returned error can't find the container with id a462d690ea7a92a9a7788d220ada2aac79f1ed95bad8474b1afd1e1fe2bcd9ed
Jul 12 00:03:54.081307 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:54.081264    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerID="885973d7be6ca86c85183bb77a41287feebd931f19c17e7bc7506afe6e37ae27" exitCode=0
Jul 12 00:03:54.081775 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:54.081309    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk" event={"ID":"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0","Type":"ContainerDied","Data":"885973d7be6ca86c85183bb77a41287feebd931f19c17e7bc7506afe6e37ae27"}
Jul 12 00:03:54.081775 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:54.081382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk" event={"ID":"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0","Type":"ContainerStarted","Data":"a462d690ea7a92a9a7788d220ada2aac79f1ed95bad8474b1afd1e1fe2bcd9ed"}
Jul 12 00:03:54.084593 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:54.084558    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerID="e95afce888875bb2c11eb91f4b0b516ee442f4e1f4f9e460e338344e6a6b47fa" exitCode=0
Jul 12 00:03:54.084730 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:54.084647    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s" event={"ID":"5d277fe6-a122-43c8-aa7e-8f03eb533a97","Type":"ContainerDied","Data":"e95afce888875bb2c11eb91f4b0b516ee442f4e1f4f9e460e338344e6a6b47fa"}
Jul 12 00:03:55.096456 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.096339    2583 generic.go:356] "Generic (PLEG): container finished" podID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerID="e6807095ef6e42e6c766288a2b9c415f2266e27b5e4dfaca0491641f58f464ba" exitCode=0
Jul 12 00:03:55.096456 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.096423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp" event={"ID":"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0","Type":"ContainerDied","Data":"e6807095ef6e42e6c766288a2b9c415f2266e27b5e4dfaca0491641f58f464ba"}
Jul 12 00:03:55.098775 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.098748    2583 generic.go:356] "Generic (PLEG): container finished" podID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerID="c67e9599a02c0d94d3f2780f0cd3a7a5f87f1831bf8ab90bc804930ec3dc3f8a" exitCode=0
Jul 12 00:03:55.098867 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.098830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st" event={"ID":"1eb00d54-7e37-437e-a949-cd62a414ed2b","Type":"ContainerDied","Data":"c67e9599a02c0d94d3f2780f0cd3a7a5f87f1831bf8ab90bc804930ec3dc3f8a"}
Jul 12 00:03:55.101070 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.101007    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerID="34562d62f37ea0d141aa692fbcf998afcbc69c91e86bb07d7e6fc19854d8f6cc" exitCode=0
Jul 12 00:03:55.101197 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.101078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk" event={"ID":"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0","Type":"ContainerDied","Data":"34562d62f37ea0d141aa692fbcf998afcbc69c91e86bb07d7e6fc19854d8f6cc"}
Jul 12 00:03:55.262967 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.262561    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:55.409672 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.409638    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-util\") pod \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") "
Jul 12 00:03:55.409672 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.409678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l7kf\" (UniqueName: \"kubernetes.io/projected/5d277fe6-a122-43c8-aa7e-8f03eb533a97-kube-api-access-9l7kf\") pod \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") "
Jul 12 00:03:55.409920 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.409715    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-bundle\") pod \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\" (UID: \"5d277fe6-a122-43c8-aa7e-8f03eb533a97\") "
Jul 12 00:03:55.410272 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.410246    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-bundle" (OuterVolumeSpecName: "bundle") pod "5d277fe6-a122-43c8-aa7e-8f03eb533a97" (UID: "5d277fe6-a122-43c8-aa7e-8f03eb533a97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:55.412113 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.412079    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d277fe6-a122-43c8-aa7e-8f03eb533a97-kube-api-access-9l7kf" (OuterVolumeSpecName: "kube-api-access-9l7kf") pod "5d277fe6-a122-43c8-aa7e-8f03eb533a97" (UID: "5d277fe6-a122-43c8-aa7e-8f03eb533a97"). InnerVolumeSpecName "kube-api-access-9l7kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:03:55.416336 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.416294    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-util" (OuterVolumeSpecName: "util") pod "5d277fe6-a122-43c8-aa7e-8f03eb533a97" (UID: "5d277fe6-a122-43c8-aa7e-8f03eb533a97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:55.511669 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.511624    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:55.511669 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.511668    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l7kf\" (UniqueName: \"kubernetes.io/projected/5d277fe6-a122-43c8-aa7e-8f03eb533a97-kube-api-access-9l7kf\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:55.511930 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:55.511685    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d277fe6-a122-43c8-aa7e-8f03eb533a97-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:56.109411 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.109375    2583 generic.go:356] "Generic (PLEG): container finished" podID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerID="8b558ea653231560f417cccc76f6e66bb29037e0465c2d761904c5637f59922c" exitCode=0
Jul 12 00:03:56.109866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.109456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp" event={"ID":"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0","Type":"ContainerDied","Data":"8b558ea653231560f417cccc76f6e66bb29037e0465c2d761904c5637f59922c"}
Jul 12 00:03:56.111390 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.111365    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s"
Jul 12 00:03:56.111532 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.111376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s" event={"ID":"5d277fe6-a122-43c8-aa7e-8f03eb533a97","Type":"ContainerDied","Data":"ce575bcb73ec3229b4d9d3b5e189c8884d67e92dc79fe687a6a8f3ae25f39edd"}
Jul 12 00:03:56.111532 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.111470    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce575bcb73ec3229b4d9d3b5e189c8884d67e92dc79fe687a6a8f3ae25f39edd"
Jul 12 00:03:56.113586 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.113553    2583 generic.go:356] "Generic (PLEG): container finished" podID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerID="4c969d9c2478d2a192321cdb491c21e249d5d032786487977dcddc845851ffc7" exitCode=0
Jul 12 00:03:56.113724 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.113643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st" event={"ID":"1eb00d54-7e37-437e-a949-cd62a414ed2b","Type":"ContainerDied","Data":"4c969d9c2478d2a192321cdb491c21e249d5d032786487977dcddc845851ffc7"}
Jul 12 00:03:56.115934 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.115903    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerID="87591b4e5f721b4d5c96d807b0ffe8711a469eb0474efbaf8a433d14de08194b" exitCode=0
Jul 12 00:03:56.116103 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:56.115989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk" event={"ID":"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0","Type":"ContainerDied","Data":"87591b4e5f721b4d5c96d807b0ffe8711a469eb0474efbaf8a433d14de08194b"}
Jul 12 00:03:57.294396 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.294365    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:57.328169 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.328135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9drs8\" (UniqueName: \"kubernetes.io/projected/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-kube-api-access-9drs8\") pod \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") "
Jul 12 00:03:57.328334 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.328221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-bundle\") pod \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") "
Jul 12 00:03:57.328334 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.328290    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-util\") pod \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\" (UID: \"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0\") "
Jul 12 00:03:57.328930 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.328895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-bundle" (OuterVolumeSpecName: "bundle") pod "e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" (UID: "e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:57.330780 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.330745    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-kube-api-access-9drs8" (OuterVolumeSpecName: "kube-api-access-9drs8") pod "e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" (UID: "e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0"). InnerVolumeSpecName "kube-api-access-9drs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:03:57.336476 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.336438    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:57.338131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.338090    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-util" (OuterVolumeSpecName: "util") pod "e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" (UID: "e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:57.347603 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.347565    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:57.429791 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.429755    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-bundle\") pod \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") "
Jul 12 00:03:57.429989 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.429803    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ntpb\" (UniqueName: \"kubernetes.io/projected/1eb00d54-7e37-437e-a949-cd62a414ed2b-kube-api-access-8ntpb\") pod \"1eb00d54-7e37-437e-a949-cd62a414ed2b\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") "
Jul 12 00:03:57.429989 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.429827    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-util\") pod \"1eb00d54-7e37-437e-a949-cd62a414ed2b\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") "
Jul 12 00:03:57.429989 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.429854    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-bundle\") pod \"1eb00d54-7e37-437e-a949-cd62a414ed2b\" (UID: \"1eb00d54-7e37-437e-a949-cd62a414ed2b\") "
Jul 12 00:03:57.429989 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.429917    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-util\") pod \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") "
Jul 12 00:03:57.429989 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.429955    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9shgc\" (UniqueName: \"kubernetes.io/projected/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-kube-api-access-9shgc\") pod \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\" (UID: \"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0\") "
Jul 12 00:03:57.430434 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.430325    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.430434 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.430347    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.430434 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.430360    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9drs8\" (UniqueName: \"kubernetes.io/projected/e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0-kube-api-access-9drs8\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.430631 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.430493    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-bundle" (OuterVolumeSpecName: "bundle") pod "fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" (UID: "fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:57.430631 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.430535    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-bundle" (OuterVolumeSpecName: "bundle") pod "1eb00d54-7e37-437e-a949-cd62a414ed2b" (UID: "1eb00d54-7e37-437e-a949-cd62a414ed2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:57.432741 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.432699    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-kube-api-access-9shgc" (OuterVolumeSpecName: "kube-api-access-9shgc") pod "fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" (UID: "fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0"). InnerVolumeSpecName "kube-api-access-9shgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:03:57.432741 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.432711    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb00d54-7e37-437e-a949-cd62a414ed2b-kube-api-access-8ntpb" (OuterVolumeSpecName: "kube-api-access-8ntpb") pod "1eb00d54-7e37-437e-a949-cd62a414ed2b" (UID: "1eb00d54-7e37-437e-a949-cd62a414ed2b"). InnerVolumeSpecName "kube-api-access-8ntpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:03:57.435453 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.435419    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-util" (OuterVolumeSpecName: "util") pod "1eb00d54-7e37-437e-a949-cd62a414ed2b" (UID: "1eb00d54-7e37-437e-a949-cd62a414ed2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:57.436189 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.436165    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-util" (OuterVolumeSpecName: "util") pod "fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" (UID: "fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:03:57.531539 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.531484    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.531539 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.531528    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ntpb\" (UniqueName: \"kubernetes.io/projected/1eb00d54-7e37-437e-a949-cd62a414ed2b-kube-api-access-8ntpb\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.531539 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.531539    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.531539 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.531549    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb00d54-7e37-437e-a949-cd62a414ed2b-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.531539 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.531557    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:57.531867 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:57.531565    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9shgc\" (UniqueName: \"kubernetes.io/projected/fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0-kube-api-access-9shgc\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:03:58.129255 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.129224    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st"
Jul 12 00:03:58.129480 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.129218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st" event={"ID":"1eb00d54-7e37-437e-a949-cd62a414ed2b","Type":"ContainerDied","Data":"f2b68d0b760b89c0021d5026551e9323e5a4745a519447e4dba47b269d859d23"}
Jul 12 00:03:58.129480 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.129355    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2b68d0b760b89c0021d5026551e9323e5a4745a519447e4dba47b269d859d23"
Jul 12 00:03:58.131387 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.131354    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk"
Jul 12 00:03:58.131387 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.131368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk" event={"ID":"fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0","Type":"ContainerDied","Data":"a462d690ea7a92a9a7788d220ada2aac79f1ed95bad8474b1afd1e1fe2bcd9ed"}
Jul 12 00:03:58.131582 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.131426    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a462d690ea7a92a9a7788d220ada2aac79f1ed95bad8474b1afd1e1fe2bcd9ed"
Jul 12 00:03:58.133591 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.133556    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp" event={"ID":"e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0","Type":"ContainerDied","Data":"619a8868c2b0e058478a76c2909dcc750a840cf197f51a1b5843842a38d9074e"}
Jul 12 00:03:58.133591 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.133583    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp"
Jul 12 00:03:58.133761 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:03:58.133603    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="619a8868c2b0e058478a76c2909dcc750a840cf197f51a1b5843842a38d9074e"
Jul 12 00:04:17.855109 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.854982    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"]
Jul 12 00:04:17.855603 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855576    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerName="util"
Jul 12 00:04:17.855652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855607    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerName="util"
Jul 12 00:04:17.855652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855618    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerName="pull"
Jul 12 00:04:17.855652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855626    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerName="pull"
Jul 12 00:04:17.855652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855637    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerName="extract"
Jul 12 00:04:17.855652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855647    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerName="extract"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855662    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerName="pull"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855670    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerName="pull"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855685    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerName="util"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855692    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerName="util"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855706    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerName="util"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855714    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerName="util"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855723    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerName="pull"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855730    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerName="pull"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855738    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerName="extract"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855746    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerName="extract"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855757    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerName="util"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855765    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerName="util"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855772    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerName="extract"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855782    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerName="extract"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855792    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerName="pull"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855800    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerName="pull"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855814    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerName="extract"
Jul 12 00:04:17.855851 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855821    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerName="extract"
Jul 12 00:04:17.856449 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855925    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d277fe6-a122-43c8-aa7e-8f03eb533a97" containerName="extract"
Jul 12 00:04:17.856449 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855934    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0" containerName="extract"
Jul 12 00:04:17.856449 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855941    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb00d54-7e37-437e-a949-cd62a414ed2b" containerName="extract"
Jul 12 00:04:17.856449 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.855949    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0" containerName="extract"
Jul 12 00:04:17.858957 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.858933    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:17.861747 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.861715    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 12 00:04:17.861900 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.861780    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 00:04:17.862834 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.862813    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 00:04:17.862970 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.862854    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 12 00:04:17.862970 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.862879    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-82w8r\""
Jul 12 00:04:17.870254 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.870222    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"]
Jul 12 00:04:17.911580 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.911527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4tcz\" (UniqueName: \"kubernetes.io/projected/23a96cba-ecb6-4293-af47-ae53c4041ee9-kube-api-access-g4tcz\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:17.911801 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.911651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/23a96cba-ecb6-4293-af47-ae53c4041ee9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:17.911801 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:17.911715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23a96cba-ecb6-4293-af47-ae53c4041ee9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.013141 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.013100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23a96cba-ecb6-4293-af47-ae53c4041ee9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.013331 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.013157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4tcz\" (UniqueName: \"kubernetes.io/projected/23a96cba-ecb6-4293-af47-ae53c4041ee9-kube-api-access-g4tcz\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.013331 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.013221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/23a96cba-ecb6-4293-af47-ae53c4041ee9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.013424 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:04:18.013340    2583 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 12 00:04:18.013424 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:04:18.013409    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a96cba-ecb6-4293-af47-ae53c4041ee9-plugin-serving-cert podName:23a96cba-ecb6-4293-af47-ae53c4041ee9 nodeName:}" failed. No retries permitted until 2026-07-12 00:04:18.513391342 +0000 UTC m=+446.316300206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/23a96cba-ecb6-4293-af47-ae53c4041ee9-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-sj8lt" (UID: "23a96cba-ecb6-4293-af47-ae53c4041ee9") : secret "plugin-serving-cert" not found
Jul 12 00:04:18.013774 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.013750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23a96cba-ecb6-4293-af47-ae53c4041ee9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.022878 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.022832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4tcz\" (UniqueName: \"kubernetes.io/projected/23a96cba-ecb6-4293-af47-ae53c4041ee9-kube-api-access-g4tcz\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.518019 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.517973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/23a96cba-ecb6-4293-af47-ae53c4041ee9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.520639 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.520613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/23a96cba-ecb6-4293-af47-ae53c4041ee9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sj8lt\" (UID: \"23a96cba-ecb6-4293-af47-ae53c4041ee9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.771636 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.771522    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"
Jul 12 00:04:18.925292 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:18.925263    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt"]
Jul 12 00:04:18.927786 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:04:18.927754    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a96cba_ecb6_4293_af47_ae53c4041ee9.slice/crio-9d8104cca09ae255326b1789c49fc602651049925f8fc395d9f30eb4270c9389 WatchSource:0}: Error finding container 9d8104cca09ae255326b1789c49fc602651049925f8fc395d9f30eb4270c9389: Status 404 returned error can't find the container with id 9d8104cca09ae255326b1789c49fc602651049925f8fc395d9f30eb4270c9389
Jul 12 00:04:19.250359 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:19.250317    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt" event={"ID":"23a96cba-ecb6-4293-af47-ae53c4041ee9","Type":"ContainerStarted","Data":"9d8104cca09ae255326b1789c49fc602651049925f8fc395d9f30eb4270c9389"}
Jul 12 00:04:42.418219 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:42.418174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt" event={"ID":"23a96cba-ecb6-4293-af47-ae53c4041ee9","Type":"ContainerStarted","Data":"1b9bf497ba38a70d84c306fdd468da55459ec7e29eb8f8f4e4c9348d1251ca0b"}
Jul 12 00:04:42.441963 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:42.438266    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj8lt" podStartSLOduration=2.882623871 podStartE2EDuration="25.438224642s" totalImagesPullingTime="22.555600771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:42.434301052 +0000 UTC m=+470.237209932" watchObservedRunningTime="2026-07-12 00:04:42.438224642 +0000 UTC m=+470.241133530"
Jul 12 00:04:50.611712 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.611672    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d48fbcfc4-txmcx"]
Jul 12 00:04:50.615343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.615309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.629178 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.627515    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d48fbcfc4-txmcx"]
Jul 12 00:04:50.712016 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.711976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-config\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.712220 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.712030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-oauth-serving-cert\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.712220 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.712103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-service-ca\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.712220 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.712132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-trusted-ca-bundle\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.712220 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.712155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkrm\" (UniqueName: \"kubernetes.io/projected/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-kube-api-access-sxkrm\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.712443 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.712220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-serving-cert\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.712443 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.712247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-oauth-config\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.812815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.812779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-config\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813024 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.812824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-oauth-serving-cert\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813024 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.812864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-service-ca\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813165 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-trusted-ca-bundle\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813165 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkrm\" (UniqueName: \"kubernetes.io/projected/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-kube-api-access-sxkrm\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813273 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-serving-cert\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813273 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-oauth-config\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813723 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-config\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813723 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813711    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-oauth-serving-cert\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.813995 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813971    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-service-ca\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.814095 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.813973    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-trusted-ca-bundle\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.815914 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.815889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-serving-cert\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.816002 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.815922    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-console-oauth-config\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.822023 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.821983    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkrm\" (UniqueName: \"kubernetes.io/projected/f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d-kube-api-access-sxkrm\") pod \"console-d48fbcfc4-txmcx\" (UID: \"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d\") " pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:50.932932 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:50.932890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:04:51.087440 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:51.087407    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d48fbcfc4-txmcx"]
Jul 12 00:04:51.089074 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:04:51.089021    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e3d71a_a2d0_4a73_bb7d_b7ba5482073d.slice/crio-5b0cf6429b0004970c00bcbfad5cb673a5658c135be14cad350d896bd0c7f92b WatchSource:0}: Error finding container 5b0cf6429b0004970c00bcbfad5cb673a5658c135be14cad350d896bd0c7f92b: Status 404 returned error can't find the container with id 5b0cf6429b0004970c00bcbfad5cb673a5658c135be14cad350d896bd0c7f92b
Jul 12 00:04:51.466651 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:51.466610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d48fbcfc4-txmcx" event={"ID":"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d","Type":"ContainerStarted","Data":"78ee5e6e6177fce442282c2eb8eb00e4b58acf686ee2f5438667b3940581d66e"}
Jul 12 00:04:51.466861 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:51.466667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d48fbcfc4-txmcx" event={"ID":"f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d","Type":"ContainerStarted","Data":"5b0cf6429b0004970c00bcbfad5cb673a5658c135be14cad350d896bd0c7f92b"}
Jul 12 00:04:51.488530 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:51.488468    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d48fbcfc4-txmcx" podStartSLOduration=1.488449452 podStartE2EDuration="1.488449452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:51.486357896 +0000 UTC m=+479.289266811" watchObservedRunningTime="2026-07-12 00:04:51.488449452 +0000 UTC m=+479.291358339"
Jul 12 00:04:52.662708 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:04:52.662669    2583 scope.go:117] "RemoveContainer" containerID="46401c111060b8725c0558ca0c97232918bf19dbf6bcaf545d8942a04cec21a8"
Jul 12 00:05:00.934014 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:00.933964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:05:00.934557 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:00.934066    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:05:00.939358 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:00.939328    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:05:01.526112 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:01.526079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d48fbcfc4-txmcx"
Jul 12 00:05:01.573583 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:01.573541    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5c78c89c-cnw5w"]
Jul 12 00:05:15.240551 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.240511    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2xm9d"]
Jul 12 00:05:15.246990 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.246958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2xm9d"
Jul 12 00:05:15.249634 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.249598    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bnw4d\""
Jul 12 00:05:15.250651 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.250625    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2xm9d"]
Jul 12 00:05:15.332594 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.332554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdbg\" (UniqueName: \"kubernetes.io/projected/1e240703-d893-4642-b0c8-9ded907089fb-kube-api-access-jtdbg\") pod \"authorino-58cd955675-2xm9d\" (UID: \"1e240703-d893-4642-b0c8-9ded907089fb\") " pod="kuadrant-system/authorino-58cd955675-2xm9d"
Jul 12 00:05:15.337032 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.336993    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6529h"]
Jul 12 00:05:15.339361 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.339340    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6529h"
Jul 12 00:05:15.345324 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.345292    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6529h"]
Jul 12 00:05:15.433892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.433852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8xsx\" (UniqueName: \"kubernetes.io/projected/379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee-kube-api-access-v8xsx\") pod \"authorino-75d556bd77-6529h\" (UID: \"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee\") " pod="kuadrant-system/authorino-75d556bd77-6529h"
Jul 12 00:05:15.434123 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.433900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdbg\" (UniqueName: \"kubernetes.io/projected/1e240703-d893-4642-b0c8-9ded907089fb-kube-api-access-jtdbg\") pod \"authorino-58cd955675-2xm9d\" (UID: \"1e240703-d893-4642-b0c8-9ded907089fb\") " pod="kuadrant-system/authorino-58cd955675-2xm9d"
Jul 12 00:05:15.441819 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.441787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdbg\" (UniqueName: \"kubernetes.io/projected/1e240703-d893-4642-b0c8-9ded907089fb-kube-api-access-jtdbg\") pod \"authorino-58cd955675-2xm9d\" (UID: \"1e240703-d893-4642-b0c8-9ded907089fb\") " pod="kuadrant-system/authorino-58cd955675-2xm9d"
Jul 12 00:05:15.534966 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.534838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8xsx\" (UniqueName: \"kubernetes.io/projected/379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee-kube-api-access-v8xsx\") pod \"authorino-75d556bd77-6529h\" (UID: \"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee\") " pod="kuadrant-system/authorino-75d556bd77-6529h"
Jul 12 00:05:15.542708 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.542672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8xsx\" (UniqueName: \"kubernetes.io/projected/379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee-kube-api-access-v8xsx\") pod \"authorino-75d556bd77-6529h\" (UID: \"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee\") " pod="kuadrant-system/authorino-75d556bd77-6529h"
Jul 12 00:05:15.558497 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.558455    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2xm9d"
Jul 12 00:05:15.650641 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.650592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6529h"
Jul 12 00:05:15.720081 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.720020    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2xm9d"]
Jul 12 00:05:15.724417 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:05:15.724379    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e240703_d893_4642_b0c8_9ded907089fb.slice/crio-fa3115289df9d94f1a888dca733792f0cad63f8b0e0d017ac37cce811bf513ea WatchSource:0}: Error finding container fa3115289df9d94f1a888dca733792f0cad63f8b0e0d017ac37cce811bf513ea: Status 404 returned error can't find the container with id fa3115289df9d94f1a888dca733792f0cad63f8b0e0d017ac37cce811bf513ea
Jul 12 00:05:15.811365 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:15.811333    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6529h"]
Jul 12 00:05:15.813402 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:05:15.813367    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod379fc1e6_fafa_4edb_ae62_c77e6b0cb2ee.slice/crio-b3706d79f1b359497e7da79b0b7dbda99e3d79bb21140bfe3b6956fb4ccac39b WatchSource:0}: Error finding container b3706d79f1b359497e7da79b0b7dbda99e3d79bb21140bfe3b6956fb4ccac39b: Status 404 returned error can't find the container with id b3706d79f1b359497e7da79b0b7dbda99e3d79bb21140bfe3b6956fb4ccac39b
Jul 12 00:05:16.621583 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:16.618164    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2xm9d" event={"ID":"1e240703-d893-4642-b0c8-9ded907089fb","Type":"ContainerStarted","Data":"fa3115289df9d94f1a888dca733792f0cad63f8b0e0d017ac37cce811bf513ea"}
Jul 12 00:05:16.625459 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:16.625362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6529h" event={"ID":"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee","Type":"ContainerStarted","Data":"b3706d79f1b359497e7da79b0b7dbda99e3d79bb21140bfe3b6956fb4ccac39b"}
Jul 12 00:05:19.654554 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:19.654502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6529h" event={"ID":"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee","Type":"ContainerStarted","Data":"a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c"}
Jul 12 00:05:19.656103 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:19.656069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2xm9d" event={"ID":"1e240703-d893-4642-b0c8-9ded907089fb","Type":"ContainerStarted","Data":"ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541"}
Jul 12 00:05:19.669463 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:19.669387    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6529h" podStartSLOduration=1.156240533 podStartE2EDuration="4.669367101s" totalImagesPullingTime="3.513126568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:19.669219209 +0000 UTC m=+507.472128091" watchObservedRunningTime="2026-07-12 00:05:19.669367101 +0000 UTC m=+507.472275989"
Jul 12 00:05:19.686505 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:19.686445    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2xm9d" podStartSLOduration=1.071257295 podStartE2EDuration="4.686427398s" totalImagesPullingTime="3.615170103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:19.684068243 +0000 UTC m=+507.486977133" watchObservedRunningTime="2026-07-12 00:05:19.686427398 +0000 UTC m=+507.489336284"
Jul 12 00:05:19.698751 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:19.698704    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2xm9d"]
Jul 12 00:05:21.666592 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:21.666550    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2xm9d" podUID="1e240703-d893-4642-b0c8-9ded907089fb" containerName="authorino" containerID="cri-o://ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541" gracePeriod=30
Jul 12 00:05:21.928865 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:21.928784    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2xm9d"
Jul 12 00:05:21.999355 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:21.999298    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtdbg\" (UniqueName: \"kubernetes.io/projected/1e240703-d893-4642-b0c8-9ded907089fb-kube-api-access-jtdbg\") pod \"1e240703-d893-4642-b0c8-9ded907089fb\" (UID: \"1e240703-d893-4642-b0c8-9ded907089fb\") "
Jul 12 00:05:22.001603 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.001571    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e240703-d893-4642-b0c8-9ded907089fb-kube-api-access-jtdbg" (OuterVolumeSpecName: "kube-api-access-jtdbg") pod "1e240703-d893-4642-b0c8-9ded907089fb" (UID: "1e240703-d893-4642-b0c8-9ded907089fb"). InnerVolumeSpecName "kube-api-access-jtdbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:05:22.101161 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.101120    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtdbg\" (UniqueName: \"kubernetes.io/projected/1e240703-d893-4642-b0c8-9ded907089fb-kube-api-access-jtdbg\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:22.673786 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.673748    2583 generic.go:356] "Generic (PLEG): container finished" podID="1e240703-d893-4642-b0c8-9ded907089fb" containerID="ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541" exitCode=0
Jul 12 00:05:22.674326 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.673801    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2xm9d"
Jul 12 00:05:22.674326 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.673839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2xm9d" event={"ID":"1e240703-d893-4642-b0c8-9ded907089fb","Type":"ContainerDied","Data":"ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541"}
Jul 12 00:05:22.674326 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.673889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2xm9d" event={"ID":"1e240703-d893-4642-b0c8-9ded907089fb","Type":"ContainerDied","Data":"fa3115289df9d94f1a888dca733792f0cad63f8b0e0d017ac37cce811bf513ea"}
Jul 12 00:05:22.674326 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.673915    2583 scope.go:117] "RemoveContainer" containerID="ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541"
Jul 12 00:05:22.684127 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.684106    2583 scope.go:117] "RemoveContainer" containerID="ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541"
Jul 12 00:05:22.684474 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:05:22.684453    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541\": container with ID starting with ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541 not found: ID does not exist" containerID="ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541"
Jul 12 00:05:22.684523 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.684485    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541"} err="failed to get container status \"ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541\": rpc error: code = NotFound desc = could not find container \"ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541\": container with ID starting with ddde233b8c37e0f725204581824e6c2a011981558c62d01d5ca04ac3c2703541 not found: ID does not exist"
Jul 12 00:05:22.695882 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.695828    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2xm9d"]
Jul 12 00:05:22.699523 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.699484    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2xm9d"]
Jul 12 00:05:22.782556 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:22.782518    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e240703-d893-4642-b0c8-9ded907089fb" path="/var/lib/kubelet/pods/1e240703-d893-4642-b0c8-9ded907089fb/volumes"
Jul 12 00:05:26.598564 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.598513    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f5c78c89c-cnw5w" podUID="fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" containerName="console" containerID="cri-o://e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd" gracePeriod=15
Jul 12 00:05:26.866404 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.866320    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 12 00:05:26.943480 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943433    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-oauth-config\") pod \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") "
Jul 12 00:05:26.943480 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943488    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-config\") pod \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") "
Jul 12 00:05:26.943764 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943550    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-oauth-serving-cert\") pod \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") "
Jul 12 00:05:26.943764 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943574    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-trusted-ca-bundle\") pod \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") "
Jul 12 00:05:26.943764 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943601    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2n87\" (UniqueName: \"kubernetes.io/projected/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-kube-api-access-c2n87\") pod \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") "
Jul 12 00:05:26.943764 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943637    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-serving-cert\") pod \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") "
Jul 12 00:05:26.943764 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943706    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-service-ca\") pod \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\" (UID: \"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b\") "
Jul 12 00:05:26.944027 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.943966    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-config" (OuterVolumeSpecName: "console-config") pod "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" (UID: "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:05:26.944131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.944025    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" (UID: "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:05:26.944263 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.944237    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" (UID: "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:05:26.944513 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.944483    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-service-ca" (OuterVolumeSpecName: "service-ca") pod "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" (UID: "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:05:26.945844 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.945821    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" (UID: "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:05:26.946008 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.945977    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" (UID: "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:05:26.946008 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:26.945993    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-kube-api-access-c2n87" (OuterVolumeSpecName: "kube-api-access-c2n87") pod "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" (UID: "fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b"). InnerVolumeSpecName "kube-api-access-c2n87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:05:27.045213 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.045164    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-trusted-ca-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:27.045213 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.045204    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2n87\" (UniqueName: \"kubernetes.io/projected/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-kube-api-access-c2n87\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:27.045213 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.045214    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:27.045213 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.045223    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:27.045213 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.045231    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-oauth-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:27.045535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.045240    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-console-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:27.045535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.045248    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b-oauth-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:27.703809 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.703760    2583 generic.go:356] "Generic (PLEG): container finished" podID="fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" containerID="e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd" exitCode=0
Jul 12 00:05:27.704311 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.703819    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5c78c89c-cnw5w"
Jul 12 00:05:27.704311 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.703856    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5c78c89c-cnw5w" event={"ID":"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b","Type":"ContainerDied","Data":"e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd"}
Jul 12 00:05:27.704311 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.703922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5c78c89c-cnw5w" event={"ID":"fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b","Type":"ContainerDied","Data":"c3f9f89296f7d776fe375bbbc043f005782ac53993a9f9abaaff9c25ed7988c2"}
Jul 12 00:05:27.704311 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.703951    2583 scope.go:117] "RemoveContainer" containerID="e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd"
Jul 12 00:05:27.714440 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.714418    2583 scope.go:117] "RemoveContainer" containerID="e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd"
Jul 12 00:05:27.714801 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:05:27.714780    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd\": container with ID starting with e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd not found: ID does not exist" containerID="e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd"
Jul 12 00:05:27.714874 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.714810    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd"} err="failed to get container status \"e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd\": rpc error: code = NotFound desc = could not find container \"e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd\": container with ID starting with e58e95c3f2d8f07fd5335edf9eff38085a4a2c1714317674342afab6fec6adbd not found: ID does not exist"
Jul 12 00:05:27.727257 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.727220    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5c78c89c-cnw5w"]
Jul 12 00:05:27.730560 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:27.730529    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f5c78c89c-cnw5w"]
Jul 12 00:05:28.782556 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:28.782512    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" path="/var/lib/kubelet/pods/fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b/volumes"
Jul 12 00:05:47.225168 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.225125    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c4db8"]
Jul 12 00:05:47.225690 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.225637    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" containerName="console"
Jul 12 00:05:47.225690 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.225658    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" containerName="console"
Jul 12 00:05:47.225690 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.225689    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e240703-d893-4642-b0c8-9ded907089fb" containerName="authorino"
Jul 12 00:05:47.225858 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.225698    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e240703-d893-4642-b0c8-9ded907089fb" containerName="authorino"
Jul 12 00:05:47.225858 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.225802    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec2c4e4-ec96-4d0a-8d30-f7ee218d3d3b" containerName="console"
Jul 12 00:05:47.225858 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.225816    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e240703-d893-4642-b0c8-9ded907089fb" containerName="authorino"
Jul 12 00:05:47.228790 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.228764    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c4db8"
Jul 12 00:05:47.234959 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.234925    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c4db8"]
Jul 12 00:05:47.332776 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.332727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tckn9\" (UniqueName: \"kubernetes.io/projected/c1e57b6a-bf27-4575-b10f-3cbe6ed68d18-kube-api-access-tckn9\") pod \"authorino-5d4b67c446-c4db8\" (UID: \"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18\") " pod="kuadrant-system/authorino-5d4b67c446-c4db8"
Jul 12 00:05:47.434097 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.434007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tckn9\" (UniqueName: \"kubernetes.io/projected/c1e57b6a-bf27-4575-b10f-3cbe6ed68d18-kube-api-access-tckn9\") pod \"authorino-5d4b67c446-c4db8\" (UID: \"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18\") " pod="kuadrant-system/authorino-5d4b67c446-c4db8"
Jul 12 00:05:47.445025 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.444984    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tckn9\" (UniqueName: \"kubernetes.io/projected/c1e57b6a-bf27-4575-b10f-3cbe6ed68d18-kube-api-access-tckn9\") pod \"authorino-5d4b67c446-c4db8\" (UID: \"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18\") " pod="kuadrant-system/authorino-5d4b67c446-c4db8"
Jul 12 00:05:47.456321 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.456281    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c4db8"]
Jul 12 00:05:47.456574 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.456562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c4db8"
Jul 12 00:05:47.477417 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.477330    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dddd67977-26nj5"]
Jul 12 00:05:47.480850 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.480826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dddd67977-26nj5"
Jul 12 00:05:47.487959 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.487922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dddd67977-26nj5"]
Jul 12 00:05:47.535513 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.535464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgp98\" (UniqueName: \"kubernetes.io/projected/67ee3275-025b-49f8-99f2-8eb5c99d6c3c-kube-api-access-zgp98\") pod \"authorino-dddd67977-26nj5\" (UID: \"67ee3275-025b-49f8-99f2-8eb5c99d6c3c\") " pod="kuadrant-system/authorino-dddd67977-26nj5"
Jul 12 00:05:47.571831 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.571783    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dddd67977-26nj5"]
Jul 12 00:05:47.572168 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:05:47.572138    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zgp98], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-dddd67977-26nj5" podUID="67ee3275-025b-49f8-99f2-8eb5c99d6c3c"
Jul 12 00:05:47.591613 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.591567    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55766d6cf7-76grl"]
Jul 12 00:05:47.595114 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.595079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.597933 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.597901    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 12 00:05:47.602898 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.602864    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55766d6cf7-76grl"]
Jul 12 00:05:47.619394 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.619360    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c4db8"]
Jul 12 00:05:47.621400 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:05:47.621368    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1e57b6a_bf27_4575_b10f_3cbe6ed68d18.slice/crio-d9248f8276c6d71964188e91f6bc9198be82e7d4316365f5aaddf67ef2067c8b WatchSource:0}: Error finding container d9248f8276c6d71964188e91f6bc9198be82e7d4316365f5aaddf67ef2067c8b: Status 404 returned error can't find the container with id d9248f8276c6d71964188e91f6bc9198be82e7d4316365f5aaddf67ef2067c8b
Jul 12 00:05:47.636860 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.636820    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecd2a74-54f0-4a13-8e56-c5c292f70418-tls-cert\") pod \"authorino-55766d6cf7-76grl\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") " pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.637093 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.636924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvq9f\" (UniqueName: \"kubernetes.io/projected/2ecd2a74-54f0-4a13-8e56-c5c292f70418-kube-api-access-pvq9f\") pod \"authorino-55766d6cf7-76grl\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") " pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.637093 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.636994    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp98\" (UniqueName: \"kubernetes.io/projected/67ee3275-025b-49f8-99f2-8eb5c99d6c3c-kube-api-access-zgp98\") pod \"authorino-dddd67977-26nj5\" (UID: \"67ee3275-025b-49f8-99f2-8eb5c99d6c3c\") " pod="kuadrant-system/authorino-dddd67977-26nj5"
Jul 12 00:05:47.645463 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.645425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgp98\" (UniqueName: \"kubernetes.io/projected/67ee3275-025b-49f8-99f2-8eb5c99d6c3c-kube-api-access-zgp98\") pod \"authorino-dddd67977-26nj5\" (UID: \"67ee3275-025b-49f8-99f2-8eb5c99d6c3c\") " pod="kuadrant-system/authorino-dddd67977-26nj5"
Jul 12 00:05:47.738369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.738254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecd2a74-54f0-4a13-8e56-c5c292f70418-tls-cert\") pod \"authorino-55766d6cf7-76grl\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") " pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.738369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.738342    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvq9f\" (UniqueName: \"kubernetes.io/projected/2ecd2a74-54f0-4a13-8e56-c5c292f70418-kube-api-access-pvq9f\") pod \"authorino-55766d6cf7-76grl\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") " pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.741052 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.740998    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecd2a74-54f0-4a13-8e56-c5c292f70418-tls-cert\") pod \"authorino-55766d6cf7-76grl\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") " pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.747088 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.747030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvq9f\" (UniqueName: \"kubernetes.io/projected/2ecd2a74-54f0-4a13-8e56-c5c292f70418-kube-api-access-pvq9f\") pod \"authorino-55766d6cf7-76grl\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") " pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.814645 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.814604    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c4db8" event={"ID":"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18","Type":"ContainerStarted","Data":"d9248f8276c6d71964188e91f6bc9198be82e7d4316365f5aaddf67ef2067c8b"}
Jul 12 00:05:47.814832 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.814648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dddd67977-26nj5"
Jul 12 00:05:47.823385 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.823349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dddd67977-26nj5"
Jul 12 00:05:47.839293 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.839246    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgp98\" (UniqueName: \"kubernetes.io/projected/67ee3275-025b-49f8-99f2-8eb5c99d6c3c-kube-api-access-zgp98\") pod \"67ee3275-025b-49f8-99f2-8eb5c99d6c3c\" (UID: \"67ee3275-025b-49f8-99f2-8eb5c99d6c3c\") "
Jul 12 00:05:47.841717 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.841683    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ee3275-025b-49f8-99f2-8eb5c99d6c3c-kube-api-access-zgp98" (OuterVolumeSpecName: "kube-api-access-zgp98") pod "67ee3275-025b-49f8-99f2-8eb5c99d6c3c" (UID: "67ee3275-025b-49f8-99f2-8eb5c99d6c3c"). InnerVolumeSpecName "kube-api-access-zgp98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:05:47.906709 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.906667    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:05:47.941205 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:47.941161    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgp98\" (UniqueName: \"kubernetes.io/projected/67ee3275-025b-49f8-99f2-8eb5c99d6c3c-kube-api-access-zgp98\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:48.068356 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.068311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55766d6cf7-76grl"]
Jul 12 00:05:48.071011 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:05:48.070934    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ecd2a74_54f0_4a13_8e56_c5c292f70418.slice/crio-03c013c1f0b7815c89670019b5a1cee24b8bcdac37fa9ed9371356b6f4bdc245 WatchSource:0}: Error finding container 03c013c1f0b7815c89670019b5a1cee24b8bcdac37fa9ed9371356b6f4bdc245: Status 404 returned error can't find the container with id 03c013c1f0b7815c89670019b5a1cee24b8bcdac37fa9ed9371356b6f4bdc245
Jul 12 00:05:48.821755 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.821714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c4db8" event={"ID":"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18","Type":"ContainerStarted","Data":"a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1"}
Jul 12 00:05:48.822258 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.821762    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-c4db8" podUID="c1e57b6a-bf27-4575-b10f-3cbe6ed68d18" containerName="authorino" containerID="cri-o://a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1" gracePeriod=30
Jul 12 00:05:48.823738 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.823704    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766d6cf7-76grl" event={"ID":"2ecd2a74-54f0-4a13-8e56-c5c292f70418","Type":"ContainerStarted","Data":"c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f"}
Jul 12 00:05:48.823891 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.823753    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766d6cf7-76grl" event={"ID":"2ecd2a74-54f0-4a13-8e56-c5c292f70418","Type":"ContainerStarted","Data":"03c013c1f0b7815c89670019b5a1cee24b8bcdac37fa9ed9371356b6f4bdc245"}
Jul 12 00:05:48.823891 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.823794    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dddd67977-26nj5"
Jul 12 00:05:48.836870 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.836806    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-c4db8" podStartSLOduration=1.510845714 podStartE2EDuration="1.836783852s" totalImagesPullingTime="325.938138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:48.835850073 +0000 UTC m=+536.638758959" watchObservedRunningTime="2026-07-12 00:05:48.836783852 +0000 UTC m=+536.639692752"
Jul 12 00:05:48.857777 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.857737    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dddd67977-26nj5"]
Jul 12 00:05:48.861117 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.861072    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-dddd67977-26nj5"]
Jul 12 00:05:48.873110 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.873020    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55766d6cf7-76grl" podStartSLOduration=1.532182275 podStartE2EDuration="1.872993979s" totalImagesPullingTime="340.811704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:48.871793166 +0000 UTC m=+536.674702055" watchObservedRunningTime="2026-07-12 00:05:48.872993979 +0000 UTC m=+536.675902868"
Jul 12 00:05:48.894871 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.894819    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6529h"]
Jul 12 00:05:48.895140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:48.895030    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6529h" podUID="379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee" containerName="authorino" containerID="cri-o://a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c" gracePeriod=30
Jul 12 00:05:49.178299 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.178267    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c4db8"
Jul 12 00:05:49.180449 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.180427    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6529h"
Jul 12 00:05:49.254602 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.254557    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8xsx\" (UniqueName: \"kubernetes.io/projected/379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee-kube-api-access-v8xsx\") pod \"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee\" (UID: \"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee\") "
Jul 12 00:05:49.254824 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.254635    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tckn9\" (UniqueName: \"kubernetes.io/projected/c1e57b6a-bf27-4575-b10f-3cbe6ed68d18-kube-api-access-tckn9\") pod \"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18\" (UID: \"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18\") "
Jul 12 00:05:49.256987 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.256950    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e57b6a-bf27-4575-b10f-3cbe6ed68d18-kube-api-access-tckn9" (OuterVolumeSpecName: "kube-api-access-tckn9") pod "c1e57b6a-bf27-4575-b10f-3cbe6ed68d18" (UID: "c1e57b6a-bf27-4575-b10f-3cbe6ed68d18"). InnerVolumeSpecName "kube-api-access-tckn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:05:49.257217 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.256998    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee-kube-api-access-v8xsx" (OuterVolumeSpecName: "kube-api-access-v8xsx") pod "379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee" (UID: "379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee"). InnerVolumeSpecName "kube-api-access-v8xsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:05:49.355666 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.355565    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tckn9\" (UniqueName: \"kubernetes.io/projected/c1e57b6a-bf27-4575-b10f-3cbe6ed68d18-kube-api-access-tckn9\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:49.355666 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.355596    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8xsx\" (UniqueName: \"kubernetes.io/projected/379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee-kube-api-access-v8xsx\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:05:49.830498 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.830458    2583 generic.go:356] "Generic (PLEG): container finished" podID="c1e57b6a-bf27-4575-b10f-3cbe6ed68d18" containerID="a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1" exitCode=0
Jul 12 00:05:49.831004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.830504    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c4db8"
Jul 12 00:05:49.831004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.830553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c4db8" event={"ID":"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18","Type":"ContainerDied","Data":"a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1"}
Jul 12 00:05:49.831004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.830603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c4db8" event={"ID":"c1e57b6a-bf27-4575-b10f-3cbe6ed68d18","Type":"ContainerDied","Data":"d9248f8276c6d71964188e91f6bc9198be82e7d4316365f5aaddf67ef2067c8b"}
Jul 12 00:05:49.831004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.830638    2583 scope.go:117] "RemoveContainer" containerID="a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1"
Jul 12 00:05:49.832243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.832079    2583 generic.go:356] "Generic (PLEG): container finished" podID="379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee" containerID="a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c" exitCode=0
Jul 12 00:05:49.832243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.832118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6529h" event={"ID":"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee","Type":"ContainerDied","Data":"a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c"}
Jul 12 00:05:49.832243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.832168    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6529h" event={"ID":"379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee","Type":"ContainerDied","Data":"b3706d79f1b359497e7da79b0b7dbda99e3d79bb21140bfe3b6956fb4ccac39b"}
Jul 12 00:05:49.832243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.832128    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6529h"
Jul 12 00:05:49.841021 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.840992    2583 scope.go:117] "RemoveContainer" containerID="a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1"
Jul 12 00:05:49.841409 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:05:49.841383    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1\": container with ID starting with a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1 not found: ID does not exist" containerID="a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1"
Jul 12 00:05:49.841473 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.841424    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1"} err="failed to get container status \"a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1\": rpc error: code = NotFound desc = could not find container \"a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1\": container with ID starting with a7f7e0baa59ea410f0f64e95a9b9947b6d15768ab96b1b873dc77a96af600ea1 not found: ID does not exist"
Jul 12 00:05:49.841473 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.841443    2583 scope.go:117] "RemoveContainer" containerID="a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c"
Jul 12 00:05:49.851047 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.851002    2583 scope.go:117] "RemoveContainer" containerID="a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c"
Jul 12 00:05:49.851396 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:05:49.851372    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c\": container with ID starting with a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c not found: ID does not exist" containerID="a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c"
Jul 12 00:05:49.851461 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.851408    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c"} err="failed to get container status \"a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c\": rpc error: code = NotFound desc = could not find container \"a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c\": container with ID starting with a287bb3c18c30df51dbc493c7ac5348a9eb356d9a91664ad491aa659d131a40c not found: ID does not exist"
Jul 12 00:05:49.856608 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.856577    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c4db8"]
Jul 12 00:05:49.858951 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.858920    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c4db8"]
Jul 12 00:05:49.868838 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.868801    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6529h"]
Jul 12 00:05:49.875312 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:49.875277    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6529h"]
Jul 12 00:05:50.788031 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:50.783925    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee" path="/var/lib/kubelet/pods/379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee/volumes"
Jul 12 00:05:50.788031 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:50.784497    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ee3275-025b-49f8-99f2-8eb5c99d6c3c" path="/var/lib/kubelet/pods/67ee3275-025b-49f8-99f2-8eb5c99d6c3c/volumes"
Jul 12 00:05:50.788031 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:50.784832    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e57b6a-bf27-4575-b10f-3cbe6ed68d18" path="/var/lib/kubelet/pods/c1e57b6a-bf27-4575-b10f-3cbe6ed68d18/volumes"
Jul 12 00:05:53.770202 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.770159    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc769888b-4c8vb"]
Jul 12 00:05:53.770650 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.770517    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e57b6a-bf27-4575-b10f-3cbe6ed68d18" containerName="authorino"
Jul 12 00:05:53.770650 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.770529    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e57b6a-bf27-4575-b10f-3cbe6ed68d18" containerName="authorino"
Jul 12 00:05:53.770650 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.770540    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee" containerName="authorino"
Jul 12 00:05:53.770650 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.770547    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee" containerName="authorino"
Jul 12 00:05:53.770650 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.770620    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e57b6a-bf27-4575-b10f-3cbe6ed68d18" containerName="authorino"
Jul 12 00:05:53.770650 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.770630    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="379fc1e6-fafa-4edb-ae62-c77e6b0cb2ee" containerName="authorino"
Jul 12 00:05:53.778251 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.778213    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:53.781028 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.780997    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 00:05:53.782099 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.782075    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 00:05:53.782371 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.782109    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7d756\""
Jul 12 00:05:53.783930 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.783902    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc769888b-4c8vb"]
Jul 12 00:05:53.795552 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.795485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert\") pod \"maas-controller-6bc769888b-4c8vb\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") " pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:53.795552 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.795550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh555\" (UniqueName: \"kubernetes.io/projected/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-kube-api-access-xh555\") pod \"maas-controller-6bc769888b-4c8vb\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") " pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:53.896839 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.896795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert\") pod \"maas-controller-6bc769888b-4c8vb\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") " pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:53.896839 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.896839    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh555\" (UniqueName: \"kubernetes.io/projected/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-kube-api-access-xh555\") pod \"maas-controller-6bc769888b-4c8vb\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") " pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:53.897182 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:05:53.896954    2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 12 00:05:53.897182 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:05:53.897080    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert podName:ec08e84a-9f36-46ff-8a70-8aead00a8d2e nodeName:}" failed. No retries permitted until 2026-07-12 00:05:54.39702219 +0000 UTC m=+542.199931057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert") pod "maas-controller-6bc769888b-4c8vb" (UID: "ec08e84a-9f36-46ff-8a70-8aead00a8d2e") : secret "maas-controller-webhook-cert" not found
Jul 12 00:05:53.908321 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:53.908284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh555\" (UniqueName: \"kubernetes.io/projected/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-kube-api-access-xh555\") pod \"maas-controller-6bc769888b-4c8vb\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") " pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:54.401757 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:54.401701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert\") pod \"maas-controller-6bc769888b-4c8vb\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") " pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:54.404417 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:54.404385    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert\") pod \"maas-controller-6bc769888b-4c8vb\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") " pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:54.692158 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:54.692105    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:54.846204 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:54.846168    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc769888b-4c8vb"]
Jul 12 00:05:54.848119 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:05:54.848088    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec08e84a_9f36_46ff_8a70_8aead00a8d2e.slice/crio-203058f2c57b0fd12f2b9a58c8f6c0f411de7afb77eb044ca2f9e59495ddbc0c WatchSource:0}: Error finding container 203058f2c57b0fd12f2b9a58c8f6c0f411de7afb77eb044ca2f9e59495ddbc0c: Status 404 returned error can't find the container with id 203058f2c57b0fd12f2b9a58c8f6c0f411de7afb77eb044ca2f9e59495ddbc0c
Jul 12 00:05:54.869426 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:54.869378    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc769888b-4c8vb" event={"ID":"ec08e84a-9f36-46ff-8a70-8aead00a8d2e","Type":"ContainerStarted","Data":"203058f2c57b0fd12f2b9a58c8f6c0f411de7afb77eb044ca2f9e59495ddbc0c"}
Jul 12 00:05:57.889510 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:57.889465    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc769888b-4c8vb" event={"ID":"ec08e84a-9f36-46ff-8a70-8aead00a8d2e","Type":"ContainerStarted","Data":"d7fe04397af2ebc6b0fd8d122cadaabf3e0d3181d7bf6d6314c8a163f19bad57"}
Jul 12 00:05:57.889930 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:57.889583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:05:57.906242 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:05:57.906185    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc769888b-4c8vb" podStartSLOduration=2.938445051 podStartE2EDuration="4.906164789s" totalImagesPullingTime="1.967719738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:57.90536233 +0000 UTC m=+545.708271232" watchObservedRunningTime="2026-07-12 00:05:57.906164789 +0000 UTC m=+545.709073791"
Jul 12 00:06:08.906461 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:08.906425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:06:29.733219 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:29.733173    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"]
Jul 12 00:06:29.740145 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:29.740111    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:29.742798 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:29.742766    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 12 00:06:29.743460 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:29.743432    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t2rdh\""
Jul 12 00:06:29.745414 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:29.745392    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"]
Jul 12 00:06:29.921639 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:29.921599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pqcrl\" (UID: \"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:29.921859 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:29.921734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8dz4\" (UniqueName: \"kubernetes.io/projected/1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2-kube-api-access-r8dz4\") pod \"payload-processing-f9b8d9b9b-pqcrl\" (UID: \"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:30.023240 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:30.023133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8dz4\" (UniqueName: \"kubernetes.io/projected/1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2-kube-api-access-r8dz4\") pod \"payload-processing-f9b8d9b9b-pqcrl\" (UID: \"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:30.023240 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:30.023213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pqcrl\" (UID: \"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:30.023928 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:30.023908    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pqcrl\" (UID: \"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:30.033507 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:30.033469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8dz4\" (UniqueName: \"kubernetes.io/projected/1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2-kube-api-access-r8dz4\") pod \"payload-processing-f9b8d9b9b-pqcrl\" (UID: \"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:30.053477 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:30.053426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:30.219561 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:30.219525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"]
Jul 12 00:06:30.222287 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:06:30.222257    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7d0cac_009d_4d2a_ac17_40d8c3a9b9c2.slice/crio-8b9e71fb5ab0567db03b51b51f5e33c1c5fc256adc0b23a8350bdb00b8659f63 WatchSource:0}: Error finding container 8b9e71fb5ab0567db03b51b51f5e33c1c5fc256adc0b23a8350bdb00b8659f63: Status 404 returned error can't find the container with id 8b9e71fb5ab0567db03b51b51f5e33c1c5fc256adc0b23a8350bdb00b8659f63
Jul 12 00:06:31.086651 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:31.086604    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl" event={"ID":"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2","Type":"ContainerStarted","Data":"8b9e71fb5ab0567db03b51b51f5e33c1c5fc256adc0b23a8350bdb00b8659f63"}
Jul 12 00:06:32.094808 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:32.094768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl" event={"ID":"1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2","Type":"ContainerStarted","Data":"eb345d4eb196369e6ebc34b55878bb8b787ff64da6bb9b1a24eb2e1041975bf5"}
Jul 12 00:06:32.095244 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:32.094944    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:32.111996 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:32.111936    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl" podStartSLOduration=1.784224737 podStartE2EDuration="3.111919015s" totalImagesPullingTime="1.327694278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:06:32.109568503 +0000 UTC m=+579.912477389" watchObservedRunningTime="2026-07-12 00:06:32.111919015 +0000 UTC m=+579.914827901"
Jul 12 00:06:43.103022 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:43.102987    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pqcrl"
Jul 12 00:06:53.085558 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:53.085429    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:06:53.098886 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:06:53.086228    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:07:11.321738 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.321682    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"]
Jul 12 00:07:11.326715 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.326675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.329535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.329507    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 00:07:11.330713 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.330683    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-czsp5\""
Jul 12 00:07:11.330874 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.330685    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 12 00:07:11.330874 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.330732    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 00:07:11.337122 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.337095    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"]
Jul 12 00:07:11.417576 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.417527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.417576 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.417578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.417823 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.417680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23433c76-7bcb-4b0c-ad10-246c570259fb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.417823 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.417720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.417823 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.417805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vgh2\" (UniqueName: \"kubernetes.io/projected/23433c76-7bcb-4b0c-ad10-246c570259fb-kube-api-access-9vgh2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.417927 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.417847    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519073 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.518991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519277 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vgh2\" (UniqueName: \"kubernetes.io/projected/23433c76-7bcb-4b0c-ad10-246c570259fb-kube-api-access-9vgh2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519277 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519277 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519277 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519277 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23433c76-7bcb-4b0c-ad10-246c570259fb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519568 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519631 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.519631 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.519601    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.521728 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.521697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23433c76-7bcb-4b0c-ad10-246c570259fb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.521999 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.521979    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23433c76-7bcb-4b0c-ad10-246c570259fb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.527271 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.527237    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vgh2\" (UniqueName: \"kubernetes.io/projected/23433c76-7bcb-4b0c-ad10-246c570259fb-kube-api-access-9vgh2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ffdlp\" (UID: \"23433c76-7bcb-4b0c-ad10-246c570259fb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.640605 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.640482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:11.793139 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.793094    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"]
Jul 12 00:07:11.797515 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:07:11.797483    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23433c76_7bcb_4b0c_ad10_246c570259fb.slice/crio-64c4802e8175b0326fee1c157b48757f1aa92537824ce1c70146feb11c66685c WatchSource:0}: Error finding container 64c4802e8175b0326fee1c157b48757f1aa92537824ce1c70146feb11c66685c: Status 404 returned error can't find the container with id 64c4802e8175b0326fee1c157b48757f1aa92537824ce1c70146feb11c66685c
Jul 12 00:07:11.799220 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:11.799189    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:07:12.335530 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:12.335478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp" event={"ID":"23433c76-7bcb-4b0c-ad10-246c570259fb","Type":"ContainerStarted","Data":"64c4802e8175b0326fee1c157b48757f1aa92537824ce1c70146feb11c66685c"}
Jul 12 00:07:14.350955 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:14.350847    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp" event={"ID":"23433c76-7bcb-4b0c-ad10-246c570259fb","Type":"ContainerStarted","Data":"dd0846684fa11e01b73b6a56341217aa16090eb927c1c3dbfadbb516c70d92cb"}
Jul 12 00:07:14.369584 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:14.369515    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp" podStartSLOduration=1.6919616830000002 podStartE2EDuration="3.369491538s" totalImagesPullingTime="1.677529855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:07:14.366875877 +0000 UTC m=+622.169784766" watchObservedRunningTime="2026-07-12 00:07:14.369491538 +0000 UTC m=+622.172400424"
Jul 12 00:07:21.640940 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:21.640887    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:21.641483 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:21.640963    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:21.654782 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:21.654746    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:22.411380 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:22.411342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ffdlp"
Jul 12 00:07:43.725273 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.725234    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"]
Jul 12 00:07:43.729061 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.729027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.731814 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.731783    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 12 00:07:43.738605 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.738562    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"]
Jul 12 00:07:43.816560 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.816516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.816756 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.816579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqvng\" (UniqueName: \"kubernetes.io/projected/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-kube-api-access-gqvng\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.816756 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.816623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.816756 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.816716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.816870 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.816788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.816870 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.816853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.918396 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918342    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.918593 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918408    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.918593 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.918706 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvng\" (UniqueName: \"kubernetes.io/projected/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-kube-api-access-gqvng\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.918706 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.918801 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.918918 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.919014 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.918990    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.919124 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.919110    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.921284 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.921256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.921448 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.921422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:43.926908 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:43.926878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqvng\" (UniqueName: \"kubernetes.io/projected/abdb4ed0-7376-4768-a5ae-fa9fa3986f7c-kube-api-access-gqvng\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj\" (UID: \"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:44.040272 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:44.040160    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:44.187899 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:44.187865    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"]
Jul 12 00:07:44.190196 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:07:44.190161    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabdb4ed0_7376_4768_a5ae_fa9fa3986f7c.slice/crio-d9e2094e38e4cfc9fd481012fe5c5e7184c32b52b9c3423058286039c3da5290 WatchSource:0}: Error finding container d9e2094e38e4cfc9fd481012fe5c5e7184c32b52b9c3423058286039c3da5290: Status 404 returned error can't find the container with id d9e2094e38e4cfc9fd481012fe5c5e7184c32b52b9c3423058286039c3da5290
Jul 12 00:07:44.529688 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:44.529641    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj" event={"ID":"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c","Type":"ContainerStarted","Data":"803cfe6b2ad7572c1713b32ccb0d8e2a11e1c74ab003ba34da1bbfe8ea9ddf92"}
Jul 12 00:07:44.529688 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:44.529690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj" event={"ID":"abdb4ed0-7376-4768-a5ae-fa9fa3986f7c","Type":"ContainerStarted","Data":"d9e2094e38e4cfc9fd481012fe5c5e7184c32b52b9c3423058286039c3da5290"}
Jul 12 00:07:44.546549 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:44.546486    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj" podStartSLOduration=1.361034213 podStartE2EDuration="1.546468677s" totalImagesPullingTime="185.434464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:07:44.545136413 +0000 UTC m=+652.348045300" watchObservedRunningTime="2026-07-12 00:07:44.546468677 +0000 UTC m=+652.349377628"
Jul 12 00:07:54.040892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:54.040845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:54.041378 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:54.040910    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:54.053996 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:54.053964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:07:54.602334 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:07:54.602300    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj"
Jul 12 00:09:04.876586 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:04.876538    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c9f9c8596-6hf28"]
Jul 12 00:09:04.880248 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:04.880224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:04.887142 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:04.887101    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c9f9c8596-6hf28"]
Jul 12 00:09:04.944291 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:04.944236    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rz5m\" (UniqueName: \"kubernetes.io/projected/a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e-kube-api-access-7rz5m\") pod \"authorino-7c9f9c8596-6hf28\" (UID: \"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e\") " pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:04.944485 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:04.944405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e-tls-cert\") pod \"authorino-7c9f9c8596-6hf28\" (UID: \"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e\") " pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:05.045538 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.045487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e-tls-cert\") pod \"authorino-7c9f9c8596-6hf28\" (UID: \"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e\") " pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:05.045538 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.045545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rz5m\" (UniqueName: \"kubernetes.io/projected/a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e-kube-api-access-7rz5m\") pod \"authorino-7c9f9c8596-6hf28\" (UID: \"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e\") " pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:05.048404 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.048360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e-tls-cert\") pod \"authorino-7c9f9c8596-6hf28\" (UID: \"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e\") " pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:05.054393 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.054364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rz5m\" (UniqueName: \"kubernetes.io/projected/a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e-kube-api-access-7rz5m\") pod \"authorino-7c9f9c8596-6hf28\" (UID: \"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e\") " pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:05.190995 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.190940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c9f9c8596-6hf28"
Jul 12 00:09:05.346273 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.346237    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c9f9c8596-6hf28"]
Jul 12 00:09:05.348858 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:09:05.348818    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda51ab4f6_edd8_42a3_ae2f_7a1d5d89287e.slice/crio-326943bcc635b3ae9591237f8453338d7aa4eaae782b4a9374bbb0f088cb9f5a WatchSource:0}: Error finding container 326943bcc635b3ae9591237f8453338d7aa4eaae782b4a9374bbb0f088cb9f5a: Status 404 returned error can't find the container with id 326943bcc635b3ae9591237f8453338d7aa4eaae782b4a9374bbb0f088cb9f5a
Jul 12 00:09:05.991664 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.991610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c9f9c8596-6hf28" event={"ID":"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e","Type":"ContainerStarted","Data":"b5f7af47e2281c2e6a11d9c2fd11381f8ce00a438c105a2592798b4326f8791e"}
Jul 12 00:09:05.991664 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:05.991663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c9f9c8596-6hf28" event={"ID":"a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e","Type":"ContainerStarted","Data":"326943bcc635b3ae9591237f8453338d7aa4eaae782b4a9374bbb0f088cb9f5a"}
Jul 12 00:09:06.008204 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.008136    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c9f9c8596-6hf28" podStartSLOduration=1.5389319559999999 podStartE2EDuration="2.008114528s" totalImagesPullingTime="469.182572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:09:06.006151017 +0000 UTC m=+733.809059904" watchObservedRunningTime="2026-07-12 00:09:06.008114528 +0000 UTC m=+733.811023415"
Jul 12 00:09:06.033751 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.033706    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55766d6cf7-76grl"]
Jul 12 00:09:06.034023 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.033969    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-55766d6cf7-76grl" podUID="2ecd2a74-54f0-4a13-8e56-c5c292f70418" containerName="authorino" containerID="cri-o://c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f" gracePeriod=30
Jul 12 00:09:06.321344 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.321309    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:09:06.361659 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.361541    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecd2a74-54f0-4a13-8e56-c5c292f70418-tls-cert\") pod \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") "
Jul 12 00:09:06.361659 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.361644    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvq9f\" (UniqueName: \"kubernetes.io/projected/2ecd2a74-54f0-4a13-8e56-c5c292f70418-kube-api-access-pvq9f\") pod \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\" (UID: \"2ecd2a74-54f0-4a13-8e56-c5c292f70418\") "
Jul 12 00:09:06.364458 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.364411    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ecd2a74-54f0-4a13-8e56-c5c292f70418-kube-api-access-pvq9f" (OuterVolumeSpecName: "kube-api-access-pvq9f") pod "2ecd2a74-54f0-4a13-8e56-c5c292f70418" (UID: "2ecd2a74-54f0-4a13-8e56-c5c292f70418"). InnerVolumeSpecName "kube-api-access-pvq9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:09:06.377983 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.377924    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ecd2a74-54f0-4a13-8e56-c5c292f70418-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2ecd2a74-54f0-4a13-8e56-c5c292f70418" (UID: "2ecd2a74-54f0-4a13-8e56-c5c292f70418"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:09:06.463451 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.463410    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecd2a74-54f0-4a13-8e56-c5c292f70418-tls-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:09:06.463451 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:06.463443    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvq9f\" (UniqueName: \"kubernetes.io/projected/2ecd2a74-54f0-4a13-8e56-c5c292f70418-kube-api-access-pvq9f\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:09:07.000384 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.000347    2583 generic.go:356] "Generic (PLEG): container finished" podID="2ecd2a74-54f0-4a13-8e56-c5c292f70418" containerID="c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f" exitCode=0
Jul 12 00:09:07.000927 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.000419    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766d6cf7-76grl"
Jul 12 00:09:07.000927 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.000439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766d6cf7-76grl" event={"ID":"2ecd2a74-54f0-4a13-8e56-c5c292f70418","Type":"ContainerDied","Data":"c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f"}
Jul 12 00:09:07.000927 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.000493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766d6cf7-76grl" event={"ID":"2ecd2a74-54f0-4a13-8e56-c5c292f70418","Type":"ContainerDied","Data":"03c013c1f0b7815c89670019b5a1cee24b8bcdac37fa9ed9371356b6f4bdc245"}
Jul 12 00:09:07.000927 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.000520    2583 scope.go:117] "RemoveContainer" containerID="c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f"
Jul 12 00:09:07.011391 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.011366    2583 scope.go:117] "RemoveContainer" containerID="c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f"
Jul 12 00:09:07.011828 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:09:07.011807    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f\": container with ID starting with c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f not found: ID does not exist" containerID="c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f"
Jul 12 00:09:07.011883 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.011840    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f"} err="failed to get container status \"c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f\": rpc error: code = NotFound desc = could not find container \"c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f\": container with ID starting with c5c0b2f4b63881ddcee15cc4b3b3984f3ea822a9fd1b23ed7a3f542721a6b02f not found: ID does not exist"
Jul 12 00:09:07.024611 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.024564    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55766d6cf7-76grl"]
Jul 12 00:09:07.028480 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:07.028430    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55766d6cf7-76grl"]
Jul 12 00:09:08.782670 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:09:08.782638    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ecd2a74-54f0-4a13-8e56-c5c292f70418" path="/var/lib/kubelet/pods/2ecd2a74-54f0-4a13-8e56-c5c292f70418/volumes"
Jul 12 00:10:26.220379 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.220276    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc769888b-4c8vb"]
Jul 12 00:10:26.220953 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.220541    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bc769888b-4c8vb" podUID="ec08e84a-9f36-46ff-8a70-8aead00a8d2e" containerName="manager" containerID="cri-o://d7fe04397af2ebc6b0fd8d122cadaabf3e0d3181d7bf6d6314c8a163f19bad57" gracePeriod=30
Jul 12 00:10:26.467362 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.467319    2583 generic.go:356] "Generic (PLEG): container finished" podID="ec08e84a-9f36-46ff-8a70-8aead00a8d2e" containerID="d7fe04397af2ebc6b0fd8d122cadaabf3e0d3181d7bf6d6314c8a163f19bad57" exitCode=0
Jul 12 00:10:26.467566 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.467389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc769888b-4c8vb" event={"ID":"ec08e84a-9f36-46ff-8a70-8aead00a8d2e","Type":"ContainerDied","Data":"d7fe04397af2ebc6b0fd8d122cadaabf3e0d3181d7bf6d6314c8a163f19bad57"}
Jul 12 00:10:26.488227 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.488193    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:10:26.600563 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.600520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert\") pod \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") "
Jul 12 00:10:26.600799 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.600614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh555\" (UniqueName: \"kubernetes.io/projected/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-kube-api-access-xh555\") pod \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\" (UID: \"ec08e84a-9f36-46ff-8a70-8aead00a8d2e\") "
Jul 12 00:10:26.603081 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.603018    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-kube-api-access-xh555" (OuterVolumeSpecName: "kube-api-access-xh555") pod "ec08e84a-9f36-46ff-8a70-8aead00a8d2e" (UID: "ec08e84a-9f36-46ff-8a70-8aead00a8d2e"). InnerVolumeSpecName "kube-api-access-xh555". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:10:26.603227 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.603103    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ec08e84a-9f36-46ff-8a70-8aead00a8d2e" (UID: "ec08e84a-9f36-46ff-8a70-8aead00a8d2e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:10:26.701802 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.701759    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh555\" (UniqueName: \"kubernetes.io/projected/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-kube-api-access-xh555\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:10:26.701802 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:26.701799    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec08e84a-9f36-46ff-8a70-8aead00a8d2e-webhook-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:10:27.474938 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:27.474905    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc769888b-4c8vb"
Jul 12 00:10:27.475413 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:27.474941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc769888b-4c8vb" event={"ID":"ec08e84a-9f36-46ff-8a70-8aead00a8d2e","Type":"ContainerDied","Data":"203058f2c57b0fd12f2b9a58c8f6c0f411de7afb77eb044ca2f9e59495ddbc0c"}
Jul 12 00:10:27.475413 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:27.475007    2583 scope.go:117] "RemoveContainer" containerID="d7fe04397af2ebc6b0fd8d122cadaabf3e0d3181d7bf6d6314c8a163f19bad57"
Jul 12 00:10:27.493785 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:27.493736    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc769888b-4c8vb"]
Jul 12 00:10:27.496056 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:27.496016    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bc769888b-4c8vb"]
Jul 12 00:10:28.293179 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.293130    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc769888b-rdxbg"]
Jul 12 00:10:28.293572 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.293558    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ecd2a74-54f0-4a13-8e56-c5c292f70418" containerName="authorino"
Jul 12 00:10:28.293618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.293572    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ecd2a74-54f0-4a13-8e56-c5c292f70418" containerName="authorino"
Jul 12 00:10:28.293618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.293585    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec08e84a-9f36-46ff-8a70-8aead00a8d2e" containerName="manager"
Jul 12 00:10:28.293618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.293591    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec08e84a-9f36-46ff-8a70-8aead00a8d2e" containerName="manager"
Jul 12 00:10:28.293717 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.293665    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ecd2a74-54f0-4a13-8e56-c5c292f70418" containerName="authorino"
Jul 12 00:10:28.293717 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.293672    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec08e84a-9f36-46ff-8a70-8aead00a8d2e" containerName="manager"
Jul 12 00:10:28.298358 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.298330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.301954 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.301923    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 00:10:28.301954 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.301923    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7d756\""
Jul 12 00:10:28.302241 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.302004    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 00:10:28.304723 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.304692    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc769888b-rdxbg"]
Jul 12 00:10:28.420585 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.420540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj5t5\" (UniqueName: \"kubernetes.io/projected/6b453020-3a2c-4841-9a9b-035201ff09bb-kube-api-access-sj5t5\") pod \"maas-controller-6bc769888b-rdxbg\" (UID: \"6b453020-3a2c-4841-9a9b-035201ff09bb\") " pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.420794 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.420621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b453020-3a2c-4841-9a9b-035201ff09bb-webhook-cert\") pod \"maas-controller-6bc769888b-rdxbg\" (UID: \"6b453020-3a2c-4841-9a9b-035201ff09bb\") " pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.521948 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.521902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj5t5\" (UniqueName: \"kubernetes.io/projected/6b453020-3a2c-4841-9a9b-035201ff09bb-kube-api-access-sj5t5\") pod \"maas-controller-6bc769888b-rdxbg\" (UID: \"6b453020-3a2c-4841-9a9b-035201ff09bb\") " pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.522509 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.521981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b453020-3a2c-4841-9a9b-035201ff09bb-webhook-cert\") pod \"maas-controller-6bc769888b-rdxbg\" (UID: \"6b453020-3a2c-4841-9a9b-035201ff09bb\") " pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.524935 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.524904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b453020-3a2c-4841-9a9b-035201ff09bb-webhook-cert\") pod \"maas-controller-6bc769888b-rdxbg\" (UID: \"6b453020-3a2c-4841-9a9b-035201ff09bb\") " pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.530028 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.529997    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj5t5\" (UniqueName: \"kubernetes.io/projected/6b453020-3a2c-4841-9a9b-035201ff09bb-kube-api-access-sj5t5\") pod \"maas-controller-6bc769888b-rdxbg\" (UID: \"6b453020-3a2c-4841-9a9b-035201ff09bb\") " pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.612314 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.612187    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:28.767808 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.767774    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc769888b-rdxbg"]
Jul 12 00:10:28.769852 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:10:28.769814    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b453020_3a2c_4841_9a9b_035201ff09bb.slice/crio-f20a05246d6db6409bd79a9bb28cfacbb5bbc0bf91bb1e093d146759c1ccb0eb WatchSource:0}: Error finding container f20a05246d6db6409bd79a9bb28cfacbb5bbc0bf91bb1e093d146759c1ccb0eb: Status 404 returned error can't find the container with id f20a05246d6db6409bd79a9bb28cfacbb5bbc0bf91bb1e093d146759c1ccb0eb
Jul 12 00:10:28.782731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:28.782695    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec08e84a-9f36-46ff-8a70-8aead00a8d2e" path="/var/lib/kubelet/pods/ec08e84a-9f36-46ff-8a70-8aead00a8d2e/volumes"
Jul 12 00:10:29.488814 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:29.488783    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc769888b-rdxbg" event={"ID":"6b453020-3a2c-4841-9a9b-035201ff09bb","Type":"ContainerStarted","Data":"f20a05246d6db6409bd79a9bb28cfacbb5bbc0bf91bb1e093d146759c1ccb0eb"}
Jul 12 00:10:30.496517 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:30.496476    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc769888b-rdxbg" event={"ID":"6b453020-3a2c-4841-9a9b-035201ff09bb","Type":"ContainerStarted","Data":"371c782fd54446837e915b86689bcc361b7f8c9619b920f2c9765a99bdec295a"}
Jul 12 00:10:30.497110 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:30.496627    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:10:30.530974 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:30.530914    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc769888b-rdxbg" podStartSLOduration=1.819909422 podStartE2EDuration="2.530892961s" totalImagesPullingTime="710.983539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:10:30.529465544 +0000 UTC m=+818.332374431" watchObservedRunningTime="2026-07-12 00:10:30.530892961 +0000 UTC m=+818.333801847"
Jul 12 00:10:41.504843 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:10:41.504811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc769888b-rdxbg"
Jul 12 00:11:53.121768 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:11:53.121644    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:11:53.127070 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:11:53.125030    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:16:53.157026 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:16:53.156993    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:16:53.162188 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:16:53.162162    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:21:53.192509 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:21:53.192364    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:21:53.199120 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:21:53.199093    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:26:53.228087 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:26:53.227941    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:26:53.237289 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:26:53.237259    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:30:00.131722 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.131668    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz"]
Jul 12 00:30:00.135602 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.135577    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"]
Jul 12 00:30:00.135750 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.135720    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz"
Jul 12 00:30:00.138617 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.138583    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:30:00.139708 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.139673    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"
Jul 12 00:30:00.141509 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.141474    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz"]
Jul 12 00:30:00.145271 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.145162    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"]
Jul 12 00:30:00.151342 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.151310    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz"
Jul 12 00:30:00.161784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.161758    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"
Jul 12 00:30:00.323998 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.323961    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz"]
Jul 12 00:30:00.325968 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:30:00.325917    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a1d278_524e_487d_b547_cc82dbd94a14.slice/crio-c9bec6248b5368f2357bebe808d31025d66cdc9d2420b3d75353421fa407e342 WatchSource:0}: Error finding container c9bec6248b5368f2357bebe808d31025d66cdc9d2420b3d75353421fa407e342: Status 404 returned error can't find the container with id c9bec6248b5368f2357bebe808d31025d66cdc9d2420b3d75353421fa407e342
Jul 12 00:30:00.328530 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.328493    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:30:00.348318 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:00.348288    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"]
Jul 12 00:30:00.349685 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:30:00.349654    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8078a6_093c_44ed_ae83_ec5d825c7045.slice/crio-10f60bd6dcf5930d3f44d7749eeee6ce12b65bf7929d6de50d84ec9d66e57871 WatchSource:0}: Error finding container 10f60bd6dcf5930d3f44d7749eeee6ce12b65bf7929d6de50d84ec9d66e57871: Status 404 returned error can't find the container with id 10f60bd6dcf5930d3f44d7749eeee6ce12b65bf7929d6de50d84ec9d66e57871
Jul 12 00:30:01.276943 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:01.276901    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b" event={"ID":"eb8078a6-093c-44ed-ae83-ec5d825c7045","Type":"ContainerStarted","Data":"10f60bd6dcf5930d3f44d7749eeee6ce12b65bf7929d6de50d84ec9d66e57871"}
Jul 12 00:30:01.278197 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:01.278165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz" event={"ID":"59a1d278-524e-487d-b547-cc82dbd94a14","Type":"ContainerStarted","Data":"c9bec6248b5368f2357bebe808d31025d66cdc9d2420b3d75353421fa407e342"}
Jul 12 00:30:04.300078 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:04.300013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b" event={"ID":"eb8078a6-093c-44ed-ae83-ec5d825c7045","Type":"ContainerStarted","Data":"19b6fbda562e1434c6c273bfa26caca5fbaba1a683dc2b6a2dd44b921c9920bb"}
Jul 12 00:30:04.301739 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:04.301705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz" event={"ID":"59a1d278-524e-487d-b547-cc82dbd94a14","Type":"ContainerStarted","Data":"c25d64e028c2d8960634d727c7a5781dd9b2f9685d2de2ed703d9ab6fc641350"}
Jul 12 00:30:04.317024 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:04.316417    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b" podStartSLOduration=1.189289968 podStartE2EDuration="4.316395303s" totalImagesPullingTime="3.127105335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:30:04.314234512 +0000 UTC m=+1992.117143400" watchObservedRunningTime="2026-07-12 00:30:04.316395303 +0000 UTC m=+1992.119304190"
Jul 12 00:30:04.330585 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:04.330511    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz" podStartSLOduration=1.184913003 podStartE2EDuration="4.33048514s" totalImagesPullingTime="3.145572137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:30:04.330064843 +0000 UTC m=+1992.132973730" watchObservedRunningTime="2026-07-12 00:30:04.33048514 +0000 UTC m=+1992.133394028"
Jul 12 00:30:05.309668 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:05.309624    2583 generic.go:356] "Generic (PLEG): container finished" podID="eb8078a6-093c-44ed-ae83-ec5d825c7045" containerID="19b6fbda562e1434c6c273bfa26caca5fbaba1a683dc2b6a2dd44b921c9920bb" exitCode=0
Jul 12 00:30:05.310188 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:05.309720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b" event={"ID":"eb8078a6-093c-44ed-ae83-ec5d825c7045","Type":"ContainerDied","Data":"19b6fbda562e1434c6c273bfa26caca5fbaba1a683dc2b6a2dd44b921c9920bb"}
Jul 12 00:30:05.311467 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:05.311435    2583 generic.go:356] "Generic (PLEG): container finished" podID="59a1d278-524e-487d-b547-cc82dbd94a14" containerID="c25d64e028c2d8960634d727c7a5781dd9b2f9685d2de2ed703d9ab6fc641350" exitCode=0
Jul 12 00:30:05.311617 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:05.311506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz" event={"ID":"59a1d278-524e-487d-b547-cc82dbd94a14","Type":"ContainerDied","Data":"c25d64e028c2d8960634d727c7a5781dd9b2f9685d2de2ed703d9ab6fc641350"}
Jul 12 00:30:06.482314 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:06.482287    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"
Jul 12 00:30:06.506310 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:06.506274    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz"
Jul 12 00:30:07.323686 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:07.323656    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"
Jul 12 00:30:07.323892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:07.323661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b" event={"ID":"eb8078a6-093c-44ed-ae83-ec5d825c7045","Type":"ContainerDied","Data":"10f60bd6dcf5930d3f44d7749eeee6ce12b65bf7929d6de50d84ec9d66e57871"}
Jul 12 00:30:07.323892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:07.323791    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10f60bd6dcf5930d3f44d7749eeee6ce12b65bf7929d6de50d84ec9d66e57871"
Jul 12 00:30:07.325285 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:07.325251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz" event={"ID":"59a1d278-524e-487d-b547-cc82dbd94a14","Type":"ContainerDied","Data":"c9bec6248b5368f2357bebe808d31025d66cdc9d2420b3d75353421fa407e342"}
Jul 12 00:30:07.325461 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:07.325309    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9bec6248b5368f2357bebe808d31025d66cdc9d2420b3d75353421fa407e342"
Jul 12 00:30:07.325461 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:07.325266    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730270-whkwz"
Jul 12 00:30:16.495365 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:16.495329    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"]
Jul 12 00:30:16.497801 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:16.497770    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-061e4a12-29730270-j9m7b"]
Jul 12 00:30:16.782649 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:30:16.782556    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8078a6-093c-44ed-ae83-ec5d825c7045" path="/var/lib/kubelet/pods/eb8078a6-093c-44ed-ae83-ec5d825c7045/volumes"
Jul 12 00:31:01.428808 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.428757    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"]
Jul 12 00:31:01.429422 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.429389    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8078a6-093c-44ed-ae83-ec5d825c7045" containerName="cleanup"
Jul 12 00:31:01.429422 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.429412    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8078a6-093c-44ed-ae83-ec5d825c7045" containerName="cleanup"
Jul 12 00:31:01.429546 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.429448    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a1d278-524e-487d-b547-cc82dbd94a14" containerName="cleanup"
Jul 12 00:31:01.429546 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.429457    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a1d278-524e-487d-b547-cc82dbd94a14" containerName="cleanup"
Jul 12 00:31:01.429641 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.429561    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="59a1d278-524e-487d-b547-cc82dbd94a14" containerName="cleanup"
Jul 12 00:31:01.429641 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.429577    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8078a6-093c-44ed-ae83-ec5d825c7045" containerName="cleanup"
Jul 12 00:31:01.432979 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.432952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.436913 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.436878    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-68596461\"/\"default-dockercfg-fn8xr\""
Jul 12 00:31:01.437099 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.436879    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-68596461\"/\"kube-root-ca.crt\""
Jul 12 00:31:01.437099 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.436886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-68596461\"/\"e2e-lifecycle-model-68596461-kserve-self-signed-certs\""
Jul 12 00:31:01.437099 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.436891    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-68596461\"/\"openshift-service-ca.crt\""
Jul 12 00:31:01.442924 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.442888    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"]
Jul 12 00:31:01.531990 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.531876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tmp-dir\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.531990 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.531928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-model-cache\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.531990 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.531989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tls-certs\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.532258 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.532022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-home\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.532258 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.532088    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2hrb\" (UniqueName: \"kubernetes.io/projected/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-kube-api-access-b2hrb\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.532258 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.532128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-dshm\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.633618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.633582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-dshm\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.633841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.633642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tmp-dir\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.633841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.633666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-model-cache\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.633841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.633700    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tls-certs\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.633841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.633725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-home\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.633841 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.633745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hrb\" (UniqueName: \"kubernetes.io/projected/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-kube-api-access-b2hrb\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.634204 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.634168    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-model-cache\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.634336 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.634179    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tmp-dir\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.634336 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.634259    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-home\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.636783 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.636750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-dshm\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.637006 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.636990    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tls-certs\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.643431 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.643395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2hrb\" (UniqueName: \"kubernetes.io/projected/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-kube-api-access-b2hrb\") pod \"e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") " pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.745205 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.745159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:01.903784 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:01.903752    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"]
Jul 12 00:31:01.906029 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:31:01.905996    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93df52a4_91a1_4a6f_840f_efa18d5a9aaf.slice/crio-8fac2bade89fba08ce8c196a6f3ea18bf9d8afdf25ea0f8dfc2da94cd7b3d1f6 WatchSource:0}: Error finding container 8fac2bade89fba08ce8c196a6f3ea18bf9d8afdf25ea0f8dfc2da94cd7b3d1f6: Status 404 returned error can't find the container with id 8fac2bade89fba08ce8c196a6f3ea18bf9d8afdf25ea0f8dfc2da94cd7b3d1f6
Jul 12 00:31:02.645892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:02.645838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq" event={"ID":"93df52a4-91a1-4a6f-840f-efa18d5a9aaf","Type":"ContainerStarted","Data":"b2d4e79c034e0c6fa5c939cfb6dab8a05a8f89aab2271af7175ac15bc599870c"}
Jul 12 00:31:02.646412 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:02.645899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq" event={"ID":"93df52a4-91a1-4a6f-840f-efa18d5a9aaf","Type":"ContainerStarted","Data":"8fac2bade89fba08ce8c196a6f3ea18bf9d8afdf25ea0f8dfc2da94cd7b3d1f6"}
Jul 12 00:31:02.663865 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:02.663790    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq" podStartSLOduration=1.663765771 podStartE2EDuration="1.663765771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:31:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:31:02.660895418 +0000 UTC m=+2050.463804316" watchObservedRunningTime="2026-07-12 00:31:02.663765771 +0000 UTC m=+2050.466674659"
Jul 12 00:31:11.745645 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:11.745590    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:11.746277 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:11.745734    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:11.759148 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:11.759112    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:12.718425 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:12.718391    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:42.744924 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:42.744833    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"]
Jul 12 00:31:53.265716 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:53.265599    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:31:53.283737 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:53.283711    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:31:57.767094 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:57.766997    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq" podUID="93df52a4-91a1-4a6f-840f-efa18d5a9aaf" containerName="main" containerID="cri-o://b2d4e79c034e0c6fa5c939cfb6dab8a05a8f89aab2271af7175ac15bc599870c" gracePeriod=45
Jul 12 00:31:57.971481 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:57.971436    2583 generic.go:356] "Generic (PLEG): container finished" podID="93df52a4-91a1-4a6f-840f-efa18d5a9aaf" containerID="b2d4e79c034e0c6fa5c939cfb6dab8a05a8f89aab2271af7175ac15bc599870c" exitCode=0
Jul 12 00:31:57.971681 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:57.971514    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq" event={"ID":"93df52a4-91a1-4a6f-840f-efa18d5a9aaf","Type":"ContainerDied","Data":"b2d4e79c034e0c6fa5c939cfb6dab8a05a8f89aab2271af7175ac15bc599870c"}
Jul 12 00:31:58.030777 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.030705    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:58.053381 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.053339    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2hrb\" (UniqueName: \"kubernetes.io/projected/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-kube-api-access-b2hrb\") pod \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") "
Jul 12 00:31:58.054343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.053394    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tls-certs\") pod \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") "
Jul 12 00:31:58.054343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.053460    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-dshm\") pod \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") "
Jul 12 00:31:58.054343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.053528    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-model-cache\") pod \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") "
Jul 12 00:31:58.054343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.053564    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-home\") pod \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") "
Jul 12 00:31:58.054343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.053600    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tmp-dir\") pod \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\" (UID: \"93df52a4-91a1-4a6f-840f-efa18d5a9aaf\") "
Jul 12 00:31:58.054343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.054148    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-model-cache" (OuterVolumeSpecName: "model-cache") pod "93df52a4-91a1-4a6f-840f-efa18d5a9aaf" (UID: "93df52a4-91a1-4a6f-840f-efa18d5a9aaf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:31:58.054343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.054156    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93df52a4-91a1-4a6f-840f-efa18d5a9aaf" (UID: "93df52a4-91a1-4a6f-840f-efa18d5a9aaf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:31:58.054813 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.054375    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-home" (OuterVolumeSpecName: "home") pod "93df52a4-91a1-4a6f-840f-efa18d5a9aaf" (UID: "93df52a4-91a1-4a6f-840f-efa18d5a9aaf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:31:58.056630 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.056596    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-dshm" (OuterVolumeSpecName: "dshm") pod "93df52a4-91a1-4a6f-840f-efa18d5a9aaf" (UID: "93df52a4-91a1-4a6f-840f-efa18d5a9aaf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:31:58.057152 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.057125    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93df52a4-91a1-4a6f-840f-efa18d5a9aaf" (UID: "93df52a4-91a1-4a6f-840f-efa18d5a9aaf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:31:58.057280 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.057145    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-kube-api-access-b2hrb" (OuterVolumeSpecName: "kube-api-access-b2hrb") pod "93df52a4-91a1-4a6f-840f-efa18d5a9aaf" (UID: "93df52a4-91a1-4a6f-840f-efa18d5a9aaf"). InnerVolumeSpecName "kube-api-access-b2hrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:31:58.154413 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.154373    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:31:58.154413 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.154406    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:31:58.154413 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.154417    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:31:58.154670 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.154428    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:31:58.154670 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.154436    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2hrb\" (UniqueName: \"kubernetes.io/projected/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-kube-api-access-b2hrb\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:31:58.154670 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.154445    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93df52a4-91a1-4a6f-840f-efa18d5a9aaf-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:31:58.978807 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.978769    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"
Jul 12 00:31:58.978807 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.978781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq" event={"ID":"93df52a4-91a1-4a6f-840f-efa18d5a9aaf","Type":"ContainerDied","Data":"8fac2bade89fba08ce8c196a6f3ea18bf9d8afdf25ea0f8dfc2da94cd7b3d1f6"}
Jul 12 00:31:58.979394 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.978836    2583 scope.go:117] "RemoveContainer" containerID="b2d4e79c034e0c6fa5c939cfb6dab8a05a8f89aab2271af7175ac15bc599870c"
Jul 12 00:31:58.995179 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.995147    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"]
Jul 12 00:31:58.999116 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:31:58.999085    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-68596461/e2e-lifecycle-model-68596461-kserve-6dbbf9f7b7-z2qmq"]
Jul 12 00:32:00.781994 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:32:00.781950    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93df52a4-91a1-4a6f-840f-efa18d5a9aaf" path="/var/lib/kubelet/pods/93df52a4-91a1-4a6f-840f-efa18d5a9aaf/volumes"
Jul 12 00:33:59.639540 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.639499    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"]
Jul 12 00:33:59.640090 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.639923    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93df52a4-91a1-4a6f-840f-efa18d5a9aaf" containerName="main"
Jul 12 00:33:59.640090 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.639935    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="93df52a4-91a1-4a6f-840f-efa18d5a9aaf" containerName="main"
Jul 12 00:33:59.640090 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.640003    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="93df52a4-91a1-4a6f-840f-efa18d5a9aaf" containerName="main"
Jul 12 00:33:59.643150 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.643125    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.646930 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.646873    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e82014\"/\"default-dockercfg-24b7f\""
Jul 12 00:33:59.647149 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.646932    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e82014\"/\"test-model-e82014-kserve-self-signed-certs\""
Jul 12 00:33:59.647149 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.646929    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e82014\"/\"openshift-service-ca.crt\""
Jul 12 00:33:59.647287 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.647197    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e82014\"/\"kube-root-ca.crt\""
Jul 12 00:33:59.650670 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.650642    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"]
Jul 12 00:33:59.783875 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.783826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-model-cache\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.783875 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.783872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e33733-4f08-4307-8611-587825ba48b5-tls-certs\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.784151 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.783949    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4vvl\" (UniqueName: \"kubernetes.io/projected/13e33733-4f08-4307-8611-587825ba48b5-kube-api-access-c4vvl\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.784151 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.783996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-tmp-dir\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.784151 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.784066    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-dshm\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.784151 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.784094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-home\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885366 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4vvl\" (UniqueName: \"kubernetes.io/projected/13e33733-4f08-4307-8611-587825ba48b5-kube-api-access-c4vvl\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885559 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-tmp-dir\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885559 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-dshm\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885559 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-home\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-model-cache\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e33733-4f08-4307-8611-587825ba48b5-tls-certs\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885843 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885813    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-tmp-dir\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.885979 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885954    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-model-cache\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.886071 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.885960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-home\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.887889 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.887851    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-dshm\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.888178 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.888159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e33733-4f08-4307-8611-587825ba48b5-tls-certs\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.893592 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.893509    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4vvl\" (UniqueName: \"kubernetes.io/projected/13e33733-4f08-4307-8611-587825ba48b5-kube-api-access-c4vvl\") pod \"test-model-e82014-kserve-7bd684799c-swpdj\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") " pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:33:59.954946 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:33:59.954886    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:34:00.106203 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:00.106147    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"]
Jul 12 00:34:00.109386 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:34:00.109353    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13e33733_4f08_4307_8611_587825ba48b5.slice/crio-72bc7a3704a0ab7e4766c6a66c0a5f17608d6fa3e0a92bae4b12afef93c080c2 WatchSource:0}: Error finding container 72bc7a3704a0ab7e4766c6a66c0a5f17608d6fa3e0a92bae4b12afef93c080c2: Status 404 returned error can't find the container with id 72bc7a3704a0ab7e4766c6a66c0a5f17608d6fa3e0a92bae4b12afef93c080c2
Jul 12 00:34:00.687004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:00.686956    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj" event={"ID":"13e33733-4f08-4307-8611-587825ba48b5","Type":"ContainerStarted","Data":"6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04"}
Jul 12 00:34:00.687004 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:00.687005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj" event={"ID":"13e33733-4f08-4307-8611-587825ba48b5","Type":"ContainerStarted","Data":"72bc7a3704a0ab7e4766c6a66c0a5f17608d6fa3e0a92bae4b12afef93c080c2"}
Jul 12 00:34:00.705339 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:00.705272    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj" podStartSLOduration=1.705248486 podStartE2EDuration="1.705248486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:34:00.702351205 +0000 UTC m=+2228.505260116" watchObservedRunningTime="2026-07-12 00:34:00.705248486 +0000 UTC m=+2228.508157436"
Jul 12 00:34:09.955213 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:09.955163    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:34:09.955644 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:09.955443    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:34:09.968522 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:09.968489    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:34:10.762491 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:10.762456    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:34:14.827586 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.827492    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"]
Jul 12 00:34:14.831297 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.831265    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:14.833922 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.833884    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-25afa8\"/\"openshift-service-ca.crt\""
Jul 12 00:34:14.835380 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.835298    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-25afa8\"/\"kube-root-ca.crt\""
Jul 12 00:34:14.835636 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.835306    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-25afa8\"/\"test-model-25afa8-kserve-self-signed-certs\""
Jul 12 00:34:14.835636 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.835453    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-25afa8\"/\"default-dockercfg-2ntbg\""
Jul 12 00:34:14.841543 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.841511    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"]
Jul 12 00:34:14.937631 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.937575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-model-cache\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:14.937866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.937647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-tmp-dir\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:14.937866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.937677    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-dshm\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:14.937866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.937789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-home\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:14.937866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.937830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6gx\" (UniqueName: \"kubernetes.io/projected/cb954fcb-731a-4f31-94d9-74a1d976f425-kube-api-access-vc6gx\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:14.938075 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:14.937873    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb954fcb-731a-4f31-94d9-74a1d976f425-tls-certs\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039380 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-tmp-dir\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039380 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-dshm\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-home\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6gx\" (UniqueName: \"kubernetes.io/projected/cb954fcb-731a-4f31-94d9-74a1d976f425-kube-api-access-vc6gx\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb954fcb-731a-4f31-94d9-74a1d976f425-tls-certs\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-model-cache\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039931 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-home\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.039931 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-tmp-dir\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.040022 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.039957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-model-cache\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.042127 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.042091    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-dshm\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.042424 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.042402    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb954fcb-731a-4f31-94d9-74a1d976f425-tls-certs\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.047978 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.047939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6gx\" (UniqueName: \"kubernetes.io/projected/cb954fcb-731a-4f31-94d9-74a1d976f425-kube-api-access-vc6gx\") pod \"test-model-25afa8-kserve-566c977cb7-8qcn6\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") " pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.144016 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.143912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:15.298495 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.298456    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"]
Jul 12 00:34:15.300619 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:34:15.300574    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb954fcb_731a_4f31_94d9_74a1d976f425.slice/crio-5e8176da450d7d0e0231f1e3c88bcc99a6a2bca098f7f8412c1c7dbe00d912fa WatchSource:0}: Error finding container 5e8176da450d7d0e0231f1e3c88bcc99a6a2bca098f7f8412c1c7dbe00d912fa: Status 404 returned error can't find the container with id 5e8176da450d7d0e0231f1e3c88bcc99a6a2bca098f7f8412c1c7dbe00d912fa
Jul 12 00:34:15.783642 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.783599    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6" event={"ID":"cb954fcb-731a-4f31-94d9-74a1d976f425","Type":"ContainerStarted","Data":"2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a"}
Jul 12 00:34:15.783838 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.783653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6" event={"ID":"cb954fcb-731a-4f31-94d9-74a1d976f425","Type":"ContainerStarted","Data":"5e8176da450d7d0e0231f1e3c88bcc99a6a2bca098f7f8412c1c7dbe00d912fa"}
Jul 12 00:34:15.802696 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:15.802627    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6" podStartSLOduration=1.8026093840000001 podStartE2EDuration="1.802609384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:34:15.799777763 +0000 UTC m=+2243.602686649" watchObservedRunningTime="2026-07-12 00:34:15.802609384 +0000 UTC m=+2243.605518297"
Jul 12 00:34:25.145140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:25.145091    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:25.145140 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:25.145149    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:25.158345 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:25.158310    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:25.859617 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:25.859579    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:33.120118 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:33.120059    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"]
Jul 12 00:34:34.004323 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:34.004277    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"]
Jul 12 00:34:48.142483 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.142435    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj" podUID="13e33733-4f08-4307-8611-587825ba48b5" containerName="main" containerID="cri-o://6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04" gracePeriod=45
Jul 12 00:34:48.412528 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.412491    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:34:48.530817 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.530769    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e33733-4f08-4307-8611-587825ba48b5-tls-certs\") pod \"13e33733-4f08-4307-8611-587825ba48b5\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") "
Jul 12 00:34:48.531073 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.530841    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-tmp-dir\") pod \"13e33733-4f08-4307-8611-587825ba48b5\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") "
Jul 12 00:34:48.531073 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.530874    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-model-cache\") pod \"13e33733-4f08-4307-8611-587825ba48b5\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") "
Jul 12 00:34:48.531073 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531006    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-home\") pod \"13e33733-4f08-4307-8611-587825ba48b5\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") "
Jul 12 00:34:48.531268 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531107    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-dshm\") pod \"13e33733-4f08-4307-8611-587825ba48b5\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") "
Jul 12 00:34:48.531268 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531142    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4vvl\" (UniqueName: \"kubernetes.io/projected/13e33733-4f08-4307-8611-587825ba48b5-kube-api-access-c4vvl\") pod \"13e33733-4f08-4307-8611-587825ba48b5\" (UID: \"13e33733-4f08-4307-8611-587825ba48b5\") "
Jul 12 00:34:48.531268 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531168    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "13e33733-4f08-4307-8611-587825ba48b5" (UID: "13e33733-4f08-4307-8611-587825ba48b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:48.531268 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531188    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "13e33733-4f08-4307-8611-587825ba48b5" (UID: "13e33733-4f08-4307-8611-587825ba48b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:48.531440 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531349    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-home" (OuterVolumeSpecName: "home") pod "13e33733-4f08-4307-8611-587825ba48b5" (UID: "13e33733-4f08-4307-8611-587825ba48b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:48.531530 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531512    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:48.531589 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531532    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:48.531589 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.531543    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:48.533441 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.533409    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e33733-4f08-4307-8611-587825ba48b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "13e33733-4f08-4307-8611-587825ba48b5" (UID: "13e33733-4f08-4307-8611-587825ba48b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:34:48.533441 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.533429    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e33733-4f08-4307-8611-587825ba48b5-kube-api-access-c4vvl" (OuterVolumeSpecName: "kube-api-access-c4vvl") pod "13e33733-4f08-4307-8611-587825ba48b5" (UID: "13e33733-4f08-4307-8611-587825ba48b5"). InnerVolumeSpecName "kube-api-access-c4vvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:34:48.533637 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.533412    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-dshm" (OuterVolumeSpecName: "dshm") pod "13e33733-4f08-4307-8611-587825ba48b5" (UID: "13e33733-4f08-4307-8611-587825ba48b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:48.632071 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.631994    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13e33733-4f08-4307-8611-587825ba48b5-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:48.632071 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.632072    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13e33733-4f08-4307-8611-587825ba48b5-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:48.632071 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.632083    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4vvl\" (UniqueName: \"kubernetes.io/projected/13e33733-4f08-4307-8611-587825ba48b5-kube-api-access-c4vvl\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:48.987548 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.987500    2583 generic.go:356] "Generic (PLEG): container finished" podID="13e33733-4f08-4307-8611-587825ba48b5" containerID="6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04" exitCode=0
Jul 12 00:34:48.987548 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.987549    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"
Jul 12 00:34:48.987797 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.987581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj" event={"ID":"13e33733-4f08-4307-8611-587825ba48b5","Type":"ContainerDied","Data":"6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04"}
Jul 12 00:34:48.987797 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.987630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj" event={"ID":"13e33733-4f08-4307-8611-587825ba48b5","Type":"ContainerDied","Data":"72bc7a3704a0ab7e4766c6a66c0a5f17608d6fa3e0a92bae4b12afef93c080c2"}
Jul 12 00:34:48.987797 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.987648    2583 scope.go:117] "RemoveContainer" containerID="6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04"
Jul 12 00:34:48.998268 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.998245    2583 scope.go:117] "RemoveContainer" containerID="6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04"
Jul 12 00:34:48.998648 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:34:48.998626    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04\": container with ID starting with 6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04 not found: ID does not exist" containerID="6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04"
Jul 12 00:34:48.998704 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:48.998660    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04"} err="failed to get container status \"6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04\": rpc error: code = NotFound desc = could not find container \"6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04\": container with ID starting with 6dcf7e9fd4087d6930b0e3d7e14a72bdd78840f604c9a8e1b907e10affee9e04 not found: ID does not exist"
Jul 12 00:34:49.004444 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.004392    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"]
Jul 12 00:34:49.011127 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.011084    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e82014/test-model-e82014-kserve-7bd684799c-swpdj"]
Jul 12 00:34:49.026943 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.026883    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6" podUID="cb954fcb-731a-4f31-94d9-74a1d976f425" containerName="main" containerID="cri-o://2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a" gracePeriod=45
Jul 12 00:34:49.307705 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.307661    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:49.439592 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439551    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-home\") pod \"cb954fcb-731a-4f31-94d9-74a1d976f425\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") "
Jul 12 00:34:49.439592 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-tmp-dir\") pod \"cb954fcb-731a-4f31-94d9-74a1d976f425\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") "
Jul 12 00:34:49.439869 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439622    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-dshm\") pod \"cb954fcb-731a-4f31-94d9-74a1d976f425\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") "
Jul 12 00:34:49.439869 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439670    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-model-cache\") pod \"cb954fcb-731a-4f31-94d9-74a1d976f425\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") "
Jul 12 00:34:49.439869 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439778    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb954fcb-731a-4f31-94d9-74a1d976f425-tls-certs\") pod \"cb954fcb-731a-4f31-94d9-74a1d976f425\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") "
Jul 12 00:34:49.439869 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439822    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc6gx\" (UniqueName: \"kubernetes.io/projected/cb954fcb-731a-4f31-94d9-74a1d976f425-kube-api-access-vc6gx\") pod \"cb954fcb-731a-4f31-94d9-74a1d976f425\" (UID: \"cb954fcb-731a-4f31-94d9-74a1d976f425\") "
Jul 12 00:34:49.439869 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439854    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb954fcb-731a-4f31-94d9-74a1d976f425" (UID: "cb954fcb-731a-4f31-94d9-74a1d976f425"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:49.440169 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.439883    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-home" (OuterVolumeSpecName: "home") pod "cb954fcb-731a-4f31-94d9-74a1d976f425" (UID: "cb954fcb-731a-4f31-94d9-74a1d976f425"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:49.440169 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.440103    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:49.440169 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.440137    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:49.440169 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.440139    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb954fcb-731a-4f31-94d9-74a1d976f425" (UID: "cb954fcb-731a-4f31-94d9-74a1d976f425"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:49.442092 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.442058    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-dshm" (OuterVolumeSpecName: "dshm") pod "cb954fcb-731a-4f31-94d9-74a1d976f425" (UID: "cb954fcb-731a-4f31-94d9-74a1d976f425"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:34:49.442092 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.442082    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb954fcb-731a-4f31-94d9-74a1d976f425-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb954fcb-731a-4f31-94d9-74a1d976f425" (UID: "cb954fcb-731a-4f31-94d9-74a1d976f425"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:34:49.442283 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.442086    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb954fcb-731a-4f31-94d9-74a1d976f425-kube-api-access-vc6gx" (OuterVolumeSpecName: "kube-api-access-vc6gx") pod "cb954fcb-731a-4f31-94d9-74a1d976f425" (UID: "cb954fcb-731a-4f31-94d9-74a1d976f425"). InnerVolumeSpecName "kube-api-access-vc6gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:34:49.541135 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.541090    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:49.541135 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.541127    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb954fcb-731a-4f31-94d9-74a1d976f425-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:49.541135 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.541138    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb954fcb-731a-4f31-94d9-74a1d976f425-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:49.541135 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.541146    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc6gx\" (UniqueName: \"kubernetes.io/projected/cb954fcb-731a-4f31-94d9-74a1d976f425-kube-api-access-vc6gx\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:34:49.995751 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.995701    2583 generic.go:356] "Generic (PLEG): container finished" podID="cb954fcb-731a-4f31-94d9-74a1d976f425" containerID="2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a" exitCode=0
Jul 12 00:34:49.995751 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.995751    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"
Jul 12 00:34:49.996081 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.995790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6" event={"ID":"cb954fcb-731a-4f31-94d9-74a1d976f425","Type":"ContainerDied","Data":"2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a"}
Jul 12 00:34:49.996081 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.995838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6" event={"ID":"cb954fcb-731a-4f31-94d9-74a1d976f425","Type":"ContainerDied","Data":"5e8176da450d7d0e0231f1e3c88bcc99a6a2bca098f7f8412c1c7dbe00d912fa"}
Jul 12 00:34:49.996081 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:49.995856    2583 scope.go:117] "RemoveContainer" containerID="2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a"
Jul 12 00:34:50.009054 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:50.008999    2583 scope.go:117] "RemoveContainer" containerID="2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a"
Jul 12 00:34:50.009653 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:34:50.009613    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a\": container with ID starting with 2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a not found: ID does not exist" containerID="2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a"
Jul 12 00:34:50.009765 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:50.009663    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a"} err="failed to get container status \"2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a\": rpc error: code = NotFound desc = could not find container \"2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a\": container with ID starting with 2ea01768b3bcf6a55b36d5e3def403e69840408cedd9350978817a0cc6989c5a not found: ID does not exist"
Jul 12 00:34:50.021165 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:50.021113    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"]
Jul 12 00:34:50.024420 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:50.024379    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-25afa8/test-model-25afa8-kserve-566c977cb7-8qcn6"]
Jul 12 00:34:50.782797 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:50.782749    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e33733-4f08-4307-8611-587825ba48b5" path="/var/lib/kubelet/pods/13e33733-4f08-4307-8611-587825ba48b5/volumes"
Jul 12 00:34:50.783404 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:34:50.783380    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb954fcb-731a-4f31-94d9-74a1d976f425" path="/var/lib/kubelet/pods/cb954fcb-731a-4f31-94d9-74a1d976f425/volumes"
Jul 12 00:35:50.500419 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.500368    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"]
Jul 12 00:35:50.500999 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.500854    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb954fcb-731a-4f31-94d9-74a1d976f425" containerName="main"
Jul 12 00:35:50.500999 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.500873    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb954fcb-731a-4f31-94d9-74a1d976f425" containerName="main"
Jul 12 00:35:50.500999 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.500904    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e33733-4f08-4307-8611-587825ba48b5" containerName="main"
Jul 12 00:35:50.500999 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.500913    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e33733-4f08-4307-8611-587825ba48b5" containerName="main"
Jul 12 00:35:50.501194 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.501019    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="13e33733-4f08-4307-8611-587825ba48b5" containerName="main"
Jul 12 00:35:50.501194 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.501065    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb954fcb-731a-4f31-94d9-74a1d976f425" containerName="main"
Jul 12 00:35:50.504323 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.504298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"
Jul 12 00:35:50.506984 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.506906    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:35:50.507257 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.506927    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:35:50.511447 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.511405    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"]
Jul 12 00:35:50.567626 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.567573    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34489f7-cdf0-42c7-9d1a-a09272848caa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd\" (UID: \"b34489f7-cdf0-42c7-9d1a-a09272848caa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"
Jul 12 00:35:50.668766 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.668725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34489f7-cdf0-42c7-9d1a-a09272848caa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd\" (UID: \"b34489f7-cdf0-42c7-9d1a-a09272848caa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"
Jul 12 00:35:50.669496 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.669465    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34489f7-cdf0-42c7-9d1a-a09272848caa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd\" (UID: \"b34489f7-cdf0-42c7-9d1a-a09272848caa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"
Jul 12 00:35:50.817818 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.817703    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"
Jul 12 00:35:50.974091 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:50.974054    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"]
Jul 12 00:35:50.977223 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:35:50.977192    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34489f7_cdf0_42c7_9d1a_a09272848caa.slice/crio-a0a11d90062f68c87f6f29155e3902c7b08fb958096dc3162d59bd4f710595bb WatchSource:0}: Error finding container a0a11d90062f68c87f6f29155e3902c7b08fb958096dc3162d59bd4f710595bb: Status 404 returned error can't find the container with id a0a11d90062f68c87f6f29155e3902c7b08fb958096dc3162d59bd4f710595bb
Jul 12 00:35:51.358754 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:51.358693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd" event={"ID":"b34489f7-cdf0-42c7-9d1a-a09272848caa","Type":"ContainerStarted","Data":"a4c459e62035d30b392811289b218971bec488b2299cbe4c9958220eb57aa3d3"}
Jul 12 00:35:51.358977 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:51.358773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd" event={"ID":"b34489f7-cdf0-42c7-9d1a-a09272848caa","Type":"ContainerStarted","Data":"a0a11d90062f68c87f6f29155e3902c7b08fb958096dc3162d59bd4f710595bb"}
Jul 12 00:35:51.374823 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:51.374759    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd" podStartSLOduration=1.374738006 podStartE2EDuration="1.374738006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:35:51.37320929 +0000 UTC m=+2339.176118181" watchObservedRunningTime="2026-07-12 00:35:51.374738006 +0000 UTC m=+2339.177646940"
Jul 12 00:35:52.366538 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:52.366499    2583 generic.go:356] "Generic (PLEG): container finished" podID="b34489f7-cdf0-42c7-9d1a-a09272848caa" containerID="a4c459e62035d30b392811289b218971bec488b2299cbe4c9958220eb57aa3d3" exitCode=0
Jul 12 00:35:52.367057 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:52.366589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd" event={"ID":"b34489f7-cdf0-42c7-9d1a-a09272848caa","Type":"ContainerDied","Data":"a4c459e62035d30b392811289b218971bec488b2299cbe4c9958220eb57aa3d3"}
Jul 12 00:35:53.523795 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:53.523761    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"
Jul 12 00:35:53.595539 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:53.595490    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34489f7-cdf0-42c7-9d1a-a09272848caa-maas-api-service-ca\") pod \"b34489f7-cdf0-42c7-9d1a-a09272848caa\" (UID: \"b34489f7-cdf0-42c7-9d1a-a09272848caa\") "
Jul 12 00:35:53.595869 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:53.595838    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34489f7-cdf0-42c7-9d1a-a09272848caa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b34489f7-cdf0-42c7-9d1a-a09272848caa" (UID: "b34489f7-cdf0-42c7-9d1a-a09272848caa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:35:53.696381 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:53.696327    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34489f7-cdf0-42c7-9d1a-a09272848caa-maas-api-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:35:54.380141 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:54.380111    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd"
Jul 12 00:35:54.380343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:54.380109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd" event={"ID":"b34489f7-cdf0-42c7-9d1a-a09272848caa","Type":"ContainerDied","Data":"a0a11d90062f68c87f6f29155e3902c7b08fb958096dc3162d59bd4f710595bb"}
Jul 12 00:35:54.380343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:35:54.380236    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0a11d90062f68c87f6f29155e3902c7b08fb958096dc3162d59bd4f710595bb"
Jul 12 00:36:53.010972 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:36:53.010926    2583 scope.go:117] "RemoveContainer" containerID="19b6fbda562e1434c6c273bfa26caca5fbaba1a683dc2b6a2dd44b921c9920bb"
Jul 12 00:36:53.303863 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:36:53.303707    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:36:53.322604 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:36:53.322575    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:37:24.530221 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.530129    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"]
Jul 12 00:37:24.530768 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.530747    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34489f7-cdf0-42c7-9d1a-a09272848caa" containerName="revoke-keys"
Jul 12 00:37:24.530819 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.530773    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34489f7-cdf0-42c7-9d1a-a09272848caa" containerName="revoke-keys"
Jul 12 00:37:24.530912 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.530899    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b34489f7-cdf0-42c7-9d1a-a09272848caa" containerName="revoke-keys"
Jul 12 00:37:24.534597 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.534559    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.538378 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.538336    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"default-dockercfg-bcrl9\""
Jul 12 00:37:24.538571 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.538380    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"openshift-service-ca.crt\""
Jul 12 00:37:24.538571 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.538402    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"auth-test-model-45be6f-kserve-self-signed-certs\""
Jul 12 00:37:24.538571 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.538459    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"kube-root-ca.crt\""
Jul 12 00:37:24.545793 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.545760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"]
Jul 12 00:37:24.642167 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.642122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt6p2\" (UniqueName: \"kubernetes.io/projected/dca4efff-8d06-488b-9d6b-9dacf3a4b572-kube-api-access-kt6p2\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.642362 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.642179    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-model-cache\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.642362 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.642260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-home\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.642362 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.642298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tls-certs\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.642362 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.642328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tmp-dir\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.642510 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.642424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-dshm\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.743648 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.743597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-dshm\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.743648 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.743651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt6p2\" (UniqueName: \"kubernetes.io/projected/dca4efff-8d06-488b-9d6b-9dacf3a4b572-kube-api-access-kt6p2\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.743920 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.743684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-model-cache\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.743920 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.743716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-home\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.743920 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.743738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tls-certs\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.743920 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.743760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tmp-dir\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.744213 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.744184    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-model-cache\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.744323 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.744228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-home\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.744323 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.744244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tmp-dir\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.746289 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.746258    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-dshm\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.746445 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.746430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tls-certs\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.751747 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.751715    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt6p2\" (UniqueName: \"kubernetes.io/projected/dca4efff-8d06-488b-9d6b-9dacf3a4b572-kube-api-access-kt6p2\") pod \"auth-test-model-45be6f-kserve-68c4f75b75-6qdps\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") " pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:24.847243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:24.847126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:25.000574 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:25.000535    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"]
Jul 12 00:37:25.002494 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:37:25.002460    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddca4efff_8d06_488b_9d6b_9dacf3a4b572.slice/crio-74709f9d365bfd0736041c8314fa2de4faed8cd8b56e0f8972ecdf7edc0be90a WatchSource:0}: Error finding container 74709f9d365bfd0736041c8314fa2de4faed8cd8b56e0f8972ecdf7edc0be90a: Status 404 returned error can't find the container with id 74709f9d365bfd0736041c8314fa2de4faed8cd8b56e0f8972ecdf7edc0be90a
Jul 12 00:37:25.916612 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:25.916571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps" event={"ID":"dca4efff-8d06-488b-9d6b-9dacf3a4b572","Type":"ContainerStarted","Data":"942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65"}
Jul 12 00:37:25.917076 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:25.916625    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps" event={"ID":"dca4efff-8d06-488b-9d6b-9dacf3a4b572","Type":"ContainerStarted","Data":"74709f9d365bfd0736041c8314fa2de4faed8cd8b56e0f8972ecdf7edc0be90a"}
Jul 12 00:37:25.933217 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:25.933155    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps" podStartSLOduration=1.9331385829999999 podStartE2EDuration="1.933138583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:37:25.932483655 +0000 UTC m=+2433.735392539" watchObservedRunningTime="2026-07-12 00:37:25.933138583 +0000 UTC m=+2433.736047469"
Jul 12 00:37:34.847722 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:34.847677    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:34.848267 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:34.847758    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:34.861339 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:34.861307    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:34.983237 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:34.983204    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:37:56.532322 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.532272    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"]
Jul 12 00:37:56.536724 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.536698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.539454 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.539421    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"default-dockercfg-hmsmq\""
Jul 12 00:37:56.539454 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.539448    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"kube-root-ca.crt\""
Jul 12 00:37:56.539699 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.539519    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"auth-test-model-39949b-kserve-self-signed-certs\""
Jul 12 00:37:56.539699 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.539427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"openshift-service-ca.crt\""
Jul 12 00:37:56.541407 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.541374    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"]
Jul 12 00:37:56.661986 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.661939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2bnw\" (UniqueName: \"kubernetes.io/projected/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-kube-api-access-c2bnw\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.662243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.661999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tls-certs\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.662243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.662116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-model-cache\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.662243 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.662229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-dshm\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.662403 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.662255    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-home\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.662403 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.662293    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tmp-dir\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763412 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-home\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763412 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tmp-dir\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bnw\" (UniqueName: \"kubernetes.io/projected/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-kube-api-access-c2bnw\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tls-certs\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-model-cache\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-dshm\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763964 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tmp-dir\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.763964 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.763937    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-home\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.764307 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.764261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-model-cache\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.766242 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.766215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-dshm\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.766607 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.766580    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tls-certs\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.771510 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.771482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2bnw\" (UniqueName: \"kubernetes.io/projected/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-kube-api-access-c2bnw\") pod \"auth-test-model-39949b-kserve-7dff988d8c-htwb6\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") " pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:56.849334 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:56.849224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:37:57.013781 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:57.013744    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"]
Jul 12 00:37:57.015246 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:37:57.015210    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddef7c4b2_3f14_40b4_ad0c_0e4a9036f526.slice/crio-9eb78e0ddc6a14959b380b7607119c948ed9d19d19d5fcd5fb0be1f8eeb8f470 WatchSource:0}: Error finding container 9eb78e0ddc6a14959b380b7607119c948ed9d19d19d5fcd5fb0be1f8eeb8f470: Status 404 returned error can't find the container with id 9eb78e0ddc6a14959b380b7607119c948ed9d19d19d5fcd5fb0be1f8eeb8f470
Jul 12 00:37:57.105668 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:57.105495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6" event={"ID":"def7c4b2-3f14-40b4-ad0c-0e4a9036f526","Type":"ContainerStarted","Data":"a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e"}
Jul 12 00:37:57.105668 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:57.105563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6" event={"ID":"def7c4b2-3f14-40b4-ad0c-0e4a9036f526","Type":"ContainerStarted","Data":"9eb78e0ddc6a14959b380b7607119c948ed9d19d19d5fcd5fb0be1f8eeb8f470"}
Jul 12 00:37:57.123333 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:37:57.123274    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6" podStartSLOduration=1.123255992 podStartE2EDuration="1.123255992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:37:57.120321684 +0000 UTC m=+2464.923230571" watchObservedRunningTime="2026-07-12 00:37:57.123255992 +0000 UTC m=+2464.926164893"
Jul 12 00:38:06.849721 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:38:06.849666    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:38:06.849721 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:38:06.849729    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:38:06.863427 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:38:06.863393    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:38:07.184658 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:38:07.184624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:39:56.370752 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:39:56.370709    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"]
Jul 12 00:39:57.114341 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:39:57.114305    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"]
Jul 12 00:40:11.392578 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.392502    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps" podUID="dca4efff-8d06-488b-9d6b-9dacf3a4b572" containerName="main" containerID="cri-o://942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65" gracePeriod=45
Jul 12 00:40:11.663991 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.663955    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:40:11.759589 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.759548    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tmp-dir\") pod \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") "
Jul 12 00:40:11.759815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.759628    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tls-certs\") pod \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") "
Jul 12 00:40:11.759815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.759649    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-home\") pod \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") "
Jul 12 00:40:11.759815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.759678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-model-cache\") pod \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") "
Jul 12 00:40:11.759815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.759702    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt6p2\" (UniqueName: \"kubernetes.io/projected/dca4efff-8d06-488b-9d6b-9dacf3a4b572-kube-api-access-kt6p2\") pod \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") "
Jul 12 00:40:11.759815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.759805    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-dshm\") pod \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\" (UID: \"dca4efff-8d06-488b-9d6b-9dacf3a4b572\") "
Jul 12 00:40:11.760129 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.759888    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dca4efff-8d06-488b-9d6b-9dacf3a4b572" (UID: "dca4efff-8d06-488b-9d6b-9dacf3a4b572"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:11.760129 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.760000    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-model-cache" (OuterVolumeSpecName: "model-cache") pod "dca4efff-8d06-488b-9d6b-9dacf3a4b572" (UID: "dca4efff-8d06-488b-9d6b-9dacf3a4b572"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:11.760129 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.760014    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-home" (OuterVolumeSpecName: "home") pod "dca4efff-8d06-488b-9d6b-9dacf3a4b572" (UID: "dca4efff-8d06-488b-9d6b-9dacf3a4b572"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:11.760295 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.760160    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:11.760295 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.760177    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:11.760295 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.760185    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:11.762377 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.762334    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dca4efff-8d06-488b-9d6b-9dacf3a4b572" (UID: "dca4efff-8d06-488b-9d6b-9dacf3a4b572"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:40:11.762514 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.762334    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-dshm" (OuterVolumeSpecName: "dshm") pod "dca4efff-8d06-488b-9d6b-9dacf3a4b572" (UID: "dca4efff-8d06-488b-9d6b-9dacf3a4b572"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:11.762514 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.762352    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca4efff-8d06-488b-9d6b-9dacf3a4b572-kube-api-access-kt6p2" (OuterVolumeSpecName: "kube-api-access-kt6p2") pod "dca4efff-8d06-488b-9d6b-9dacf3a4b572" (UID: "dca4efff-8d06-488b-9d6b-9dacf3a4b572"). InnerVolumeSpecName "kube-api-access-kt6p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:40:11.860752 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.860704    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dca4efff-8d06-488b-9d6b-9dacf3a4b572-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:11.860752 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.860747    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt6p2\" (UniqueName: \"kubernetes.io/projected/dca4efff-8d06-488b-9d6b-9dacf3a4b572-kube-api-access-kt6p2\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:11.860752 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.860757    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dca4efff-8d06-488b-9d6b-9dacf3a4b572-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:11.889279 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.889238    2583 generic.go:356] "Generic (PLEG): container finished" podID="dca4efff-8d06-488b-9d6b-9dacf3a4b572" containerID="942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65" exitCode=0
Jul 12 00:40:11.889494 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.889285    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"
Jul 12 00:40:11.889494 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.889322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps" event={"ID":"dca4efff-8d06-488b-9d6b-9dacf3a4b572","Type":"ContainerDied","Data":"942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65"}
Jul 12 00:40:11.889494 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.889370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps" event={"ID":"dca4efff-8d06-488b-9d6b-9dacf3a4b572","Type":"ContainerDied","Data":"74709f9d365bfd0736041c8314fa2de4faed8cd8b56e0f8972ecdf7edc0be90a"}
Jul 12 00:40:11.889494 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.889388    2583 scope.go:117] "RemoveContainer" containerID="942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65"
Jul 12 00:40:11.900027 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.900005    2583 scope.go:117] "RemoveContainer" containerID="942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65"
Jul 12 00:40:11.900531 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:40:11.900503    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65\": container with ID starting with 942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65 not found: ID does not exist" containerID="942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65"
Jul 12 00:40:11.900623 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.900540    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65"} err="failed to get container status \"942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65\": rpc error: code = NotFound desc = could not find container \"942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65\": container with ID starting with 942be7a82eda959e982a3f68356919de4b0133666811c29366d240d3898e9e65 not found: ID does not exist"
Jul 12 00:40:11.911175 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.911133    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"]
Jul 12 00:40:11.916315 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:11.916277    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/auth-test-model-45be6f-kserve-68c4f75b75-6qdps"]
Jul 12 00:40:12.137890 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.137846    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6" podUID="def7c4b2-3f14-40b4-ad0c-0e4a9036f526" containerName="main" containerID="cri-o://a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e" gracePeriod=45
Jul 12 00:40:12.397148 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.397111    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:40:12.465983 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.465934    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-home\") pod \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") "
Jul 12 00:40:12.466246 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466104    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-model-cache\") pod \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") "
Jul 12 00:40:12.466246 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466138    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tls-certs\") pod \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") "
Jul 12 00:40:12.466246 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-dshm\") pod \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") "
Jul 12 00:40:12.466246 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466205    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2bnw\" (UniqueName: \"kubernetes.io/projected/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-kube-api-access-c2bnw\") pod \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") "
Jul 12 00:40:12.466246 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466244    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tmp-dir\") pod \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\" (UID: \"def7c4b2-3f14-40b4-ad0c-0e4a9036f526\") "
Jul 12 00:40:12.466503 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466266    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-home" (OuterVolumeSpecName: "home") pod "def7c4b2-3f14-40b4-ad0c-0e4a9036f526" (UID: "def7c4b2-3f14-40b4-ad0c-0e4a9036f526"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:12.466503 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466425    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-model-cache" (OuterVolumeSpecName: "model-cache") pod "def7c4b2-3f14-40b4-ad0c-0e4a9036f526" (UID: "def7c4b2-3f14-40b4-ad0c-0e4a9036f526"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:12.466618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466510    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "def7c4b2-3f14-40b4-ad0c-0e4a9036f526" (UID: "def7c4b2-3f14-40b4-ad0c-0e4a9036f526"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:12.466618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466579    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:12.466618 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.466598    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:12.468805 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.468773    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-dshm" (OuterVolumeSpecName: "dshm") pod "def7c4b2-3f14-40b4-ad0c-0e4a9036f526" (UID: "def7c4b2-3f14-40b4-ad0c-0e4a9036f526"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:40:12.468805 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.468776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-kube-api-access-c2bnw" (OuterVolumeSpecName: "kube-api-access-c2bnw") pod "def7c4b2-3f14-40b4-ad0c-0e4a9036f526" (UID: "def7c4b2-3f14-40b4-ad0c-0e4a9036f526"). InnerVolumeSpecName "kube-api-access-c2bnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:40:12.468979 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.468775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "def7c4b2-3f14-40b4-ad0c-0e4a9036f526" (UID: "def7c4b2-3f14-40b4-ad0c-0e4a9036f526"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:40:12.567652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.567597    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:12.567652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.567633    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:12.567652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.567644    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2bnw\" (UniqueName: \"kubernetes.io/projected/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-kube-api-access-c2bnw\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:12.567652 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.567653    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def7c4b2-3f14-40b4-ad0c-0e4a9036f526-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:40:12.782558 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.782463    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca4efff-8d06-488b-9d6b-9dacf3a4b572" path="/var/lib/kubelet/pods/dca4efff-8d06-488b-9d6b-9dacf3a4b572/volumes"
Jul 12 00:40:12.897611 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.897572    2583 generic.go:356] "Generic (PLEG): container finished" podID="def7c4b2-3f14-40b4-ad0c-0e4a9036f526" containerID="a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e" exitCode=0
Jul 12 00:40:12.897815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.897624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6" event={"ID":"def7c4b2-3f14-40b4-ad0c-0e4a9036f526","Type":"ContainerDied","Data":"a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e"}
Jul 12 00:40:12.897815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.897638    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"
Jul 12 00:40:12.897815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.897661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6" event={"ID":"def7c4b2-3f14-40b4-ad0c-0e4a9036f526","Type":"ContainerDied","Data":"9eb78e0ddc6a14959b380b7607119c948ed9d19d19d5fcd5fb0be1f8eeb8f470"}
Jul 12 00:40:12.897815 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.897679    2583 scope.go:117] "RemoveContainer" containerID="a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e"
Jul 12 00:40:12.908178 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.908155    2583 scope.go:117] "RemoveContainer" containerID="a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e"
Jul 12 00:40:12.908511 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:40:12.908485    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e\": container with ID starting with a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e not found: ID does not exist" containerID="a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e"
Jul 12 00:40:12.908567 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.908525    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e"} err="failed to get container status \"a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e\": rpc error: code = NotFound desc = could not find container \"a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e\": container with ID starting with a43f6b3e409724198811ae2dfcd1b4b1400a1baf474a4094f6ff5f82c5f9527e not found: ID does not exist"
Jul 12 00:40:12.914467 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.914431    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"]
Jul 12 00:40:12.918297 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:12.918262    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/auth-test-model-39949b-kserve-7dff988d8c-htwb6"]
Jul 12 00:40:13.633775 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.633738    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"]
Jul 12 00:40:13.634189 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.634146    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def7c4b2-3f14-40b4-ad0c-0e4a9036f526" containerName="main"
Jul 12 00:40:13.634189 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.634162    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="def7c4b2-3f14-40b4-ad0c-0e4a9036f526" containerName="main"
Jul 12 00:40:13.634189 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.634183    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca4efff-8d06-488b-9d6b-9dacf3a4b572" containerName="main"
Jul 12 00:40:13.634189 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.634189    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca4efff-8d06-488b-9d6b-9dacf3a4b572" containerName="main"
Jul 12 00:40:13.634321 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.634264    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="def7c4b2-3f14-40b4-ad0c-0e4a9036f526" containerName="main"
Jul 12 00:40:13.634321 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.634274    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca4efff-8d06-488b-9d6b-9dacf3a4b572" containerName="main"
Jul 12 00:40:13.639165 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.639135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.643362 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.643317    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"sub-test-model-45be6f-kserve-self-signed-certs\""
Jul 12 00:40:13.643553 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.643442    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"openshift-service-ca.crt\""
Jul 12 00:40:13.643553 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.643541    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"default-dockercfg-bcrl9\""
Jul 12 00:40:13.643684 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.643652    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-45be6f\"/\"kube-root-ca.crt\""
Jul 12 00:40:13.647104 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.647069    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"]
Jul 12 00:40:13.676507 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.676454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-home\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.676507 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.676514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-dshm\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.676984 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.676598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-model-cache\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.676984 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.676639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.676984 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.676664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-265mf\" (UniqueName: \"kubernetes.io/projected/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-kube-api-access-265mf\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.676984 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.676768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tmp-dir\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.777566 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.777514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-dshm\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.777566 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.777573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-model-cache\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.777844 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.777606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.777844 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.777631    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-265mf\" (UniqueName: \"kubernetes.io/projected/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-kube-api-access-265mf\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.777844 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.777702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tmp-dir\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.777844 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.777759    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-home\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.778104 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.778080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-model-cache\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.778221 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.778203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tmp-dir\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.778264 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.778246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-home\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.780352 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.780321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-dshm\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.780511 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.780493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.785482 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.785447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-265mf\" (UniqueName: \"kubernetes.io/projected/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-kube-api-access-265mf\") pod \"sub-test-model-45be6f-kserve-5cf87bc755-99xs9\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") " pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:13.951019 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:13.950978    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:14.104512 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:14.104476    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"]
Jul 12 00:40:14.106361 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:40:14.106324    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff9c18bd_f1ef_4c43_bfab_2fb95f6d229c.slice/crio-7d0a6fa17d80318fe31138a4875c2ff791e1f1360a87b0ce8ac5a48e83f099e6 WatchSource:0}: Error finding container 7d0a6fa17d80318fe31138a4875c2ff791e1f1360a87b0ce8ac5a48e83f099e6: Status 404 returned error can't find the container with id 7d0a6fa17d80318fe31138a4875c2ff791e1f1360a87b0ce8ac5a48e83f099e6
Jul 12 00:40:14.782885 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:14.782842    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def7c4b2-3f14-40b4-ad0c-0e4a9036f526" path="/var/lib/kubelet/pods/def7c4b2-3f14-40b4-ad0c-0e4a9036f526/volumes"
Jul 12 00:40:14.913280 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:14.913239    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9" event={"ID":"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c","Type":"ContainerStarted","Data":"b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b"}
Jul 12 00:40:14.913280 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:14.913292    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9" event={"ID":"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c","Type":"ContainerStarted","Data":"7d0a6fa17d80318fe31138a4875c2ff791e1f1360a87b0ce8ac5a48e83f099e6"}
Jul 12 00:40:14.930779 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:14.930715    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9" podStartSLOduration=1.930694727 podStartE2EDuration="1.930694727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:40:14.929782232 +0000 UTC m=+2602.732691120" watchObservedRunningTime="2026-07-12 00:40:14.930694727 +0000 UTC m=+2602.733603666"
Jul 12 00:40:23.951746 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:23.951696    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:23.952262 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:23.951779    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:23.966372 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:23.966339    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:23.980656 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:23.980623    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:40:49.135847 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.135810    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"]
Jul 12 00:40:49.139381 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.139354    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.142181 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.142158    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"openshift-service-ca.crt\""
Jul 12 00:40:49.143392 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.143370    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"default-dockercfg-hmsmq\""
Jul 12 00:40:49.143529 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.143430    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"kube-root-ca.crt\""
Jul 12 00:40:49.143529 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.143494    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"sub-test-model-39949b-kserve-self-signed-certs\""
Jul 12 00:40:49.147222 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.147185    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"]
Jul 12 00:40:49.316160 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.316104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-dshm\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.316369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.316186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-model-cache\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.316369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.316231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jdw8\" (UniqueName: \"kubernetes.io/projected/9e47e1d3-33c7-4199-8f08-4047356045ef-kube-api-access-4jdw8\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.316369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.316258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-tmp-dir\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.316369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.316280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-home\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.316369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.316298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e47e1d3-33c7-4199-8f08-4047356045ef-tls-certs\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417083 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-dshm\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417279 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-model-cache\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417279 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jdw8\" (UniqueName: \"kubernetes.io/projected/9e47e1d3-33c7-4199-8f08-4047356045ef-kube-api-access-4jdw8\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417279 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-tmp-dir\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417279 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-home\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417279 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e47e1d3-33c7-4199-8f08-4047356045ef-tls-certs\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417616 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417585    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-model-cache\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-tmp-dir\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.417691 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.417679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-home\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.419549 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.419523    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-dshm\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.419814 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.419796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e47e1d3-33c7-4199-8f08-4047356045ef-tls-certs\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.426391 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.426355    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jdw8\" (UniqueName: \"kubernetes.io/projected/9e47e1d3-33c7-4199-8f08-4047356045ef-kube-api-access-4jdw8\") pod \"sub-test-model-39949b-kserve-7cf77699ff-8vb6p\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") " pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.450999 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.450952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:49.608579 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:49.608544    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"]
Jul 12 00:40:49.610440 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:40:49.610402    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e47e1d3_33c7_4199_8f08_4047356045ef.slice/crio-5497ee965ec4bb4eea668a14df427da1a9ad720f24120c09a8eb8ea391f8e290 WatchSource:0}: Error finding container 5497ee965ec4bb4eea668a14df427da1a9ad720f24120c09a8eb8ea391f8e290: Status 404 returned error can't find the container with id 5497ee965ec4bb4eea668a14df427da1a9ad720f24120c09a8eb8ea391f8e290
Jul 12 00:40:50.116259 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:50.116152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p" event={"ID":"9e47e1d3-33c7-4199-8f08-4047356045ef","Type":"ContainerStarted","Data":"908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b"}
Jul 12 00:40:50.116259 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:50.116197    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p" event={"ID":"9e47e1d3-33c7-4199-8f08-4047356045ef","Type":"ContainerStarted","Data":"5497ee965ec4bb4eea668a14df427da1a9ad720f24120c09a8eb8ea391f8e290"}
Jul 12 00:40:50.132929 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:50.132868    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p" podStartSLOduration=1.132848126 podStartE2EDuration="1.132848126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:40:50.131306589 +0000 UTC m=+2637.934215467" watchObservedRunningTime="2026-07-12 00:40:50.132848126 +0000 UTC m=+2637.935757013"
Jul 12 00:40:59.451399 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:59.451346    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:59.451833 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:59.451425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:40:59.464466 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:40:59.464426    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:41:00.184415 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:00.184376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:41:39.790362 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:39.790316    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-self-signed-certs: secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:39.790905 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:39.790438    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs podName:ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c nodeName:}" failed. No retries permitted until 2026-07-12 00:41:40.290413929 +0000 UTC m=+2688.093322819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs") pod "sub-test-model-45be6f-kserve-5cf87bc755-99xs9" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c") : secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:39.811800 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:39.811756    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"]
Jul 12 00:41:40.294723 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:40.294679    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-self-signed-certs: secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:40.294929 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:40.294794    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs podName:ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c nodeName:}" failed. No retries permitted until 2026-07-12 00:41:41.294776289 +0000 UTC m=+2689.097685153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs") pod "sub-test-model-45be6f-kserve-5cf87bc755-99xs9" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c") : secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:40.716391 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:40.716349    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"]
Jul 12 00:41:41.304470 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:41.304419    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-self-signed-certs: secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:41.304913 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:41.304500    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs podName:ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c nodeName:}" failed. No retries permitted until 2026-07-12 00:41:43.30448467 +0000 UTC m=+2691.107393535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs") pod "sub-test-model-45be6f-kserve-5cf87bc755-99xs9" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c") : secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:43.319541 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:43.319496    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-self-signed-certs: secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:43.319990 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:43.319590    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs podName:ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c nodeName:}" failed. No retries permitted until 2026-07-12 00:41:47.319569863 +0000 UTC m=+2695.122478729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs") pod "sub-test-model-45be6f-kserve-5cf87bc755-99xs9" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c") : secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:47.352263 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:47.352215    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-self-signed-certs: secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:47.352727 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:47.352304    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs podName:ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c nodeName:}" failed. No retries permitted until 2026-07-12 00:41:55.352288396 +0000 UTC m=+2703.155197260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs") pod "sub-test-model-45be6f-kserve-5cf87bc755-99xs9" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c") : secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:53.340582 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:53.340465    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:41:53.359566 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:53.359535    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:41:55.429051 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.428988    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9" podUID="ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" containerName="main" containerID="cri-o://b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b" gracePeriod=45
Jul 12 00:41:55.437209 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:55.437171    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-self-signed-certs: secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:55.437376 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:55.437275    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs podName:ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c nodeName:}" failed. No retries permitted until 2026-07-12 00:42:11.437251181 +0000 UTC m=+2719.240160046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs") pod "sub-test-model-45be6f-kserve-5cf87bc755-99xs9" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c") : secret "sub-test-model-45be6f-kserve-self-signed-certs" not found
Jul 12 00:41:55.697629 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.697587    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:41:55.738549 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.738507    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p" podUID="9e47e1d3-33c7-4199-8f08-4047356045ef" containerName="main" containerID="cri-o://908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b" gracePeriod=45
Jul 12 00:41:55.740245 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740211    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-home\") pod \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") "
Jul 12 00:41:55.740387 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740282    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs\") pod \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") "
Jul 12 00:41:55.740442 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-model-cache\") pod \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") "
Jul 12 00:41:55.740490 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740458    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tmp-dir\") pod \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") "
Jul 12 00:41:55.740550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740486    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-dshm\") pod \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") "
Jul 12 00:41:55.740550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740540    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-265mf\" (UniqueName: \"kubernetes.io/projected/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-kube-api-access-265mf\") pod \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\" (UID: \"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c\") "
Jul 12 00:41:55.740656 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740573    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-home" (OuterVolumeSpecName: "home") pod "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:55.740761 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740701    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:55.740852 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740765    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:55.740916 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740889    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:55.740916 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740910    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:55.741024 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.740924    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:55.742866 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.742831    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-dshm" (OuterVolumeSpecName: "dshm") pod "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:55.743022 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.742969    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:41:55.743154 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.743074    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-kube-api-access-265mf" (OuterVolumeSpecName: "kube-api-access-265mf") pod "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" (UID: "ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c"). InnerVolumeSpecName "kube-api-access-265mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:41:55.842178 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.842121    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:55.842178 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.842169    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-265mf\" (UniqueName: \"kubernetes.io/projected/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-kube-api-access-265mf\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:55.842178 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.842184    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:55.990484 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:55.990454    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:41:56.044113 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044064    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-model-cache\") pod \"9e47e1d3-33c7-4199-8f08-4047356045ef\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") "
Jul 12 00:41:56.044338 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-home\") pod \"9e47e1d3-33c7-4199-8f08-4047356045ef\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") "
Jul 12 00:41:56.044338 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044182    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e47e1d3-33c7-4199-8f08-4047356045ef-tls-certs\") pod \"9e47e1d3-33c7-4199-8f08-4047356045ef\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") "
Jul 12 00:41:56.044338 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044201    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-dshm\") pod \"9e47e1d3-33c7-4199-8f08-4047356045ef\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") "
Jul 12 00:41:56.044338 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-tmp-dir\") pod \"9e47e1d3-33c7-4199-8f08-4047356045ef\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") "
Jul 12 00:41:56.044338 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044243    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jdw8\" (UniqueName: \"kubernetes.io/projected/9e47e1d3-33c7-4199-8f08-4047356045ef-kube-api-access-4jdw8\") pod \"9e47e1d3-33c7-4199-8f08-4047356045ef\" (UID: \"9e47e1d3-33c7-4199-8f08-4047356045ef\") "
Jul 12 00:41:56.044591 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044357    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e47e1d3-33c7-4199-8f08-4047356045ef" (UID: "9e47e1d3-33c7-4199-8f08-4047356045ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:56.044591 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044459    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-home" (OuterVolumeSpecName: "home") pod "9e47e1d3-33c7-4199-8f08-4047356045ef" (UID: "9e47e1d3-33c7-4199-8f08-4047356045ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:56.044591 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044478    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9e47e1d3-33c7-4199-8f08-4047356045ef" (UID: "9e47e1d3-33c7-4199-8f08-4047356045ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:56.044766 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044608    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:56.044766 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044622    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:56.044766 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.044631    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:56.046526 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.046450    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-dshm" (OuterVolumeSpecName: "dshm") pod "9e47e1d3-33c7-4199-8f08-4047356045ef" (UID: "9e47e1d3-33c7-4199-8f08-4047356045ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:41:56.046526 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.046485    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e47e1d3-33c7-4199-8f08-4047356045ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9e47e1d3-33c7-4199-8f08-4047356045ef" (UID: "9e47e1d3-33c7-4199-8f08-4047356045ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:41:56.046526 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.046500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e47e1d3-33c7-4199-8f08-4047356045ef-kube-api-access-4jdw8" (OuterVolumeSpecName: "kube-api-access-4jdw8") pod "9e47e1d3-33c7-4199-8f08-4047356045ef" (UID: "9e47e1d3-33c7-4199-8f08-4047356045ef"). InnerVolumeSpecName "kube-api-access-4jdw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:41:56.146156 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.146109    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e47e1d3-33c7-4199-8f08-4047356045ef-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:56.146156 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.146145    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e47e1d3-33c7-4199-8f08-4047356045ef-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:56.146156 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.146155    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jdw8\" (UniqueName: \"kubernetes.io/projected/9e47e1d3-33c7-4199-8f08-4047356045ef-kube-api-access-4jdw8\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:41:56.502701 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.502655    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" containerID="b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b" exitCode=0
Jul 12 00:41:56.502701 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.502695    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"
Jul 12 00:41:56.503284 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.502744    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9" event={"ID":"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c","Type":"ContainerDied","Data":"b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b"}
Jul 12 00:41:56.503284 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.502794    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9" event={"ID":"ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c","Type":"ContainerDied","Data":"7d0a6fa17d80318fe31138a4875c2ff791e1f1360a87b0ce8ac5a48e83f099e6"}
Jul 12 00:41:56.503284 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.502812    2583 scope.go:117] "RemoveContainer" containerID="b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b"
Jul 12 00:41:56.504331 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.504121    2583 generic.go:356] "Generic (PLEG): container finished" podID="9e47e1d3-33c7-4199-8f08-4047356045ef" containerID="908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b" exitCode=0
Jul 12 00:41:56.504331 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.504158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p" event={"ID":"9e47e1d3-33c7-4199-8f08-4047356045ef","Type":"ContainerDied","Data":"908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b"}
Jul 12 00:41:56.504331 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.504183    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"
Jul 12 00:41:56.504331 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.504208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p" event={"ID":"9e47e1d3-33c7-4199-8f08-4047356045ef","Type":"ContainerDied","Data":"5497ee965ec4bb4eea668a14df427da1a9ad720f24120c09a8eb8ea391f8e290"}
Jul 12 00:41:56.514373 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.514352    2583 scope.go:117] "RemoveContainer" containerID="b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b"
Jul 12 00:41:56.514769 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:56.514741    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b\": container with ID starting with b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b not found: ID does not exist" containerID="b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b"
Jul 12 00:41:56.514828 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.514788    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b"} err="failed to get container status \"b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b\": rpc error: code = NotFound desc = could not find container \"b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b\": container with ID starting with b1946658d867491c3f5b5427f30de9dd4d53dbd3c255d9c9b72569a745754f5b not found: ID does not exist"
Jul 12 00:41:56.514828 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.514818    2583 scope.go:117] "RemoveContainer" containerID="908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b"
Jul 12 00:41:56.524665 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.524641    2583 scope.go:117] "RemoveContainer" containerID="908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b"
Jul 12 00:41:56.525120 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:41:56.525093    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b\": container with ID starting with 908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b not found: ID does not exist" containerID="908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b"
Jul 12 00:41:56.525207 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.525128    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b"} err="failed to get container status \"908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b\": rpc error: code = NotFound desc = could not find container \"908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b\": container with ID starting with 908ab4659b02af883081c1783c0bedb895dd7aced21330770bdccd291eb3408b not found: ID does not exist"
Jul 12 00:41:56.526390 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.526365    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"]
Jul 12 00:41:56.529075 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.529029    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-45be6f/sub-test-model-45be6f-kserve-5cf87bc755-99xs9"]
Jul 12 00:41:56.539732 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.539694    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"]
Jul 12 00:41:56.545535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.545490    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/sub-test-model-39949b-kserve-7cf77699ff-8vb6p"]
Jul 12 00:41:56.783224 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.783120    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e47e1d3-33c7-4199-8f08-4047356045ef" path="/var/lib/kubelet/pods/9e47e1d3-33c7-4199-8f08-4047356045ef/volumes"
Jul 12 00:41:56.783657 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:41:56.783636    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" path="/var/lib/kubelet/pods/ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c/volumes"
Jul 12 00:42:55.529867 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.529809    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"]
Jul 12 00:42:55.530550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.530254    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e47e1d3-33c7-4199-8f08-4047356045ef" containerName="main"
Jul 12 00:42:55.530550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.530268    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e47e1d3-33c7-4199-8f08-4047356045ef" containerName="main"
Jul 12 00:42:55.530550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.530291    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" containerName="main"
Jul 12 00:42:55.530550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.530297    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" containerName="main"
Jul 12 00:42:55.530550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.530350    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e47e1d3-33c7-4199-8f08-4047356045ef" containerName="main"
Jul 12 00:42:55.530550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.530362    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff9c18bd-f1ef-4c43-bfab-2fb95f6d229c" containerName="main"
Jul 12 00:42:55.534922 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.534888    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.538753 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.538657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"rate-test-model-39949b-kserve-self-signed-certs\""
Jul 12 00:42:55.539002 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.538793    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"default-dockercfg-hmsmq\""
Jul 12 00:42:55.539309 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.539248    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"kube-root-ca.crt\""
Jul 12 00:42:55.539454 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.539407    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-39949b\"/\"openshift-service-ca.crt\""
Jul 12 00:42:55.543642 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.543613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"]
Jul 12 00:42:55.608058 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.608006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-dshm\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.608251 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.608127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-home\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.608251 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.608169    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-model-cache\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.608251 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.608194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42238e40-b926-4c85-b19d-7732697257a8-tls-certs\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.608363 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.608270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-595c8\" (UniqueName: \"kubernetes.io/projected/42238e40-b926-4c85-b19d-7732697257a8-kube-api-access-595c8\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.608399 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.608384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-tmp-dir\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.709667 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.709609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-595c8\" (UniqueName: \"kubernetes.io/projected/42238e40-b926-4c85-b19d-7732697257a8-kube-api-access-595c8\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.709865 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.709767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-tmp-dir\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.709865 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.709798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-dshm\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.709865 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.709835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-home\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.709865 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.709859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-model-cache\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.710120 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.709886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42238e40-b926-4c85-b19d-7732697257a8-tls-certs\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.710286 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.710262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-tmp-dir\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.710383 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.710349    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-home\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.710458 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.710384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-model-cache\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.712419 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.712400    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-dshm\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.712612 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.712595    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42238e40-b926-4c85-b19d-7732697257a8-tls-certs\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.719893 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.719859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-595c8\" (UniqueName: \"kubernetes.io/projected/42238e40-b926-4c85-b19d-7732697257a8-kube-api-access-595c8\") pod \"rate-test-model-39949b-kserve-f6986b875-5nq27\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") " pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.846641 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.846545    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:42:55.997944 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:55.997901    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"]
Jul 12 00:42:55.999315 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:42:55.999281    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42238e40_b926_4c85_b19d_7732697257a8.slice/crio-1e165fa6f7555781a425ed75bba2008c6ed8b62d792ccb3b332093644a78319d WatchSource:0}: Error finding container 1e165fa6f7555781a425ed75bba2008c6ed8b62d792ccb3b332093644a78319d: Status 404 returned error can't find the container with id 1e165fa6f7555781a425ed75bba2008c6ed8b62d792ccb3b332093644a78319d
Jul 12 00:42:56.852793 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:56.852752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27" event={"ID":"42238e40-b926-4c85-b19d-7732697257a8","Type":"ContainerStarted","Data":"4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f"}
Jul 12 00:42:56.852793 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:56.852803    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27" event={"ID":"42238e40-b926-4c85-b19d-7732697257a8","Type":"ContainerStarted","Data":"1e165fa6f7555781a425ed75bba2008c6ed8b62d792ccb3b332093644a78319d"}
Jul 12 00:42:56.869863 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:42:56.869802    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27" podStartSLOduration=1.869783032 podStartE2EDuration="1.869783032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:42:56.867957015 +0000 UTC m=+2764.670865906" watchObservedRunningTime="2026-07-12 00:42:56.869783032 +0000 UTC m=+2764.672691918"
Jul 12 00:43:05.847708 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:05.847663    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:43:05.848236 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:05.847731    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:43:05.860982 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:05.860950    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:43:05.919144 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:05.919103    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:43:39.132786 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:39.132686    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"]
Jul 12 00:43:40.138084 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.138027    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7508-140265896860080"]
Jul 12 00:43:40.141829 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.141801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:40.144442 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.144415    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-7h8fx\""
Jul 12 00:43:40.144622 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.144481    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265896860080"]
Jul 12 00:43:40.236392 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.236345    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqxw2\" (UniqueName: \"kubernetes.io/projected/19b2229c-f08e-409c-bc0e-5b7de5426f9c-kube-api-access-wqxw2\") pod \"test-curl-7508-140265896860080\" (UID: \"19b2229c-f08e-409c-bc0e-5b7de5426f9c\") " pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:40.337309 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.337263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqxw2\" (UniqueName: \"kubernetes.io/projected/19b2229c-f08e-409c-bc0e-5b7de5426f9c-kube-api-access-wqxw2\") pod \"test-curl-7508-140265896860080\" (UID: \"19b2229c-f08e-409c-bc0e-5b7de5426f9c\") " pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:40.345561 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.345520    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqxw2\" (UniqueName: \"kubernetes.io/projected/19b2229c-f08e-409c-bc0e-5b7de5426f9c-kube-api-access-wqxw2\") pod \"test-curl-7508-140265896860080\" (UID: \"19b2229c-f08e-409c-bc0e-5b7de5426f9c\") " pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:40.453186 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.453136    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:40.607431 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.607395    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265896860080"]
Jul 12 00:43:40.609620 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:43:40.609584    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19b2229c_f08e_409c_bc0e_5b7de5426f9c.slice/crio-9d4672a1766c7ad7637bc9175eec0ca8ac469951b36b07e63da121356fae7c09 WatchSource:0}: Error finding container 9d4672a1766c7ad7637bc9175eec0ca8ac469951b36b07e63da121356fae7c09: Status 404 returned error can't find the container with id 9d4672a1766c7ad7637bc9175eec0ca8ac469951b36b07e63da121356fae7c09
Jul 12 00:43:40.611166 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:40.611144    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 00:43:41.110135 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:41.110086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265896860080" event={"ID":"19b2229c-f08e-409c-bc0e-5b7de5426f9c","Type":"ContainerStarted","Data":"9d4672a1766c7ad7637bc9175eec0ca8ac469951b36b07e63da121356fae7c09"}
Jul 12 00:43:42.121471 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:42.121433    2583 generic.go:356] "Generic (PLEG): container finished" podID="19b2229c-f08e-409c-bc0e-5b7de5426f9c" containerID="14e9528dc9ba4204ca297475b09fd9f447f96b7c21320c2c24eb0fec36fd1c0b" exitCode=0
Jul 12 00:43:42.121954 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:42.121522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265896860080" event={"ID":"19b2229c-f08e-409c-bc0e-5b7de5426f9c","Type":"ContainerDied","Data":"14e9528dc9ba4204ca297475b09fd9f447f96b7c21320c2c24eb0fec36fd1c0b"}
Jul 12 00:43:43.284006 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.283969    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:43.317501 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.317459    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7508-140265896860080_19b2229c-f08e-409c-bc0e-5b7de5426f9c/test-curl-7508-140265896860080/0.log"
Jul 12 00:43:43.339367 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.339318    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7508-140265896860080"]
Jul 12 00:43:43.341790 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.341751    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7508-140265896860080"]
Jul 12 00:43:43.367501 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.367456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqxw2\" (UniqueName: \"kubernetes.io/projected/19b2229c-f08e-409c-bc0e-5b7de5426f9c-kube-api-access-wqxw2\") pod \"19b2229c-f08e-409c-bc0e-5b7de5426f9c\" (UID: \"19b2229c-f08e-409c-bc0e-5b7de5426f9c\") "
Jul 12 00:43:43.369724 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.369694    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b2229c-f08e-409c-bc0e-5b7de5426f9c-kube-api-access-wqxw2" (OuterVolumeSpecName: "kube-api-access-wqxw2") pod "19b2229c-f08e-409c-bc0e-5b7de5426f9c" (UID: "19b2229c-f08e-409c-bc0e-5b7de5426f9c"). InnerVolumeSpecName "kube-api-access-wqxw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:43.465254 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.465213    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7508-140265891172656"]
Jul 12 00:43:43.465649 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.465635    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b2229c-f08e-409c-bc0e-5b7de5426f9c" containerName="test-curl-7508-140265896860080"
Jul 12 00:43:43.465695 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.465650    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b2229c-f08e-409c-bc0e-5b7de5426f9c" containerName="test-curl-7508-140265896860080"
Jul 12 00:43:43.465734 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.465721    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b2229c-f08e-409c-bc0e-5b7de5426f9c" containerName="test-curl-7508-140265896860080"
Jul 12 00:43:43.468886 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.468852    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqxw2\" (UniqueName: \"kubernetes.io/projected/19b2229c-f08e-409c-bc0e-5b7de5426f9c-kube-api-access-wqxw2\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:43.468957 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.468917    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891172656"
Jul 12 00:43:43.474413 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.474380    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891172656"]
Jul 12 00:43:43.569664 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.569625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9m9\" (UniqueName: \"kubernetes.io/projected/bb0ff91d-e1af-438c-8db4-32b6ba6fa518-kube-api-access-sx9m9\") pod \"test-curl-7508-140265891172656\" (UID: \"bb0ff91d-e1af-438c-8db4-32b6ba6fa518\") " pod="openshift-ingress/test-curl-7508-140265891172656"
Jul 12 00:43:43.670996 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.670955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9m9\" (UniqueName: \"kubernetes.io/projected/bb0ff91d-e1af-438c-8db4-32b6ba6fa518-kube-api-access-sx9m9\") pod \"test-curl-7508-140265891172656\" (UID: \"bb0ff91d-e1af-438c-8db4-32b6ba6fa518\") " pod="openshift-ingress/test-curl-7508-140265891172656"
Jul 12 00:43:43.679514 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.679475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9m9\" (UniqueName: \"kubernetes.io/projected/bb0ff91d-e1af-438c-8db4-32b6ba6fa518-kube-api-access-sx9m9\") pod \"test-curl-7508-140265891172656\" (UID: \"bb0ff91d-e1af-438c-8db4-32b6ba6fa518\") " pod="openshift-ingress/test-curl-7508-140265891172656"
Jul 12 00:43:43.780612 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.780501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891172656"
Jul 12 00:43:43.929779 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:43.929742    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891172656"]
Jul 12 00:43:43.931914 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:43:43.931882    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb0ff91d_e1af_438c_8db4_32b6ba6fa518.slice/crio-d682cc6fede531ef4f01063467c3a58d7190b40109955531b7edf032fe722626 WatchSource:0}: Error finding container d682cc6fede531ef4f01063467c3a58d7190b40109955531b7edf032fe722626: Status 404 returned error can't find the container with id d682cc6fede531ef4f01063467c3a58d7190b40109955531b7edf032fe722626
Jul 12 00:43:44.133985 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:44.133872    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891172656" event={"ID":"bb0ff91d-e1af-438c-8db4-32b6ba6fa518","Type":"ContainerStarted","Data":"d682cc6fede531ef4f01063467c3a58d7190b40109955531b7edf032fe722626"}
Jul 12 00:43:44.135281 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:44.135256    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d4672a1766c7ad7637bc9175eec0ca8ac469951b36b07e63da121356fae7c09"
Jul 12 00:43:44.135443 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:44.135288    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:44.146513 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:43:44.146469    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7508-140265896860080\" is forbidden: User \"system:node:ip-10-0-134-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-216.ec2.internal' and this object" podUID="19b2229c-f08e-409c-bc0e-5b7de5426f9c" pod="openshift-ingress/test-curl-7508-140265896860080"
Jul 12 00:43:44.782733 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:44.782697    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b2229c-f08e-409c-bc0e-5b7de5426f9c" path="/var/lib/kubelet/pods/19b2229c-f08e-409c-bc0e-5b7de5426f9c/volumes"
Jul 12 00:43:45.143426 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:45.143314    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb0ff91d-e1af-438c-8db4-32b6ba6fa518" containerID="cd9d878da6be3392daea2a165e214d728db167bdb2dfa2a8a15392ff8ae0158e" exitCode=0
Jul 12 00:43:45.143426 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:45.143382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891172656" event={"ID":"bb0ff91d-e1af-438c-8db4-32b6ba6fa518","Type":"ContainerDied","Data":"cd9d878da6be3392daea2a165e214d728db167bdb2dfa2a8a15392ff8ae0158e"}
Jul 12 00:43:46.307254 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.307216    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891172656"
Jul 12 00:43:46.327409 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.327369    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7508-140265891172656_bb0ff91d-e1af-438c-8db4-32b6ba6fa518/test-curl-7508-140265891172656/0.log"
Jul 12 00:43:46.356218 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.356175    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7508-140265891172656"]
Jul 12 00:43:46.359095 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.359057    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7508-140265891172656"]
Jul 12 00:43:46.397047 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.396982    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx9m9\" (UniqueName: \"kubernetes.io/projected/bb0ff91d-e1af-438c-8db4-32b6ba6fa518-kube-api-access-sx9m9\") pod \"bb0ff91d-e1af-438c-8db4-32b6ba6fa518\" (UID: \"bb0ff91d-e1af-438c-8db4-32b6ba6fa518\") "
Jul 12 00:43:46.399369 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.399293    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0ff91d-e1af-438c-8db4-32b6ba6fa518-kube-api-access-sx9m9" (OuterVolumeSpecName: "kube-api-access-sx9m9") pod "bb0ff91d-e1af-438c-8db4-32b6ba6fa518" (UID: "bb0ff91d-e1af-438c-8db4-32b6ba6fa518"). InnerVolumeSpecName "kube-api-access-sx9m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:46.498366 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.498323    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx9m9\" (UniqueName: \"kubernetes.io/projected/bb0ff91d-e1af-438c-8db4-32b6ba6fa518-kube-api-access-sx9m9\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:46.509563 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.509517    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:46.509910 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.509895    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0ff91d-e1af-438c-8db4-32b6ba6fa518" containerName="test-curl-7508-140265891172656"
Jul 12 00:43:46.509956 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.509911    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0ff91d-e1af-438c-8db4-32b6ba6fa518" containerName="test-curl-7508-140265891172656"
Jul 12 00:43:46.510002 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.509992    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0ff91d-e1af-438c-8db4-32b6ba6fa518" containerName="test-curl-7508-140265891172656"
Jul 12 00:43:46.513153 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.513129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:46.519145 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.519109    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:46.599343 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.599294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-948g7\" (UniqueName: \"kubernetes.io/projected/3195ccd7-e778-462e-a56a-050874f68d3c-kube-api-access-948g7\") pod \"test-curl-7508-140265891180592\" (UID: \"3195ccd7-e778-462e-a56a-050874f68d3c\") " pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:46.700775 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.700728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-948g7\" (UniqueName: \"kubernetes.io/projected/3195ccd7-e778-462e-a56a-050874f68d3c-kube-api-access-948g7\") pod \"test-curl-7508-140265891180592\" (UID: \"3195ccd7-e778-462e-a56a-050874f68d3c\") " pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:46.709577 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.709533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-948g7\" (UniqueName: \"kubernetes.io/projected/3195ccd7-e778-462e-a56a-050874f68d3c-kube-api-access-948g7\") pod \"test-curl-7508-140265891180592\" (UID: \"3195ccd7-e778-462e-a56a-050874f68d3c\") " pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:46.782406 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.782368    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb0ff91d-e1af-438c-8db4-32b6ba6fa518" path="/var/lib/kubelet/pods/bb0ff91d-e1af-438c-8db4-32b6ba6fa518/volumes"
Jul 12 00:43:46.824827 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.824784    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:46.975193 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:46.975163    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:46.976774 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:43:46.976742    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3195ccd7_e778_462e_a56a_050874f68d3c.slice/crio-d143623da4003a64c500e2c0e5ebc4885e71c3eed3a421d37d35d7da53aafe89 WatchSource:0}: Error finding container d143623da4003a64c500e2c0e5ebc4885e71c3eed3a421d37d35d7da53aafe89: Status 404 returned error can't find the container with id d143623da4003a64c500e2c0e5ebc4885e71c3eed3a421d37d35d7da53aafe89
Jul 12 00:43:47.156250 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:47.156199    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891180592" event={"ID":"3195ccd7-e778-462e-a56a-050874f68d3c","Type":"ContainerStarted","Data":"d143623da4003a64c500e2c0e5ebc4885e71c3eed3a421d37d35d7da53aafe89"}
Jul 12 00:43:47.157614 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:47.157588    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891172656"
Jul 12 00:43:47.157778 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:47.157590    2583 scope.go:117] "RemoveContainer" containerID="cd9d878da6be3392daea2a165e214d728db167bdb2dfa2a8a15392ff8ae0158e"
Jul 12 00:43:48.175498 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:48.175450    2583 generic.go:356] "Generic (PLEG): container finished" podID="3195ccd7-e778-462e-a56a-050874f68d3c" containerID="68586768c0dd8088c0407e64b41bb0855ec0c1c2c8f0e2a5a51d5095e12d4939" exitCode=0
Jul 12 00:43:48.176055 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:48.175534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891180592" event={"ID":"3195ccd7-e778-462e-a56a-050874f68d3c","Type":"ContainerDied","Data":"68586768c0dd8088c0407e64b41bb0855ec0c1c2c8f0e2a5a51d5095e12d4939"}
Jul 12 00:43:49.333891 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.333858    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:49.352131 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.352053    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7508-140265891180592_3195ccd7-e778-462e-a56a-050874f68d3c/test-curl-7508-140265891180592/0.log"
Jul 12 00:43:49.374290 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.374250    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:49.376848 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.376817    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:49.428390 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.428354    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-948g7\" (UniqueName: \"kubernetes.io/projected/3195ccd7-e778-462e-a56a-050874f68d3c-kube-api-access-948g7\") pod \"3195ccd7-e778-462e-a56a-050874f68d3c\" (UID: \"3195ccd7-e778-462e-a56a-050874f68d3c\") "
Jul 12 00:43:49.430637 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.430602    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3195ccd7-e778-462e-a56a-050874f68d3c-kube-api-access-948g7" (OuterVolumeSpecName: "kube-api-access-948g7") pod "3195ccd7-e778-462e-a56a-050874f68d3c" (UID: "3195ccd7-e778-462e-a56a-050874f68d3c"). InnerVolumeSpecName "kube-api-access-948g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:49.496257 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.496211    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:49.496611 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.496597    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3195ccd7-e778-462e-a56a-050874f68d3c" containerName="test-curl-7508-140265891180592"
Jul 12 00:43:49.496662 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.496612    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3195ccd7-e778-462e-a56a-050874f68d3c" containerName="test-curl-7508-140265891180592"
Jul 12 00:43:49.496706 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.496699    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3195ccd7-e778-462e-a56a-050874f68d3c" containerName="test-curl-7508-140265891180592"
Jul 12 00:43:49.499863 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.499841    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:49.505707 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.505676    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:49.529472 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.529430    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-948g7\" (UniqueName: \"kubernetes.io/projected/3195ccd7-e778-462e-a56a-050874f68d3c-kube-api-access-948g7\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:49.629942 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.629905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/6a819567-4416-406f-9765-bc23477ece54-kube-api-access-4j9rv\") pod \"test-curl-7508-140265891180592\" (UID: \"6a819567-4416-406f-9765-bc23477ece54\") " pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:49.731586 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.731472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/6a819567-4416-406f-9765-bc23477ece54-kube-api-access-4j9rv\") pod \"test-curl-7508-140265891180592\" (UID: \"6a819567-4416-406f-9765-bc23477ece54\") " pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:49.739678 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.739649    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/6a819567-4416-406f-9765-bc23477ece54-kube-api-access-4j9rv\") pod \"test-curl-7508-140265891180592\" (UID: \"6a819567-4416-406f-9765-bc23477ece54\") " pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:49.811274 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.811232    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:49.961751 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:49.961720    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:49.963712 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:43:49.963681    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a819567_4416_406f_9765_bc23477ece54.slice/crio-a831bc34cb31cdc586daf5c323a21d1821333a57602f5b8e334fa77b7a56b87b WatchSource:0}: Error finding container a831bc34cb31cdc586daf5c323a21d1821333a57602f5b8e334fa77b7a56b87b: Status 404 returned error can't find the container with id a831bc34cb31cdc586daf5c323a21d1821333a57602f5b8e334fa77b7a56b87b
Jul 12 00:43:50.189763 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:50.189725    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891180592" event={"ID":"6a819567-4416-406f-9765-bc23477ece54","Type":"ContainerStarted","Data":"a831bc34cb31cdc586daf5c323a21d1821333a57602f5b8e334fa77b7a56b87b"}
Jul 12 00:43:50.191022 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:50.190998    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:50.191022 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:50.191011    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d143623da4003a64c500e2c0e5ebc4885e71c3eed3a421d37d35d7da53aafe89"
Jul 12 00:43:50.202831 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:50.202786    2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7508-140265891180592" oldPodUID="3195ccd7-e778-462e-a56a-050874f68d3c" podUID="6a819567-4416-406f-9765-bc23477ece54"
Jul 12 00:43:50.782743 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:50.782702    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3195ccd7-e778-462e-a56a-050874f68d3c" path="/var/lib/kubelet/pods/3195ccd7-e778-462e-a56a-050874f68d3c/volumes"
Jul 12 00:43:51.200263 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:51.200225    2583 generic.go:356] "Generic (PLEG): container finished" podID="6a819567-4416-406f-9765-bc23477ece54" containerID="42cb4a0fbd1f6acc8190fa2cb26561937694d0dca17a1e9bad20d71b85441d3a" exitCode=0
Jul 12 00:43:51.200467 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:51.200288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891180592" event={"ID":"6a819567-4416-406f-9765-bc23477ece54","Type":"ContainerDied","Data":"42cb4a0fbd1f6acc8190fa2cb26561937694d0dca17a1e9bad20d71b85441d3a"}
Jul 12 00:43:52.366594 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.366562    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:52.384589 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.384557    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7508-140265891180592_6a819567-4416-406f-9765-bc23477ece54/test-curl-7508-140265891180592/0.log"
Jul 12 00:43:52.408497 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.408449    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:52.411756 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.411721    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7508-140265891180592"]
Jul 12 00:43:52.458602 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.458487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/6a819567-4416-406f-9765-bc23477ece54-kube-api-access-4j9rv\") pod \"6a819567-4416-406f-9765-bc23477ece54\" (UID: \"6a819567-4416-406f-9765-bc23477ece54\") "
Jul 12 00:43:52.461012 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.460971    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a819567-4416-406f-9765-bc23477ece54-kube-api-access-4j9rv" (OuterVolumeSpecName: "kube-api-access-4j9rv") pod "6a819567-4416-406f-9765-bc23477ece54" (UID: "6a819567-4416-406f-9765-bc23477ece54"). InnerVolumeSpecName "kube-api-access-4j9rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:52.530840 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.530805    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:52.531244 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.531227    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a819567-4416-406f-9765-bc23477ece54" containerName="test-curl-7508-140265891180592"
Jul 12 00:43:52.531287 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.531244    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a819567-4416-406f-9765-bc23477ece54" containerName="test-curl-7508-140265891180592"
Jul 12 00:43:52.531326 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.531321    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a819567-4416-406f-9765-bc23477ece54" containerName="test-curl-7508-140265891180592"
Jul 12 00:43:52.534535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.534509    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:52.538863 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.538830    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:52.560208 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.560162    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/6a819567-4416-406f-9765-bc23477ece54-kube-api-access-4j9rv\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:52.660747 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.660686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9fp9\" (UniqueName: \"kubernetes.io/projected/f2d8f375-6966-480c-aabe-b51ae5cea463-kube-api-access-r9fp9\") pod \"test-curl-7508-140265891181600\" (UID: \"f2d8f375-6966-480c-aabe-b51ae5cea463\") " pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:52.762191 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.762098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9fp9\" (UniqueName: \"kubernetes.io/projected/f2d8f375-6966-480c-aabe-b51ae5cea463-kube-api-access-r9fp9\") pod \"test-curl-7508-140265891181600\" (UID: \"f2d8f375-6966-480c-aabe-b51ae5cea463\") " pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:52.771176 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.771137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9fp9\" (UniqueName: \"kubernetes.io/projected/f2d8f375-6966-480c-aabe-b51ae5cea463-kube-api-access-r9fp9\") pod \"test-curl-7508-140265891181600\" (UID: \"f2d8f375-6966-480c-aabe-b51ae5cea463\") " pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:52.784789 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.784759    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a819567-4416-406f-9765-bc23477ece54" path="/var/lib/kubelet/pods/6a819567-4416-406f-9765-bc23477ece54/volumes"
Jul 12 00:43:52.846274 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.846234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:52.992155 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:52.992127    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:52.993899 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:43:52.993871    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2d8f375_6966_480c_aabe_b51ae5cea463.slice/crio-13c9e1ec62cfc2f3ad8f620de08945ef7a59597f152a08284df450bf3eb03a74 WatchSource:0}: Error finding container 13c9e1ec62cfc2f3ad8f620de08945ef7a59597f152a08284df450bf3eb03a74: Status 404 returned error can't find the container with id 13c9e1ec62cfc2f3ad8f620de08945ef7a59597f152a08284df450bf3eb03a74
Jul 12 00:43:53.213981 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:53.213946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891181600" event={"ID":"f2d8f375-6966-480c-aabe-b51ae5cea463","Type":"ContainerStarted","Data":"13c9e1ec62cfc2f3ad8f620de08945ef7a59597f152a08284df450bf3eb03a74"}
Jul 12 00:43:53.215305 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:53.215285    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891180592"
Jul 12 00:43:53.215436 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:53.215285    2583 scope.go:117] "RemoveContainer" containerID="42cb4a0fbd1f6acc8190fa2cb26561937694d0dca17a1e9bad20d71b85441d3a"
Jul 12 00:43:54.156424 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.156371    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27" podUID="42238e40-b926-4c85-b19d-7732697257a8" containerName="main" containerID="cri-o://4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f" gracePeriod=45
Jul 12 00:43:54.222731 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.222693    2583 generic.go:356] "Generic (PLEG): container finished" podID="f2d8f375-6966-480c-aabe-b51ae5cea463" containerID="845387c85641ee7d147aef0d6ffaa7406434a9438ee67ce9a258d8690a6b9cf3" exitCode=0
Jul 12 00:43:54.222956 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.222779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891181600" event={"ID":"f2d8f375-6966-480c-aabe-b51ae5cea463","Type":"ContainerDied","Data":"845387c85641ee7d147aef0d6ffaa7406434a9438ee67ce9a258d8690a6b9cf3"}
Jul 12 00:43:54.421160 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.421079    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:43:54.581363 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-595c8\" (UniqueName: \"kubernetes.io/projected/42238e40-b926-4c85-b19d-7732697257a8-kube-api-access-595c8\") pod \"42238e40-b926-4c85-b19d-7732697257a8\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") "
Jul 12 00:43:54.581363 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581372    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-dshm\") pod \"42238e40-b926-4c85-b19d-7732697257a8\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") "
Jul 12 00:43:54.581613 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581403    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-model-cache\") pod \"42238e40-b926-4c85-b19d-7732697257a8\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") "
Jul 12 00:43:54.581613 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581435    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-home\") pod \"42238e40-b926-4c85-b19d-7732697257a8\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") "
Jul 12 00:43:54.581613 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581478    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-tmp-dir\") pod \"42238e40-b926-4c85-b19d-7732697257a8\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") "
Jul 12 00:43:54.581613 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581523    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42238e40-b926-4c85-b19d-7732697257a8-tls-certs\") pod \"42238e40-b926-4c85-b19d-7732697257a8\" (UID: \"42238e40-b926-4c85-b19d-7732697257a8\") "
Jul 12 00:43:54.581838 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581765    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-home" (OuterVolumeSpecName: "home") pod "42238e40-b926-4c85-b19d-7732697257a8" (UID: "42238e40-b926-4c85-b19d-7732697257a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:54.581838 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581786    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "42238e40-b926-4c85-b19d-7732697257a8" (UID: "42238e40-b926-4c85-b19d-7732697257a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:54.581838 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.581780    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42238e40-b926-4c85-b19d-7732697257a8" (UID: "42238e40-b926-4c85-b19d-7732697257a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:54.583696 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.583671    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42238e40-b926-4c85-b19d-7732697257a8-kube-api-access-595c8" (OuterVolumeSpecName: "kube-api-access-595c8") pod "42238e40-b926-4c85-b19d-7732697257a8" (UID: "42238e40-b926-4c85-b19d-7732697257a8"). InnerVolumeSpecName "kube-api-access-595c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:54.583696 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.583689    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42238e40-b926-4c85-b19d-7732697257a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42238e40-b926-4c85-b19d-7732697257a8" (UID: "42238e40-b926-4c85-b19d-7732697257a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 00:43:54.583857 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.583670    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-dshm" (OuterVolumeSpecName: "dshm") pod "42238e40-b926-4c85-b19d-7732697257a8" (UID: "42238e40-b926-4c85-b19d-7732697257a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 00:43:54.682770 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.682670    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-595c8\" (UniqueName: \"kubernetes.io/projected/42238e40-b926-4c85-b19d-7732697257a8-kube-api-access-595c8\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:54.682770 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.682706    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-dshm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:54.682770 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.682718    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-model-cache\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:54.682770 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.682727    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-home\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:54.682770 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.682735    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42238e40-b926-4c85-b19d-7732697257a8-tmp-dir\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:54.682770 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:54.682742    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42238e40-b926-4c85-b19d-7732697257a8-tls-certs\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:55.230638 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.230598    2583 generic.go:356] "Generic (PLEG): container finished" podID="42238e40-b926-4c85-b19d-7732697257a8" containerID="4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f" exitCode=0
Jul 12 00:43:55.231098 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.230643    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"
Jul 12 00:43:55.231098 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.230680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27" event={"ID":"42238e40-b926-4c85-b19d-7732697257a8","Type":"ContainerDied","Data":"4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f"}
Jul 12 00:43:55.231098 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.230733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27" event={"ID":"42238e40-b926-4c85-b19d-7732697257a8","Type":"ContainerDied","Data":"1e165fa6f7555781a425ed75bba2008c6ed8b62d792ccb3b332093644a78319d"}
Jul 12 00:43:55.231098 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.230751    2583 scope.go:117] "RemoveContainer" containerID="4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f"
Jul 12 00:43:55.242221 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.242192    2583 scope.go:117] "RemoveContainer" containerID="4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f"
Jul 12 00:43:55.242607 ip-10-0-134-216 kubenswrapper[2583]: E0712 00:43:55.242579    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f\": container with ID starting with 4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f not found: ID does not exist" containerID="4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f"
Jul 12 00:43:55.242659 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.242627    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f"} err="failed to get container status \"4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f\": rpc error: code = NotFound desc = could not find container \"4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f\": container with ID starting with 4d3aa8c0c69cf63a07bec94a9ad34a3a176cbd365402c45045a35f574f46508f not found: ID does not exist"
Jul 12 00:43:55.248185 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.248116    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"]
Jul 12 00:43:55.251472 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.251433    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-39949b/rate-test-model-39949b-kserve-f6986b875-5nq27"]
Jul 12 00:43:55.389958 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.389925    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:55.408906 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.408873    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7508-140265891181600_f2d8f375-6966-480c-aabe-b51ae5cea463/test-curl-7508-140265891181600/0.log"
Jul 12 00:43:55.432535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.432491    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:55.435745 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.435711    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:55.490906 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.490811    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9fp9\" (UniqueName: \"kubernetes.io/projected/f2d8f375-6966-480c-aabe-b51ae5cea463-kube-api-access-r9fp9\") pod \"f2d8f375-6966-480c-aabe-b51ae5cea463\" (UID: \"f2d8f375-6966-480c-aabe-b51ae5cea463\") "
Jul 12 00:43:55.493135 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.493102    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d8f375-6966-480c-aabe-b51ae5cea463-kube-api-access-r9fp9" (OuterVolumeSpecName: "kube-api-access-r9fp9") pod "f2d8f375-6966-480c-aabe-b51ae5cea463" (UID: "f2d8f375-6966-480c-aabe-b51ae5cea463"). InnerVolumeSpecName "kube-api-access-r9fp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:55.560632 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.560588    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:55.561000 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.560987    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42238e40-b926-4c85-b19d-7732697257a8" containerName="main"
Jul 12 00:43:55.561097 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.561001    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="42238e40-b926-4c85-b19d-7732697257a8" containerName="main"
Jul 12 00:43:55.561097 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.561017    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d8f375-6966-480c-aabe-b51ae5cea463" containerName="test-curl-7508-140265891181600"
Jul 12 00:43:55.561097 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.561023    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d8f375-6966-480c-aabe-b51ae5cea463" containerName="test-curl-7508-140265891181600"
Jul 12 00:43:55.561097 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.561096    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d8f375-6966-480c-aabe-b51ae5cea463" containerName="test-curl-7508-140265891181600"
Jul 12 00:43:55.561237 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.561106    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="42238e40-b926-4c85-b19d-7732697257a8" containerName="main"
Jul 12 00:43:55.564229 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.564206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:55.569680 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.569649    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:55.591881 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.591844    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9fp9\" (UniqueName: \"kubernetes.io/projected/f2d8f375-6966-480c-aabe-b51ae5cea463-kube-api-access-r9fp9\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:55.692938 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.692897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z429k\" (UniqueName: \"kubernetes.io/projected/0b57fa26-9bfc-43e1-8eed-54541b2ff000-kube-api-access-z429k\") pod \"test-curl-7508-140265891181600\" (UID: \"0b57fa26-9bfc-43e1-8eed-54541b2ff000\") " pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:55.794505 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.794390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z429k\" (UniqueName: \"kubernetes.io/projected/0b57fa26-9bfc-43e1-8eed-54541b2ff000-kube-api-access-z429k\") pod \"test-curl-7508-140265891181600\" (UID: \"0b57fa26-9bfc-43e1-8eed-54541b2ff000\") " pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:55.802938 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.802892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z429k\" (UniqueName: \"kubernetes.io/projected/0b57fa26-9bfc-43e1-8eed-54541b2ff000-kube-api-access-z429k\") pod \"test-curl-7508-140265891181600\" (UID: \"0b57fa26-9bfc-43e1-8eed-54541b2ff000\") " pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:55.875810 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:55.875767    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:56.019996 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:56.019968    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:56.021857 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:43:56.021834    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b57fa26_9bfc_43e1_8eed_54541b2ff000.slice/crio-987356be0bb91f524d6fa4954ed391552a15d35b1263c1d811766f6779c26eb6 WatchSource:0}: Error finding container 987356be0bb91f524d6fa4954ed391552a15d35b1263c1d811766f6779c26eb6: Status 404 returned error can't find the container with id 987356be0bb91f524d6fa4954ed391552a15d35b1263c1d811766f6779c26eb6
Jul 12 00:43:56.246076 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:56.246017    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13c9e1ec62cfc2f3ad8f620de08945ef7a59597f152a08284df450bf3eb03a74"
Jul 12 00:43:56.246076 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:56.246027    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:56.248499 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:56.248464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891181600" event={"ID":"0b57fa26-9bfc-43e1-8eed-54541b2ff000","Type":"ContainerStarted","Data":"987356be0bb91f524d6fa4954ed391552a15d35b1263c1d811766f6779c26eb6"}
Jul 12 00:43:56.258667 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:56.258631    2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7508-140265891181600" oldPodUID="f2d8f375-6966-480c-aabe-b51ae5cea463" podUID="0b57fa26-9bfc-43e1-8eed-54541b2ff000"
Jul 12 00:43:56.783324 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:56.783284    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42238e40-b926-4c85-b19d-7732697257a8" path="/var/lib/kubelet/pods/42238e40-b926-4c85-b19d-7732697257a8/volumes"
Jul 12 00:43:56.783661 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:56.783647    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2d8f375-6966-480c-aabe-b51ae5cea463" path="/var/lib/kubelet/pods/f2d8f375-6966-480c-aabe-b51ae5cea463/volumes"
Jul 12 00:43:57.255435 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:57.255398    2583 generic.go:356] "Generic (PLEG): container finished" podID="0b57fa26-9bfc-43e1-8eed-54541b2ff000" containerID="3d81cbea18483d0ef8bb82e30ed5e956cf91ab39839bc1d88fb6e674b9dc7d66" exitCode=0
Jul 12 00:43:57.255435 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:57.255438    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7508-140265891181600" event={"ID":"0b57fa26-9bfc-43e1-8eed-54541b2ff000","Type":"ContainerDied","Data":"3d81cbea18483d0ef8bb82e30ed5e956cf91ab39839bc1d88fb6e674b9dc7d66"}
Jul 12 00:43:58.417932 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.417901    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:58.436776 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.436738    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7508-140265891181600_0b57fa26-9bfc-43e1-8eed-54541b2ff000/test-curl-7508-140265891181600/0.log"
Jul 12 00:43:58.463363 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.463326    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:58.465910 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.465881    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7508-140265891181600"]
Jul 12 00:43:58.519177 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.519080    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z429k\" (UniqueName: \"kubernetes.io/projected/0b57fa26-9bfc-43e1-8eed-54541b2ff000-kube-api-access-z429k\") pod \"0b57fa26-9bfc-43e1-8eed-54541b2ff000\" (UID: \"0b57fa26-9bfc-43e1-8eed-54541b2ff000\") "
Jul 12 00:43:58.521394 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.521360    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b57fa26-9bfc-43e1-8eed-54541b2ff000-kube-api-access-z429k" (OuterVolumeSpecName: "kube-api-access-z429k") pod "0b57fa26-9bfc-43e1-8eed-54541b2ff000" (UID: "0b57fa26-9bfc-43e1-8eed-54541b2ff000"). InnerVolumeSpecName "kube-api-access-z429k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 00:43:58.620177 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.620135    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z429k\" (UniqueName: \"kubernetes.io/projected/0b57fa26-9bfc-43e1-8eed-54541b2ff000-kube-api-access-z429k\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:43:58.642971 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.642934    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"]
Jul 12 00:43:58.643403 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.643384    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b57fa26-9bfc-43e1-8eed-54541b2ff000" containerName="test-curl-7508-140265891181600"
Jul 12 00:43:58.643513 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.643405    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b57fa26-9bfc-43e1-8eed-54541b2ff000" containerName="test-curl-7508-140265891181600"
Jul 12 00:43:58.643565 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.643517    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b57fa26-9bfc-43e1-8eed-54541b2ff000" containerName="test-curl-7508-140265891181600"
Jul 12 00:43:58.646672 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.646648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"
Jul 12 00:43:58.649356 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.649322    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:43:58.649498 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.649366    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:43:58.653300 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.653268    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"]
Jul 12 00:43:58.720922 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.720881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cae2f0-ea49-46c8-b586-8882e2c28551-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n\" (UID: \"24cae2f0-ea49-46c8-b586-8882e2c28551\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"
Jul 12 00:43:58.782482 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.782387    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b57fa26-9bfc-43e1-8eed-54541b2ff000" path="/var/lib/kubelet/pods/0b57fa26-9bfc-43e1-8eed-54541b2ff000/volumes"
Jul 12 00:43:58.822026 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.821979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cae2f0-ea49-46c8-b586-8882e2c28551-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n\" (UID: \"24cae2f0-ea49-46c8-b586-8882e2c28551\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"
Jul 12 00:43:58.822742 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.822712    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cae2f0-ea49-46c8-b586-8882e2c28551-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n\" (UID: \"24cae2f0-ea49-46c8-b586-8882e2c28551\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"
Jul 12 00:43:58.960856 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:58.960812    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"
Jul 12 00:43:59.119295 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:59.119265    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"]
Jul 12 00:43:59.121281 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:43:59.121247    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24cae2f0_ea49_46c8_b586_8882e2c28551.slice/crio-dd1cd1aa7f9b31a6319daf8d3c4a0f80eeae32faea1680159801aa5ddfea7c01 WatchSource:0}: Error finding container dd1cd1aa7f9b31a6319daf8d3c4a0f80eeae32faea1680159801aa5ddfea7c01: Status 404 returned error can't find the container with id dd1cd1aa7f9b31a6319daf8d3c4a0f80eeae32faea1680159801aa5ddfea7c01
Jul 12 00:43:59.268537 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:59.268498    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7508-140265891181600"
Jul 12 00:43:59.268737 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:59.268512    2583 scope.go:117] "RemoveContainer" containerID="3d81cbea18483d0ef8bb82e30ed5e956cf91ab39839bc1d88fb6e674b9dc7d66"
Jul 12 00:43:59.270078 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:43:59.269912    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n" event={"ID":"24cae2f0-ea49-46c8-b586-8882e2c28551","Type":"ContainerStarted","Data":"dd1cd1aa7f9b31a6319daf8d3c4a0f80eeae32faea1680159801aa5ddfea7c01"}
Jul 12 00:44:00.278086 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:00.278049    2583 generic.go:356] "Generic (PLEG): container finished" podID="24cae2f0-ea49-46c8-b586-8882e2c28551" containerID="0a98e511653c9eef408471389c5e784bdbf20d852fa2ac2e893f5a30276265e5" exitCode=0
Jul 12 00:44:00.278508 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:00.278121    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n" event={"ID":"24cae2f0-ea49-46c8-b586-8882e2c28551","Type":"ContainerDied","Data":"0a98e511653c9eef408471389c5e784bdbf20d852fa2ac2e893f5a30276265e5"}
Jul 12 00:44:01.431783 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:01.431754    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"
Jul 12 00:44:01.446280 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:01.446240    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cae2f0-ea49-46c8-b586-8882e2c28551-maas-api-service-ca\") pod \"24cae2f0-ea49-46c8-b586-8882e2c28551\" (UID: \"24cae2f0-ea49-46c8-b586-8882e2c28551\") "
Jul 12 00:44:01.446887 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:01.446714    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24cae2f0-ea49-46c8-b586-8882e2c28551-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24cae2f0-ea49-46c8-b586-8882e2c28551" (UID: "24cae2f0-ea49-46c8-b586-8882e2c28551"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:44:01.447460 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:01.447424    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24cae2f0-ea49-46c8-b586-8882e2c28551-maas-api-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:44:02.290861 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:02.290819    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n"
Jul 12 00:44:02.290861 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:02.290849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n" event={"ID":"24cae2f0-ea49-46c8-b586-8882e2c28551","Type":"ContainerDied","Data":"dd1cd1aa7f9b31a6319daf8d3c4a0f80eeae32faea1680159801aa5ddfea7c01"}
Jul 12 00:44:02.291083 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:02.290909    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd1cd1aa7f9b31a6319daf8d3c4a0f80eeae32faea1680159801aa5ddfea7c01"
Jul 12 00:44:24.761792 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.761755    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"]
Jul 12 00:44:24.762380 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.762296    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24cae2f0-ea49-46c8-b586-8882e2c28551" containerName="revoke-keys"
Jul 12 00:44:24.762380 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.762311    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="24cae2f0-ea49-46c8-b586-8882e2c28551" containerName="revoke-keys"
Jul 12 00:44:24.762481 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.762391    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="24cae2f0-ea49-46c8-b586-8882e2c28551" containerName="revoke-keys"
Jul 12 00:44:24.768802 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.768434    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"
Jul 12 00:44:24.771116 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.771082    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 00:44:24.771116 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.771100    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68qpm\""
Jul 12 00:44:24.772550 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.772517    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"]
Jul 12 00:44:24.867582 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.867542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf233d1d-0d60-4124-a9f8-08b51b94ce7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl\" (UID: \"cf233d1d-0d60-4124-a9f8-08b51b94ce7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"
Jul 12 00:44:24.969184 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.969132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf233d1d-0d60-4124-a9f8-08b51b94ce7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl\" (UID: \"cf233d1d-0d60-4124-a9f8-08b51b94ce7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"
Jul 12 00:44:24.969869 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:24.969837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf233d1d-0d60-4124-a9f8-08b51b94ce7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl\" (UID: \"cf233d1d-0d60-4124-a9f8-08b51b94ce7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"
Jul 12 00:44:25.084695 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:25.084594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"
Jul 12 00:44:25.240622 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:25.240594    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"]
Jul 12 00:44:25.243674 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:44:25.243627    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf233d1d_0d60_4124_a9f8_08b51b94ce7f.slice/crio-85f40c6db06698aebdb91be7347eb5ede24932aa46bdb6514a04572a64ecbd7b WatchSource:0}: Error finding container 85f40c6db06698aebdb91be7347eb5ede24932aa46bdb6514a04572a64ecbd7b: Status 404 returned error can't find the container with id 85f40c6db06698aebdb91be7347eb5ede24932aa46bdb6514a04572a64ecbd7b
Jul 12 00:44:25.428923 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:25.428881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl" event={"ID":"cf233d1d-0d60-4124-a9f8-08b51b94ce7f","Type":"ContainerStarted","Data":"85f40c6db06698aebdb91be7347eb5ede24932aa46bdb6514a04572a64ecbd7b"}
Jul 12 00:44:26.436928 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:26.436891    2583 generic.go:356] "Generic (PLEG): container finished" podID="cf233d1d-0d60-4124-a9f8-08b51b94ce7f" containerID="69747ed96f75abf22d01beb4af16e4e9899b9881aa408aaa8bc8fc5ee82dd3ac" exitCode=0
Jul 12 00:44:26.437422 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:26.436976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl" event={"ID":"cf233d1d-0d60-4124-a9f8-08b51b94ce7f","Type":"ContainerDied","Data":"69747ed96f75abf22d01beb4af16e4e9899b9881aa408aaa8bc8fc5ee82dd3ac"}
Jul 12 00:44:27.593351 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:27.593318    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"
Jul 12 00:44:27.694894 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:27.694783    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf233d1d-0d60-4124-a9f8-08b51b94ce7f-maas-api-service-ca\") pod \"cf233d1d-0d60-4124-a9f8-08b51b94ce7f\" (UID: \"cf233d1d-0d60-4124-a9f8-08b51b94ce7f\") "
Jul 12 00:44:27.695218 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:27.695195    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf233d1d-0d60-4124-a9f8-08b51b94ce7f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cf233d1d-0d60-4124-a9f8-08b51b94ce7f" (UID: "cf233d1d-0d60-4124-a9f8-08b51b94ce7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 00:44:27.795799 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:27.795759    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf233d1d-0d60-4124-a9f8-08b51b94ce7f-maas-api-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 12 00:44:28.450326 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:28.450290    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl"
Jul 12 00:44:28.450326 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:28.450321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl" event={"ID":"cf233d1d-0d60-4124-a9f8-08b51b94ce7f","Type":"ContainerDied","Data":"85f40c6db06698aebdb91be7347eb5ede24932aa46bdb6514a04572a64ecbd7b"}
Jul 12 00:44:28.450572 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:28.450376    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85f40c6db06698aebdb91be7347eb5ede24932aa46bdb6514a04572a64ecbd7b"
Jul 12 00:44:51.180427 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:51.180387    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c9f9c8596-6hf28_a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e/authorino/0.log"
Jul 12 00:44:56.227249 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:56.227204    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bc769888b-rdxbg_6b453020-3a2c-4841-9a9b-035201ff09bb/manager/0.log"
Jul 12 00:44:56.346104 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:56.346072    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lwgvx_ad6acfff-5f4f-4fc2-a012-a531732b9647/server/0.log"
Jul 12 00:44:56.468924 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:56.468886    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w8g2d_fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4/manager/0.log"
Jul 12 00:44:56.587435 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:56.587341    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-94sfq_83c33e63-f2fa-4905-9d6d-0bea643a1867/copy-manifests/0.log"
Jul 12 00:44:56.594562 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:56.594534    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-94sfq_83c33e63-f2fa-4905-9d6d-0bea643a1867/manager/0.log"
Jul 12 00:44:57.427490 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:57.427450    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29730270-whkwz_59a1d278-524e-487d-b547-cc82dbd94a14/cleanup/0.log"
Jul 12 00:44:57.762132 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:57.762011    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-483dcb-wwjkd_b34489f7-cdf0-42c7-9d1a-a09272848caa/revoke-keys/0.log"
Jul 12 00:44:58.647339 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:58.647306    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-45be6f-pr58n_24cae2f0-ea49-46c8-b586-8882e2c28551/revoke-keys/0.log"
Jul 12 00:44:58.761372 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:58.761339    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-39949b-4rpnl_cf233d1d-0d60-4124-a9f8-08b51b94ce7f/revoke-keys/0.log"
Jul 12 00:44:59.653085 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.653047    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk_fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0/extract/0.log"
Jul 12 00:44:59.658754 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.658723    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk_fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0/util/0.log"
Jul 12 00:44:59.664879 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.664853    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk_fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0/pull/0.log"
Jul 12 00:44:59.773738 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.773702    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s_5d277fe6-a122-43c8-aa7e-8f03eb533a97/util/0.log"
Jul 12 00:44:59.779726 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.779694    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s_5d277fe6-a122-43c8-aa7e-8f03eb533a97/pull/0.log"
Jul 12 00:44:59.785795 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.785763    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s_5d277fe6-a122-43c8-aa7e-8f03eb533a97/extract/0.log"
Jul 12 00:44:59.894651 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.894624    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp_e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0/util/0.log"
Jul 12 00:44:59.901009 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.900976    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp_e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0/pull/0.log"
Jul 12 00:44:59.906964 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:44:59.906870    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp_e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0/extract/0.log"
Jul 12 00:45:00.021106 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:00.021065    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st_1eb00d54-7e37-437e-a949-cd62a414ed2b/util/0.log"
Jul 12 00:45:00.027546 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:00.027517    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st_1eb00d54-7e37-437e-a949-cd62a414ed2b/pull/0.log"
Jul 12 00:45:00.033683 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:00.033660    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st_1eb00d54-7e37-437e-a949-cd62a414ed2b/extract/0.log"
Jul 12 00:45:00.177050 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:00.176924    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c9f9c8596-6hf28_a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e/authorino/0.log"
Jul 12 00:45:00.527941 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:00.527859    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sj8lt_23a96cba-ecb6-4293-af47-ae53c4041ee9/kuadrant-console-plugin/0.log"
Jul 12 00:45:01.596820 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:01.596724    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-6flmm_bdf045ad-b9f3-4aa6-b363-278beff09a7c/kube-auth-proxy/0.log"
Jul 12 00:45:02.082915 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:02.082880    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pqcrl_1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2/payload-processing/0.log"
Jul 12 00:45:02.197514 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:02.197483    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f86fdd8d-pqx5n_b112c8c3-e2f2-4fdb-8c14-54310010d566/router/0.log"
Jul 12 00:45:02.658001 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:02.657957    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ffdlp_23433c76-7bcb-4b0c-ad10-246c570259fb/main/0.log"
Jul 12 00:45:03.118099 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:03.117989    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-cptmj_abdb4ed0-7376-4768-a5ae-fa9fa3986f7c/main/0.log"
Jul 12 00:45:07.386125 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.386082    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kpjgh/must-gather-rxsv7"]
Jul 12 00:45:07.386710 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.386570    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf233d1d-0d60-4124-a9f8-08b51b94ce7f" containerName="revoke-keys"
Jul 12 00:45:07.386710 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.386586    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf233d1d-0d60-4124-a9f8-08b51b94ce7f" containerName="revoke-keys"
Jul 12 00:45:07.386710 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.386660    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf233d1d-0d60-4124-a9f8-08b51b94ce7f" containerName="revoke-keys"
Jul 12 00:45:07.390100 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.390073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.392918 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.392890    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kpjgh\"/\"kube-root-ca.crt\""
Jul 12 00:45:07.393144 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.392936    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kpjgh\"/\"openshift-service-ca.crt\""
Jul 12 00:45:07.394230 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.394208    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kpjgh\"/\"default-dockercfg-dbv4n\""
Jul 12 00:45:07.397898 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.397866    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/must-gather-rxsv7"]
Jul 12 00:45:07.464447 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.464392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fkd7\" (UniqueName: \"kubernetes.io/projected/d538ba3d-8e95-4116-b22a-f2bb0b0881d8-kube-api-access-7fkd7\") pod \"must-gather-rxsv7\" (UID: \"d538ba3d-8e95-4116-b22a-f2bb0b0881d8\") " pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.464447 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.464452    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d538ba3d-8e95-4116-b22a-f2bb0b0881d8-must-gather-output\") pod \"must-gather-rxsv7\" (UID: \"d538ba3d-8e95-4116-b22a-f2bb0b0881d8\") " pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.565107 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.565029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fkd7\" (UniqueName: \"kubernetes.io/projected/d538ba3d-8e95-4116-b22a-f2bb0b0881d8-kube-api-access-7fkd7\") pod \"must-gather-rxsv7\" (UID: \"d538ba3d-8e95-4116-b22a-f2bb0b0881d8\") " pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.565283 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.565128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d538ba3d-8e95-4116-b22a-f2bb0b0881d8-must-gather-output\") pod \"must-gather-rxsv7\" (UID: \"d538ba3d-8e95-4116-b22a-f2bb0b0881d8\") " pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.565534 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.565514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d538ba3d-8e95-4116-b22a-f2bb0b0881d8-must-gather-output\") pod \"must-gather-rxsv7\" (UID: \"d538ba3d-8e95-4116-b22a-f2bb0b0881d8\") " pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.573935 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.573893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fkd7\" (UniqueName: \"kubernetes.io/projected/d538ba3d-8e95-4116-b22a-f2bb0b0881d8-kube-api-access-7fkd7\") pod \"must-gather-rxsv7\" (UID: \"d538ba3d-8e95-4116-b22a-f2bb0b0881d8\") " pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.701867 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.701824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/must-gather-rxsv7"
Jul 12 00:45:07.850215 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:07.850187    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/must-gather-rxsv7"]
Jul 12 00:45:07.852192 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:45:07.852159    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd538ba3d_8e95_4116_b22a_f2bb0b0881d8.slice/crio-e51daca06d068cdbbb80b5f8a757a9522257e2d0d18834be43a7b5e8b61561dd WatchSource:0}: Error finding container e51daca06d068cdbbb80b5f8a757a9522257e2d0d18834be43a7b5e8b61561dd: Status 404 returned error can't find the container with id e51daca06d068cdbbb80b5f8a757a9522257e2d0d18834be43a7b5e8b61561dd
Jul 12 00:45:08.685872 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:08.685830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/must-gather-rxsv7" event={"ID":"d538ba3d-8e95-4116-b22a-f2bb0b0881d8","Type":"ContainerStarted","Data":"e51daca06d068cdbbb80b5f8a757a9522257e2d0d18834be43a7b5e8b61561dd"}
Jul 12 00:45:09.696779 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:09.696738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/must-gather-rxsv7" event={"ID":"d538ba3d-8e95-4116-b22a-f2bb0b0881d8","Type":"ContainerStarted","Data":"288178c1751c77c080c08ee6dbf48e4aeea742e9e58d24838445ba409f4337b1"}
Jul 12 00:45:09.697332 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:09.696790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/must-gather-rxsv7" event={"ID":"d538ba3d-8e95-4116-b22a-f2bb0b0881d8","Type":"ContainerStarted","Data":"e51579d0d5e7c6c654b3666ca4e6b1db1b5302a5f28b0b8ba09714fb07703af7"}
Jul 12 00:45:09.715631 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:09.715549    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kpjgh/must-gather-rxsv7" podStartSLOduration=1.9770399090000002 podStartE2EDuration="2.715519448s" totalImagesPullingTime="738.479539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:45:09.713158499 +0000 UTC m=+2897.516067386" watchObservedRunningTime="2026-07-12 00:45:09.715519448 +0000 UTC m=+2897.518428335"
Jul 12 00:45:10.200599 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:10.200559    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hzf8m_2e31c781-af27-43f5-ba5c-91fe3e687053/global-pull-secret-syncer/0.log"
Jul 12 00:45:10.321217 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:10.321182    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dllr7_446412df-b4fa-40e1-b83f-ab84c0733f54/konnectivity-agent/0.log"
Jul 12 00:45:10.390584 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:10.390545    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-216.ec2.internal_555b18a426b488b1398d4227fda6ee59/haproxy/0.log"
Jul 12 00:45:15.172215 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.172176    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk_fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0/extract/0.log"
Jul 12 00:45:15.202768 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.202728    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk_fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0/util/0.log"
Jul 12 00:45:15.222740 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.222704    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595w4jk_fe32c8cf-3cf3-40cc-8fe2-6933fe66e0f0/pull/0.log"
Jul 12 00:45:15.248178 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.248143    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s_5d277fe6-a122-43c8-aa7e-8f03eb533a97/extract/0.log"
Jul 12 00:45:15.268755 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.268715    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s_5d277fe6-a122-43c8-aa7e-8f03eb533a97/util/0.log"
Jul 12 00:45:15.289754 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.289712    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d2k2s_5d277fe6-a122-43c8-aa7e-8f03eb533a97/pull/0.log"
Jul 12 00:45:15.314233 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.314189    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp_e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0/extract/0.log"
Jul 12 00:45:15.339605 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.339567    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp_e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0/util/0.log"
Jul 12 00:45:15.361299 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.361248    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73645qp_e3a5a4a3-37ac-4bd2-acbb-3be74c44dff0/pull/0.log"
Jul 12 00:45:15.387983 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.387945    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st_1eb00d54-7e37-437e-a949-cd62a414ed2b/extract/0.log"
Jul 12 00:45:15.407708 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.407662    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st_1eb00d54-7e37-437e-a949-cd62a414ed2b/util/0.log"
Jul 12 00:45:15.426431 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.426339    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qs5st_1eb00d54-7e37-437e-a949-cd62a414ed2b/pull/0.log"
Jul 12 00:45:15.950061 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:15.949695    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c9f9c8596-6hf28_a51ab4f6-edd8-42a3-ae2f-7a1d5d89287e/authorino/0.log"
Jul 12 00:45:16.041072 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:16.040928    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sj8lt_23a96cba-ecb6-4293-af47-ae53c4041ee9/kuadrant-console-plugin/0.log"
Jul 12 00:45:18.007166 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:18.007126    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-d4gkv_58c932fb-0b1b-4c14-a044-ae8d727f27cb/cluster-monitoring-operator/0.log"
Jul 12 00:45:18.149434 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:18.149404    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rl79_94642288-d7a7-476c-8bf8-943671c75d7a/node-exporter/0.log"
Jul 12 00:45:18.171620 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:18.171581    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rl79_94642288-d7a7-476c-8bf8-943671c75d7a/kube-rbac-proxy/0.log"
Jul 12 00:45:18.193899 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:18.193871    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rl79_94642288-d7a7-476c-8bf8-943671c75d7a/init-textfile/0.log"
Jul 12 00:45:20.143203 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:20.143170    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-z2mxp_b4884128-9626-4070-9196-631e31785a2f/networking-console-plugin/0.log"
Jul 12 00:45:20.801749 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:20.801718    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/1.log"
Jul 12 00:45:20.809818 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:20.809782    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lgm9w_b1c18cb5-2c53-4c43-ae24-e121141c1348/console-operator/2.log"
Jul 12 00:45:21.355019 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.354986    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d48fbcfc4-txmcx_f2e3d71a-a2d0-4a73-bb7d-b7ba5482073d/console/0.log"
Jul 12 00:45:21.395942 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.395908    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-tvs9q_0f72ae0d-9075-497b-bc70-c7a22f07a94d/download-server/0.log"
Jul 12 00:45:21.828378 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.828308    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"]
Jul 12 00:45:21.834807 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.834771    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:21.842448 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.840243    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"]
Jul 12 00:45:21.934630 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.934582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-proc\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:21.934848 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.934757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-lib-modules\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:21.934848 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.934806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-podres\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:21.934952 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.934853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-sys\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:21.934952 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:21.934888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8g6\" (UniqueName: \"kubernetes.io/projected/e04af27b-7da3-4b1b-825d-1f88e71eb44c-kube-api-access-wp8g6\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036003 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.035953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-lib-modules\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036238 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-podres\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036238 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036074    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-sys\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036238 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8g6\" (UniqueName: \"kubernetes.io/projected/e04af27b-7da3-4b1b-825d-1f88e71eb44c-kube-api-access-wp8g6\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036238 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036175    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-podres\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036238 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-proc\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036238 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036180    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-lib-modules\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036476 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-proc\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.036476 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.036321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04af27b-7da3-4b1b-825d-1f88e71eb44c-sys\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.044832 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.044786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8g6\" (UniqueName: \"kubernetes.io/projected/e04af27b-7da3-4b1b-825d-1f88e71eb44c-kube-api-access-wp8g6\") pod \"perf-node-gather-daemonset-6fl5l\" (UID: \"e04af27b-7da3-4b1b-825d-1f88e71eb44c\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.137612 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.137497    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-wzlm7_444cdf45-412b-444f-a834-2b829956d682/volume-data-source-validator/0.log"
Jul 12 00:45:22.162396 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.162081    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.373309 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.373282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"]
Jul 12 00:45:22.375973 ip-10-0-134-216 kubenswrapper[2583]: W0712 00:45:22.375932    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode04af27b_7da3_4b1b_825d_1f88e71eb44c.slice/crio-c4baac575a8048090495090386e47b9b41434584a32c82a2f7bc23db9395e580 WatchSource:0}: Error finding container c4baac575a8048090495090386e47b9b41434584a32c82a2f7bc23db9395e580: Status 404 returned error can't find the container with id c4baac575a8048090495090386e47b9b41434584a32c82a2f7bc23db9395e580
Jul 12 00:45:22.824297 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.824241    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l" event={"ID":"e04af27b-7da3-4b1b-825d-1f88e71eb44c","Type":"ContainerStarted","Data":"8f87ebdc45572935b3130d033d5024e00d6fbf3c1d815e502973e1d09cd0e39b"}
Jul 12 00:45:22.824578 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.824326    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:22.824578 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.824356    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l" event={"ID":"e04af27b-7da3-4b1b-825d-1f88e71eb44c","Type":"ContainerStarted","Data":"c4baac575a8048090495090386e47b9b41434584a32c82a2f7bc23db9395e580"}
Jul 12 00:45:22.842987 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:22.842925    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l" podStartSLOduration=1.842904833 podStartE2EDuration="1.842904833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 00:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:45:22.840616017 +0000 UTC m=+2910.643524917" watchObservedRunningTime="2026-07-12 00:45:22.842904833 +0000 UTC m=+2910.645813722"
Jul 12 00:45:23.285571 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:23.285537    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl8ts_e787a0be-5ca5-40bc-b7a9-1a509c40d23e/dns/0.log"
Jul 12 00:45:23.305952 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:23.305919    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl8ts_e787a0be-5ca5-40bc-b7a9-1a509c40d23e/kube-rbac-proxy/0.log"
Jul 12 00:45:23.366264 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:23.366229    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pmjfs_44efc80d-74e9-44dc-a0d2-be7d54a11c37/dns-node-resolver/0.log"
Jul 12 00:45:23.934307 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:23.934273    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29730240-dc8wf_96e7e9a9-9fb6-438d-bb97-202a1e03f637/image-pruner/0.log"
Jul 12 00:45:24.012796 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:24.012755    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk6s9_020df34c-91fe-445d-951f-bb7c6a1694b7/node-ca/0.log"
Jul 12 00:45:25.084781 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:25.084748    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-6flmm_bdf045ad-b9f3-4aa6-b363-278beff09a7c/kube-auth-proxy/0.log"
Jul 12 00:45:25.229125 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:25.229088    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pqcrl_1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2/payload-processing/0.log"
Jul 12 00:45:25.248535 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:25.248495    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f86fdd8d-pqx5n_b112c8c3-e2f2-4fdb-8c14-54310010d566/router/0.log"
Jul 12 00:45:25.979891 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:25.979851    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6t6w_a2cd73c3-c8a4-4fd0-90d4-c0a1d1ab0230/serve-healthcheck-canary/0.log"
Jul 12 00:45:26.492368 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:26.492326    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5xrjv_eb31f674-c7a0-4096-9cea-3600d61e9af7/insights-operator/0.log"
Jul 12 00:45:26.493053 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:26.493010    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5xrjv_eb31f674-c7a0-4096-9cea-3600d61e9af7/insights-operator/1.log"
Jul 12 00:45:26.630913 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:26.630874    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shmrx_5953328f-6a94-4f49-9343-535a7b265a73/kube-rbac-proxy/0.log"
Jul 12 00:45:26.648478 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:26.648440    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shmrx_5953328f-6a94-4f49-9343-535a7b265a73/exporter/0.log"
Jul 12 00:45:26.668469 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:26.668425    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shmrx_5953328f-6a94-4f49-9343-535a7b265a73/extractor/0.log"
Jul 12 00:45:28.850183 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:28.850149    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-6fl5l"
Jul 12 00:45:29.081684 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:29.081638    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bc769888b-rdxbg_6b453020-3a2c-4841-9a9b-035201ff09bb/manager/0.log"
Jul 12 00:45:29.099477 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:29.099394    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lwgvx_ad6acfff-5f4f-4fc2-a012-a531732b9647/server/0.log"
Jul 12 00:45:29.207743 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:29.207687    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w8g2d_fa79ff9e-f2a8-4643-b5ce-015aeaeda1b4/manager/0.log"
Jul 12 00:45:29.236717 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:29.236664    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-94sfq_83c33e63-f2fa-4905-9d6d-0bea643a1867/manager/0.log"
Jul 12 00:45:29.255892 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:29.255853    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-94sfq_83c33e63-f2fa-4905-9d6d-0bea643a1867/copy-manifests/0.log"
Jul 12 00:45:30.872424 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:30.872312    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bf7bdd7c5-r9zcs_c170135c-eadb-4bff-9ad0-ed62d60d63f3/manager/0.log"
Jul 12 00:45:33.133294 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:33.133255    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-6flmm_bdf045ad-b9f3-4aa6-b363-278beff09a7c/kube-auth-proxy/0.log"
Jul 12 00:45:33.251242 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:33.251200    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pqcrl_1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2/payload-processing/0.log"
Jul 12 00:45:33.266539 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:33.266506    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f86fdd8d-pqx5n_b112c8c3-e2f2-4fdb-8c14-54310010d566/router/0.log"
Jul 12 00:45:34.658479 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:34.658430    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57d6f88c78-6flmm_bdf045ad-b9f3-4aa6-b363-278beff09a7c/kube-auth-proxy/0.log"
Jul 12 00:45:34.776441 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:34.775881    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pqcrl_1c7d0cac-009d-4d2a-ac17-40d8c3a9b9c2/payload-processing/0.log"
Jul 12 00:45:34.794874 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:34.794827    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f86fdd8d-pqx5n_b112c8c3-e2f2-4fdb-8c14-54310010d566/router/0.log"
Jul 12 00:45:36.498670 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:36.498626    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tv62b_bbb3ae2c-238d-481d-a113-04517f3cdf3d/kube-storage-version-migrator-operator/1.log"
Jul 12 00:45:36.500563 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:36.500520    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tv62b_bbb3ae2c-238d-481d-a113-04517f3cdf3d/kube-storage-version-migrator-operator/0.log"
Jul 12 00:45:37.499303 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:37.499272    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-42stw_f09f9cdf-3e60-4775-81bb-8d054e27021a/kube-multus-additional-cni-plugins/0.log"
Jul 12 00:45:37.518030 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:37.517997    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-42stw_f09f9cdf-3e60-4775-81bb-8d054e27021a/egress-router-binary-copy/0.log"
Jul 12 00:45:37.538736 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:37.538707    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-42stw_f09f9cdf-3e60-4775-81bb-8d054e27021a/cni-plugins/0.log"
Jul 12 00:45:37.556839 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:37.556800    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-42stw_f09f9cdf-3e60-4775-81bb-8d054e27021a/bond-cni-plugin/0.log"
Jul 12 00:45:37.582675 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:37.582636    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-42stw_f09f9cdf-3e60-4775-81bb-8d054e27021a/routeoverride-cni/0.log"
Jul 12 00:45:37.611905 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:37.611873    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-42stw_f09f9cdf-3e60-4775-81bb-8d054e27021a/whereabouts-cni-bincopy/0.log"
Jul 12 00:45:37.664783 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:37.664742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-42stw_f09f9cdf-3e60-4775-81bb-8d054e27021a/whereabouts-cni/0.log"
Jul 12 00:45:38.085314 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:38.085265    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vg9rz_2c043f6b-5c14-4d22-b644-f469c65f3c3e/kube-multus/0.log"
Jul 12 00:45:38.104146 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:38.104112    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-72xrz_fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b/network-metrics-daemon/0.log"
Jul 12 00:45:38.116337 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:38.116303    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-72xrz_fb664c9d-cceb-40bf-ad4f-fa9477a7ae7b/kube-rbac-proxy/0.log"
Jul 12 00:45:39.081767 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:39.081722    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7hqx6_8111f40c-5c61-4622-8d2f-74f8912f1517/ovn-controller/0.log"
Jul 12 00:45:39.097848 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:39.097793    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7hqx6_8111f40c-5c61-4622-8d2f-74f8912f1517/ovn-acl-logging/0.log"
Jul 12 00:45:39.123358 ip-10-0-134-216 kubenswrapper[2583]: I0712 00:45:39.123286    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7hqx6_8111f40c-5c61-4622-8d2f-74f8912f1517/kube-rbac-proxy-node/0.log"