Jul 01 16:56:25.824071 ip-10-0-138-165 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 01 16:56:25.824084 ip-10-0-138-165 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 01 16:56:25.824091 ip-10-0-138-165 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 01 16:56:25.824333 ip-10-0-138-165 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 01 16:56:35.863281 ip-10-0-138-165 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 01 16:56:35.863297 ip-10-0-138-165 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d9db26ebd4034ee6b7f3346e615530e1 --
Jul 01 16:58:37.461735 ip-10-0-138-165 systemd[1]: Starting Kubernetes Kubelet...
Jul 01 16:58:37.754513 ip-10-0-138-165 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 16:58:37.754513 ip-10-0-138-165 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 01 16:58:37.754513 ip-10-0-138-165 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 16:58:37.754513 ip-10-0-138-165 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 01 16:58:37.754513 ip-10-0-138-165 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 16:58:37.755817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.755728    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 01 16:58:37.761725 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761702    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 16:58:37.761725 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761721    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 16:58:37.761725 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761726    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 16:58:37.761725 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761731    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761735    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761740    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761747    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761752    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761756    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761760    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761763    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761767    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761771    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761775    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761779    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761783    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761788    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761792    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761797    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761801    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761805    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761808    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761813    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 16:58:37.761968 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761816    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761820    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761824    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761828    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761832    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761835    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761839    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761843    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761850    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761855    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761859    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761864    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761869    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761873    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761878    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761882    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761887    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761891    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761895    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 16:58:37.762800 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761899    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761904    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761908    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761912    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761918    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761922    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761926    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761930    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761936    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761941    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761945    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761949    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761953    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761957    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761963    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761969    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761973    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761977    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761982    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761986    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 16:58:37.763611 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761990    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.761994    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762001    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762005    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762009    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762014    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762018    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762023    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762027    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762031    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762036    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762040    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762044    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762048    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762052    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762057    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762061    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762066    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762070    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762074    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 16:58:37.764444 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762078    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762083    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762087    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762091    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762096    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762099    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762104    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762108    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762112    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762116    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762119    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762124    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762128    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762133    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762137    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762141    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.762144    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763324    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763334    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763340    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 16:58:37.765309 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763345    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763349    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763353    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763358    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763361    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763366    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763370    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763374    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763378    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763382    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763387    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763391    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763396    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763404    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763410    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763415    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763419    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763423    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763427    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763431    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 16:58:37.766356 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763435    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763439    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763443    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763448    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763452    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763480    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763484    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763489    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763493    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763497    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763502    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763509    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763514    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763519    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763523    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763527    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763531    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763535    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763539    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763543    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 16:58:37.766911 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763548    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763553    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763558    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763562    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763566    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763570    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763574    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763580    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763584    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763588    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763592    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763597    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763601    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763605    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763609    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763613    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763617    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763621    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763625    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763629    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 16:58:37.767521 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763633    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763637    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763642    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763646    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763651    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763655    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763659    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763664    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763668    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763672    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763676    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763680    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763687    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763692    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763697    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763701    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763706    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763711    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763715    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 16:58:37.768247 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763719    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763724    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763728    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763733    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763739    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763743    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763747    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763751    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763755    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763760    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763764    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763768    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763772    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763785    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763789    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763794    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.763799    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764380    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764388    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 16:58:37.768752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764393    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764398    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764403    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764407    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764411    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764415    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764420    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764424    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764428    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764432    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764436    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764440    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764444    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764448    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764471    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764476    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764480    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764485    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764489    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764492    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 16:58:37.769268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764496    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764501    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764505    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764509    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764513    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764517    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764521    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764526    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764530    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764535    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764539    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764543    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764547    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764553    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764559    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764564    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764568    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764572    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764576    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 16:58:37.769824 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764580    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764584    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764589    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764593    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764600    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764604    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764608    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764612    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764617    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764621    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764625    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764629    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764634    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764638    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764642    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764646    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764650    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764654    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764658    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764663    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 16:58:37.770304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764667    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764672    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764680    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764684    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764688    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764693    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764697    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764701    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764705    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764709    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764713    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764717    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764721    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764725    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764729    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764733    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764737    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764741    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764745    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 16:58:37.770815 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764749    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764753    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764758    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764762    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764766    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764772    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764777    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764785    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764789    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764794    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764800    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764804    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764808    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764815    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764820    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764829    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764833    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764838    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.764842    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 16:58:37.771268 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764939    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764949    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764959    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764966    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764972    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764977    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764989    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.764996    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765001    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765006    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765011    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765018    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765023    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765028    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765032    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765037    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765042    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765047    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765053    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765057    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765062    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765067    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765073    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765079    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 01 16:58:37.771783 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765084    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765089    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765094    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765098    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765105    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765109    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765114    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765119    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765125    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765130    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765135    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765139    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765144    2569 flags.go:64] FLAG: --enable-server="true"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765148    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765156    2569 flags.go:64] FLAG: --event-burst="100"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765160    2569 flags.go:64] FLAG: --event-qps="50"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765165    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765170    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765174    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765182    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765187    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765192    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765197    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765201    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765206    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 01 16:58:37.772422 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765211    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765216    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765220    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765224    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765229    2569 flags.go:64] FLAG: --feature-gates=""
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765235    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765240    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765245    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765249    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765254    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765259    2569 flags.go:64] FLAG: --help="false"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765265    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-138-165.ec2.internal"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765270    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765274    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765279    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765284    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765290    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765294    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765299    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765303    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765307    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765311    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765316    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765320    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 01 16:58:37.773143 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765324    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765329    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765334    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765338    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765343    2569 flags.go:64] FLAG: --lock-file=""
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765347    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765352    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765357    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765365    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765370    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765375    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765379    2569 flags.go:64] FLAG: --logging-format="text"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765384    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765389    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765393    2569 flags.go:64] FLAG: --manifest-url=""
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765398    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765404    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765409    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765415    2569 flags.go:64] FLAG: --max-pods="110"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765420    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765424    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765429    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765434    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765438    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765443    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 01 16:58:37.773760 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765447    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765480    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765485    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765489    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765493    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765498    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765507    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765512    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765517    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765522    2569 flags.go:64] FLAG: --port="10250"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765526    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765531    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06241df0d3352dbb2"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765536    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765541    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765545    2569 flags.go:64] FLAG: --register-node="true"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765549    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765555    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765560    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765565    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765570    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765577    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765582    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765587    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765592    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765596    2569 flags.go:64] FLAG: --runonce="false"
Jul 01 16:58:37.774365 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765601    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765605    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765611    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765615    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765620    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765624    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765629    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765634    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765639    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765643    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765648    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765652    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765657    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765661    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765666    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765674    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765679    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765684    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765690    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765695    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765699    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765704    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765708    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765713    2569 flags.go:64] FLAG: --v="2"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765719    2569 flags.go:64] FLAG: --version="false"
Jul 01 16:58:37.775022 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765726    2569 flags.go:64] FLAG: --vmodule=""
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765732    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.765737    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765917    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765924    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765928    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765933    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765937    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765942    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765947    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765951    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765956    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765960    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765965    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765970    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765974    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765978    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765982    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765987    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765992    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 16:58:37.775633 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.765996    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766001    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766005    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766012    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766018    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766023    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766027    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766031    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766036    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766040    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766044    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766048    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766052    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766057    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766061    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766066    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766070    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766074    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766078    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 16:58:37.776115 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766082    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766086    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766091    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766095    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766100    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766104    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766108    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766112    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766116    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766120    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766125    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766129    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766133    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766137    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766141    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766148    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766152    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766156    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766160    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766164    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 16:58:37.776594 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766169    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766173    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766177    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766181    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766186    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766190    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766194    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766199    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766203    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766207    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766211    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766216    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766220    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766224    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766232    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766238    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766242    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766248    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766253    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766257    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 16:58:37.777086 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766262    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766267    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766271    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766275    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766280    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766285    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766290    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766295    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766300    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766304    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766309    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766313    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766317    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766322    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766326    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766331    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766335    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766339    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766345    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 16:58:37.777685 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766351    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766356    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766361    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.766365    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.766917    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.774449    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.774479    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.775036    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.775043    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775099    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775104    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775107    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775110    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775113    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775116    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 16:58:37.778149 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775118    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775121    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775124    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775128    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775132    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775134    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775137    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775140    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775143    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775145    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775149    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775153    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775156    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775159    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775161    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775164    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775166    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775169    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 16:58:37.778582 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775173    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775175    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775178    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775180    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775182    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775186    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775188    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775191    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775194    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775196    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775199    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775201    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775203    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775206    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775208    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775211    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775213    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775216    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775218    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775221    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 16:58:37.779014 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775223    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775225    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775228    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775230    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775233    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775235    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775237    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775240    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775242    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775246    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775249    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775252    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775254    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775257    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775260    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775263    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775265    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775269    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775271    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775274    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 16:58:37.779524 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775276    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775279    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775281    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775284    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775286    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775288    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775291    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775293    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775296    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775299    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775301    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775304    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775306    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775309    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775311    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775313    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775316    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775318    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775321    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775323    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 16:58:37.780022 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775325    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775328    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775330    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775333    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775335    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775338    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775341    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775343    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775345    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775348    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775351    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775353    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775356    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775358    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775361    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 16:58:37.780523 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.775366    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775490    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775495    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775498    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775500    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775503    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775505    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775508    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775511    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775514    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775517    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775519    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775522    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775524    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775527    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775529    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775531    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775534    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775536    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775539    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 16:58:37.780892 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775541    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775543    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775546    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775548    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775552    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775554    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775557    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775560    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775563    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775565    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775568    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775570    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775573    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775575    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775579    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775581    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775585    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775588    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775591    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775594    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 16:58:37.781363 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775596    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775599    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775602    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775604    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775607    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775610    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775613    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775615    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775618    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775620    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775623    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775625    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775628    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775630    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775633    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775636    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775639    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775642    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775645    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775647    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 16:58:37.781872 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775649    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775652    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775654    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775657    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775659    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775662    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775664    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775667    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775669    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775671    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775674    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775676    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775679    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775681    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775683    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775686    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775688    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775691    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775693    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 16:58:37.782360 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775696    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775698    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775700    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775703    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775705    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775708    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775710    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775713    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775715    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775718    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775721    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775724    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775727    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775729    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775733    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775736    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775739    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775742    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775745    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 16:58:37.782844 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775748    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:37.775750    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.775755    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.775867    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.778178    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.779246    2569 server.go:1019] "Starting client certificate rotation"
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.779347    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.779386    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.781698    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 16:58:37.783304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.782804    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 16:58:37.789951 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.789936    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 01 16:58:37.791791 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.791768    2569 log.go:25] "Validated CRI v1 image API"
Jul 01 16:58:37.794920 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.794899    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 01 16:58:37.796827 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.796807    2569 fs.go:135] Filesystem UUIDs: map[4fa6f786-a67e-4472-b601-b9094dffa548:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 93384ad6-92f3-4518-9a5b-74442b04b6b5:/dev/nvme0n1p4]
Jul 01 16:58:37.796898 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.796827    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 01 16:58:37.801568 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.801442    2569 manager.go:216] Machine: {Timestamp:2026-07-01 16:58:37.800360916 +0000 UTC m=+0.247281891 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100222 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25c15afc5bb1ea51aae7a19ab9c6bb SystemUUID:ec25c15a-fc5b-b1ea-51aa-e7a19ab9c6bb BootID:d9db26eb-d403-4ee6-b7f3-346e615530e1 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:c0:13:77:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:c0:13:77:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:5b:8e:93:d6:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 01 16:58:37.801568 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.801556    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 01 16:58:37.801759 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.801655    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 01 16:58:37.804082 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.804055    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 01 16:58:37.804238 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.804084    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 01 16:58:37.804698 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.804686    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 01 16:58:37.804795 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.804703    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 01 16:58:37.804795 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.804713    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 16:58:37.805263 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.805250    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 16:58:37.805963 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.805951    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 01 16:58:37.807558 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.807542    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 16:58:37.809520 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.809506    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 16:58:37.809651 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.809640    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 01 16:58:37.809714 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.809680    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 01 16:58:37.809714 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.809695    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 01 16:58:37.809714 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.809709    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 01 16:58:37.809827 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.809721    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 01 16:58:37.809827 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.809734    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 01 16:58:37.810141 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.810127    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 16:58:37.810205 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.810150    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 16:58:37.811825 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.811804    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 01 16:58:37.813185 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813173    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 01 16:58:37.813225 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813205    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 01 16:58:37.813747 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813734    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813751    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813760    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813781    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813790    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813795    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813802    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813807    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813813    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 01 16:58:37.813817 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813818    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 01 16:58:37.814067 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813835    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 01 16:58:37.814067 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.813841    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 01 16:58:37.815110 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.815100    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 01 16:58:37.815110 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.815109    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 01 16:58:37.818344 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.818324    2569 server.go:1268] "Started kubelet"
Jul 01 16:58:37.818425 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.818398    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 01 16:58:37.818515 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.818481    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 01 16:58:37.818576 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.818532    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 01 16:58:37.819242 ip-10-0-138-165 systemd[1]: Started Kubernetes Kubelet.
Jul 01 16:58:37.822116 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.821648    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 01 16:58:37.822474 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.822430    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 01 16:58:37.822666 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.822641    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 01 16:58:37.822846 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.822809    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 01 16:58:37.823235 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.823215    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 01 16:58:37.824273 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.824174    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 01 16:58:37.826853 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.825970    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-165.ec2.internal.18be38f2c4ae21b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-165.ec2.internal,UID:ip-10-0-138-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-165.ec2.internal,},FirstTimestamp:2026-07-01 16:58:37.818282424 +0000 UTC m=+0.265203399,LastTimestamp:2026-07-01 16:58:37.818282424 +0000 UTC m=+0.265203399,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-165.ec2.internal,}"
Jul 01 16:58:37.829795 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.829775    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 01 16:58:37.829795 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.829784    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 01 16:58:37.829920 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.829852    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:37.830304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830288    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 01 16:58:37.830472 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830441    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 01 16:58:37.830559 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830281    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 01 16:58:37.830610 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830579    2569 factory.go:55] Registering systemd factory
Jul 01 16:58:37.830610 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830594    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 01 16:58:37.830705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830620    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 01 16:58:37.830705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830630    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 01 16:58:37.830838 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830808    2569 factory.go:153] Registering CRI-O factory
Jul 01 16:58:37.830838 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830837    2569 factory.go:223] Registration of the crio container factory successfully
Jul 01 16:58:37.830943 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830883    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 01 16:58:37.830943 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830908    2569 factory.go:103] Registering Raw factory
Jul 01 16:58:37.830943 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.830928    2569 manager.go:1196] Started watching for new ooms in manager
Jul 01 16:58:37.831388 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.831372    2569 manager.go:349] Starting recovery of all containers
Jul 01 16:58:37.840438 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.840404    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 01 16:58:37.840545 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.840481    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 01 16:58:37.841799 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.841777    2569 manager.go:354] Recovery completed
Jul 01 16:58:37.845642 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.845629    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:37.847861 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.847842    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:37.847923 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.847872    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:37.847923 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.847872    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ssnr2"
Jul 01 16:58:37.847923 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.847888    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:37.848341 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.848324    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 01 16:58:37.848341 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.848339    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 01 16:58:37.848444 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.848354    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 16:58:37.848444 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.848340    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:37.849964 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.849944    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:37.850061 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.849979    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:37.850061 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.849992    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:37.850338 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.850272    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-165.ec2.internal.18be38f2c6717778  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-165.ec2.internal,UID:ip-10-0-138-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-165.ec2.internal,},FirstTimestamp:2026-07-01 16:58:37.847861112 +0000 UTC m=+0.294782090,LastTimestamp:2026-07-01 16:58:37.847861112 +0000 UTC m=+0.294782090,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-165.ec2.internal,}"
Jul 01 16:58:37.850651 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.850638    2569 policy_none.go:49] "None policy: Start"
Jul 01 16:58:37.850707 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.850653    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 01 16:58:37.850707 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.850665    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 01 16:58:37.852639 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.852627    2569 policy_none.go:47] "Start"
Jul 01 16:58:37.859827 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.859814    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ssnr2"
Jul 01 16:58:37.864877 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.864773    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-165.ec2.internal.18be38f2c671bd04  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-165.ec2.internal,UID:ip-10-0-138-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-165.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-165.ec2.internal,},FirstTimestamp:2026-07-01 16:58:37.847878916 +0000 UTC m=+0.294799903,LastTimestamp:2026-07-01 16:58:37.847878916 +0000 UTC m=+0.294799903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-165.ec2.internal,}"
Jul 01 16:58:37.886008 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.885991    2569 manager.go:337] "Starting Device Plugin manager"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.886026    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.886039    2569 server.go:87] "Starting device plugin registration server"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.886254    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.886272    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.886413    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.886530    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.886539    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.887035    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.887088    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.894423    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.895765    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.895805    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.895824    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.895854    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 01 16:58:37.910127 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.897863    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 16:58:37.986691 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.986659    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:37.987573 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.987550    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:37.987676 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.987581    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:37.987676 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.987596    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:37.987676 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.987623    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-165.ec2.internal"
Jul 01 16:58:37.996856 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.996834    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"]
Jul 01 16:58:37.996913 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.996893    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:37.997888 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.997874    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-165.ec2.internal"
Jul 01 16:58:37.997940 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:37.997894    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-165.ec2.internal\": node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:37.998429 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.998413    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:37.998519 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.998440    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:37.998519 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:37.998472    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:38.000732 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.000716    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:38.000850 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.000820    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.000899 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.000875    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:38.001643 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.001627    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:38.001732 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.001632    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:38.001732 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.001660    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:38.001732 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.001673    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:38.001732 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.001677    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:38.001732 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.001691    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:38.003877 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.003863    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.003947 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.003888    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:38.004667 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.004628    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:38.004667 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.004647    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:38.004667 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.004656    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:38.019979 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.019963    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-165.ec2.internal\" not found" node="ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.023876 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.023858    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-165.ec2.internal\" not found" node="ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.032032 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.032011    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94931912ae664b057f65d93e94955987-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"94931912ae664b057f65d93e94955987\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.032104 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.032034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94931912ae664b057f65d93e94955987-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"94931912ae664b057f65d93e94955987\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.032104 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.032051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74de3413fa164734c8b5ebbbbf272e87-config\") pod \"kube-apiserver-proxy-ip-10-0-138-165.ec2.internal\" (UID: \"74de3413fa164734c8b5ebbbbf272e87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.065123 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.065101    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.133134 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.133109    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94931912ae664b057f65d93e94955987-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"94931912ae664b057f65d93e94955987\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.133234 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.133145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94931912ae664b057f65d93e94955987-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"94931912ae664b057f65d93e94955987\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.133234 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.133168    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74de3413fa164734c8b5ebbbbf272e87-config\") pod \"kube-apiserver-proxy-ip-10-0-138-165.ec2.internal\" (UID: \"74de3413fa164734c8b5ebbbbf272e87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.133234 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.133176    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94931912ae664b057f65d93e94955987-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"94931912ae664b057f65d93e94955987\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.133234 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.133229    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94931912ae664b057f65d93e94955987-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal\" (UID: \"94931912ae664b057f65d93e94955987\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.133358 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.133230    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74de3413fa164734c8b5ebbbbf272e87-config\") pod \"kube-apiserver-proxy-ip-10-0-138-165.ec2.internal\" (UID: \"74de3413fa164734c8b5ebbbbf272e87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.165727 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.165704    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.266327 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.266253    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.322726 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.322702    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.327321 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.327171    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:38.366519 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.366496    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.466984 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.466959    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.567429 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.567405    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.667815 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.667794    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.717213 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.717191    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 16:58:38.768276 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.768255    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.779394 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.779376    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 01 16:58:38.779565 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.779548    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 16:58:38.779605 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.779580    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 16:58:38.864924 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.864879    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:53:37 +0000 UTC" deadline="2028-04-08 13:55:00.852045766 +0000 UTC"
Jul 01 16:58:38.864924 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.864920    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15524h56m21.987128861s"
Jul 01 16:58:38.868341 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.868323    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.868701 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:38.868679    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94931912ae664b057f65d93e94955987.slice/crio-602d74ca3f4991be287d6ca951666b8d26ad3c113a75289494d013546c028d38 WatchSource:0}: Error finding container 602d74ca3f4991be287d6ca951666b8d26ad3c113a75289494d013546c028d38: Status 404 returned error can't find the container with id 602d74ca3f4991be287d6ca951666b8d26ad3c113a75289494d013546c028d38
Jul 01 16:58:38.868900 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:38.868884    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74de3413fa164734c8b5ebbbbf272e87.slice/crio-452cf1de12ffa9d30eb885f309eea2bc556589a0c937ca185f7094a590d59d5e WatchSource:0}: Error finding container 452cf1de12ffa9d30eb885f309eea2bc556589a0c937ca185f7094a590d59d5e: Status 404 returned error can't find the container with id 452cf1de12ffa9d30eb885f309eea2bc556589a0c937ca185f7094a590d59d5e
Jul 01 16:58:38.873265 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.873250    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 16:58:38.898500 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.898440    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal" event={"ID":"74de3413fa164734c8b5ebbbbf272e87","Type":"ContainerStarted","Data":"452cf1de12ffa9d30eb885f309eea2bc556589a0c937ca185f7094a590d59d5e"}
Jul 01 16:58:38.899475 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.899433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" event={"ID":"94931912ae664b057f65d93e94955987","Type":"ContainerStarted","Data":"602d74ca3f4991be287d6ca951666b8d26ad3c113a75289494d013546c028d38"}
Jul 01 16:58:38.968834 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:38.968803    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:38.980887 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.980872    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 16:58:38.983345 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.983332    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 16:58:38.983418 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.983357    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 16:58:38.983418 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:38.983366    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeHasSufficientPID"
Jul 01 16:58:39.069872 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:39.069842    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-165.ec2.internal\" not found"
Jul 01 16:58:39.091865 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.091847    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 16:58:39.130248 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.130195    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:39.208096 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.208076    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 16:58:39.208837 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.208825    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal"
Jul 01 16:58:39.218248 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.218235    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 16:58:39.280677 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.280659    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 16:58:39.811703 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.811679    2569 apiserver.go:52] "Watching apiserver"
Jul 01 16:58:39.821168 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.821146    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 01 16:58:39.823444 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.823404    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xkt6f","kube-system/konnectivity-agent-k42dq","openshift-cluster-node-tuning-operator/tuned-7llzk","openshift-dns/node-resolver-r7qkz","openshift-image-registry/node-ca-rkdsj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal","openshift-multus/multus-additional-cni-plugins-8tsg5","openshift-multus/multus-p75f7","openshift-network-diagnostics/network-check-target-flncg","kube-system/global-pull-secret-syncer-wvdhd","kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45","openshift-multus/network-metrics-daemon-28fln","openshift-network-operator/iptables-alerter-dd27j"]
Jul 01 16:58:39.826266 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.825835    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.828103 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.828081    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:39.828193 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:39.828165    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:39.830139 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.830117    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 01 16:58:39.830236 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.830180    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 01 16:58:39.830533 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.830508    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.830824 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.830807    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 01 16:58:39.832485 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.830925    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 01 16:58:39.832485 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.831032    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 01 16:58:39.832485 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.831230    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8mhb6\""
Jul 01 16:58:39.834310 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.832889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.834310 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.832998    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x4wf9\""
Jul 01 16:58:39.834310 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.833566    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 01 16:58:39.834310 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.833644    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 01 16:58:39.835185 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.835129    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k769t\""
Jul 01 16:58:39.835362 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.835333    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 01 16:58:39.835574 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.835482    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 01 16:58:39.835574 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.835553    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:39.838019 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.838002    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 01 16:58:39.838116 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.838102    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 01 16:58:39.838271 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.838258    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.838327 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.838290    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nqg6l\""
Jul 01 16:58:39.838627 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.838258    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 01 16:58:39.840190 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.840175    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:39.840627 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.840606    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 01 16:58:39.841111 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841083    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 01 16:58:39.841282 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841269    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 01 16:58:39.841368 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841288    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 01 16:58:39.841423 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841410    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5tgvz\""
Jul 01 16:58:39.841423 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841419    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 01 16:58:39.841562 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841547    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 01 16:58:39.841761 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysctl-d\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.841857 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841772    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysctl-conf\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.841857 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841796    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.841857 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841820    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-kubernetes\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.841857 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-cni-multus\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842045 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-conf-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842045 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841898    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-run\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842045 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-lib-modules\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842045 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-var-lib-kubelet\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842045 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.841983    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:39.842045 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842003    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-host\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842045 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-system-cni-dir\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-cnibin\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842098    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxqns\" (UniqueName: \"kubernetes.io/projected/56491b52-96d9-46ed-8cf2-7011c9e244df-kube-api-access-vxqns\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-os-release\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842203    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5e96b5f-59f3-4b27-ac1c-0255341339c6-cni-binary-copy\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysconfig\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-systemd\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-sys\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842313    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-cni-binary-copy\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-system-cni-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842381    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-k8s-cni-cncf-io\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842398 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-netns\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-os-release\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842471    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-cnibin\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842499    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-cni-bin\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-hostroot\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842556    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-daemon-config\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-multus-certs\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842607    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdc2\" (UniqueName: \"kubernetes.io/projected/b5e96b5f-59f3-4b27-ac1c-0255341339c6-kube-api-access-vcdc2\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842639    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-modprobe-d\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842661    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-cni-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-kubelet\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842729    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-etc-kubernetes\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842751    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c96vk\" (UniqueName: \"kubernetes.io/projected/c53c1ddf-1614-4a13-93fb-f8cc474c2789-kube-api-access-c96vk\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68c9c059-1760-4892-b800-e097e21861a2-etc-tuned\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68c9c059-1760-4892-b800-e097e21861a2-tmp\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842846    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s9w7\" (UniqueName: \"kubernetes.io/projected/68c9c059-1760-4892-b800-e097e21861a2-kube-api-access-9s9w7\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-socket-dir-parent\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.842993 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.842892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.843662 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.843397    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:39.843662 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:39.843457    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:39.843902 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.843882    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 01 16:58:39.844239 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.844188    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 01 16:58:39.845344 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.845328    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xxs79\""
Jul 01 16:58:39.845707 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.845686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:39.845791 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:39.845746    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:39.848765 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.848737    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.850927 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.850914    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:39.854487 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.853654    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:39.854991 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.854970    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 01 16:58:39.855062 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.855021    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 01 16:58:39.855166 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.855151    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 01 16:58:39.855209 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.855169    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hq4hk\""
Jul 01 16:58:39.857560 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.857538    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 16:58:39.858048 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.858032    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 01 16:58:39.860137 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.859950    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 01 16:58:39.860137 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.859968    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 01 16:58:39.860284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.860174    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kh6xp\""
Jul 01 16:58:39.860284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.860239    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wc49c\""
Jul 01 16:58:39.860284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.860269    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 01 16:58:39.860660 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.860502    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 01 16:58:39.885525 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.885501    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gjf8h"
Jul 01 16:58:39.894171 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.894154    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gjf8h"
Jul 01 16:58:39.915840 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.915816    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 16:58:39.932121 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.932103    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 01 16:58:39.943302 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/802e4941-e3f7-4467-beca-9a569b62ca6a-dbus\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:39.943401 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-system-cni-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943401 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943338    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-netns\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943401 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-os-release\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.943401 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-sys-fs\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943421    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-netns\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-log-socket\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943423    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-system-cni-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943438    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-os-release\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-cnibin\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-cni-bin\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943523    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-cnibin\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-hostroot\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-multus-certs\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943572    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-cni-bin\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943583    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-hostroot\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-modprobe-d\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.943629 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943615    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-multus-certs\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943637    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-env-overrides\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943686    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-modprobe-d\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c145cde9-97cf-4583-9d5d-07bfd26e46ac-hosts-file\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943728    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-cni-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943752    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-etc-kubernetes\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c96vk\" (UniqueName: \"kubernetes.io/projected/c53c1ddf-1614-4a13-93fb-f8cc474c2789-kube-api-access-c96vk\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68c9c059-1760-4892-b800-e097e21861a2-tmp\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943805    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7hj\" (UniqueName: \"kubernetes.io/projected/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-kube-api-access-mv7hj\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943867    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/319af92a-d5fc-4fb5-81a6-4d9139adae04-agent-certs\") pod \"konnectivity-agent-k42dq\" (UID: \"319af92a-d5fc-4fb5-81a6-4d9139adae04\") " pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d342d78-4b8a-42c6-984c-39f211d365b7-iptables-alerter-script\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-socket-dir-parent\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-host\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysctl-conf\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943945    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-cni-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944099 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-device-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943992    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-etc-kubernetes\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.943984    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-cni-bin\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d342d78-4b8a-42c6-984c-39f211d365b7-host-slash\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-kubelet\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944080    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-cni-multus\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-run\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944140    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-var-lib-kubelet\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944216    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysctl-conf\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944225    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-system-cni-dir\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxqns\" (UniqueName: \"kubernetes.io/projected/56491b52-96d9-46ed-8cf2-7011c9e244df-kube-api-access-vxqns\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944292    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-host\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944296    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-socket-dir-parent\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944317    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xsrw\" (UniqueName: \"kubernetes.io/projected/782b859e-b8e9-45da-b59a-baa9aeaece97-kube-api-access-2xsrw\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944362    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-cni-multus\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-ovn\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.944705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5e96b5f-59f3-4b27-ac1c-0255341339c6-cni-binary-copy\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-systemd\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-sys\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944522    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-systemd-units\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944540    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944596    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-k8s-cni-cncf-io\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944657    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-run\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944701    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-var-lib-kubelet\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944739    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-system-cni-dir\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.945284 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945056    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-host\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.945594 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945405    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-sys\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.945594 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945483    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-systemd\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.945594 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.944556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-run-k8s-cni-cncf-io\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.945594 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945534    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-run-netns\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.945594 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-var-lib-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.945594 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-node-log\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.945803 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-cni-netd\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.945803 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945629    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5e96b5f-59f3-4b27-ac1c-0255341339c6-cni-binary-copy\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.945803 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovnkube-config\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.945803 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvxk9\" (UniqueName: \"kubernetes.io/projected/c145cde9-97cf-4583-9d5d-07bfd26e46ac-kube-api-access-lvxk9\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:39.945803 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945694    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-daemon-config\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.945803 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdc2\" (UniqueName: \"kubernetes.io/projected/b5e96b5f-59f3-4b27-ac1c-0255341339c6-kube-api-access-vcdc2\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.946030 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.946030 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945969    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-serviceca\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:39.946030 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.945997    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94wh6\" (UniqueName: \"kubernetes.io/projected/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-kube-api-access-94wh6\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:39.946178 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-kubelet\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.946178 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68c9c059-1760-4892-b800-e097e21861a2-etc-tuned\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.946178 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s9w7\" (UniqueName: \"kubernetes.io/projected/68c9c059-1760-4892-b800-e097e21861a2-kube-api-access-9s9w7\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.946178 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-socket-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.946304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.946304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.946304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946235    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-daemon-config\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.946304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysctl-d\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.946304 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.946486 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946306    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.946486 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946336    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysctl-d\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.946486 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovn-node-metrics-cert\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.946486 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946408    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-host-var-lib-kubelet\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovnkube-script-lib\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946753    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c145cde9-97cf-4583-9d5d-07bfd26e46ac-tmp-dir\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99lcq\" (UniqueName: \"kubernetes.io/projected/3d342d78-4b8a-42c6-984c-39f211d365b7-kube-api-access-99lcq\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946805    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-kubernetes\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946830    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-conf-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-lib-modules\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946866    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946869    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946893    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-cnibin\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946906    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-kubernetes\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946925    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-multus-conf-dir\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946951    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-lib-modules\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946972    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/319af92a-d5fc-4fb5-81a6-4d9139adae04-konnectivity-ca\") pod \"konnectivity-agent-k42dq\" (UID: \"319af92a-d5fc-4fb5-81a6-4d9139adae04\") " pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.946988    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-systemd\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947019    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:39.947071 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947037    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56491b52-96d9-46ed-8cf2-7011c9e244df-cnibin\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-etc-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-os-release\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947176    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysconfig\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-cni-binary-copy\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947229    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5e96b5f-59f3-4b27-ac1c-0255341339c6-os-release\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:39.947239    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947277    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68c9c059-1760-4892-b800-e097e21861a2-etc-sysconfig\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-registration-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:39.947302    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:40.447284501 +0000 UTC m=+2.894205484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947349    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-slash\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947375    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/802e4941-e3f7-4467-beca-9a569b62ca6a-kubelet-config\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:39.947771 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.947383    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.948351 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.948320    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68c9c059-1760-4892-b800-e097e21861a2-tmp\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.948391 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.948366    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56491b52-96d9-46ed-8cf2-7011c9e244df-cni-binary-copy\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.949002 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.948946    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68c9c059-1760-4892-b800-e097e21861a2-etc-tuned\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:39.953790 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.953735    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c96vk\" (UniqueName: \"kubernetes.io/projected/c53c1ddf-1614-4a13-93fb-f8cc474c2789-kube-api-access-c96vk\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:39.954427 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.954403    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdc2\" (UniqueName: \"kubernetes.io/projected/b5e96b5f-59f3-4b27-ac1c-0255341339c6-kube-api-access-vcdc2\") pod \"multus-p75f7\" (UID: \"b5e96b5f-59f3-4b27-ac1c-0255341339c6\") " pod="openshift-multus/multus-p75f7"
Jul 01 16:58:39.954850 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.954820    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxqns\" (UniqueName: \"kubernetes.io/projected/56491b52-96d9-46ed-8cf2-7011c9e244df-kube-api-access-vxqns\") pod \"multus-additional-cni-plugins-8tsg5\" (UID: \"56491b52-96d9-46ed-8cf2-7011c9e244df\") " pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:39.955282 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:39.955262    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s9w7\" (UniqueName: \"kubernetes.io/projected/68c9c059-1760-4892-b800-e097e21861a2-kube-api-access-9s9w7\") pod \"tuned-7llzk\" (UID: \"68c9c059-1760-4892-b800-e097e21861a2\") " pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:40.048128 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048128 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-serviceca\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:40.048347 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94wh6\" (UniqueName: \"kubernetes.io/projected/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-kube-api-access-94wh6\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:40.048347 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048200    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048347 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048241    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-socket-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.048347 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.048347 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048291    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048347 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovn-node-metrics-cert\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048347 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048336    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovnkube-script-lib\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c145cde9-97cf-4583-9d5d-07bfd26e46ac-tmp-dir\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048382    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99lcq\" (UniqueName: \"kubernetes.io/projected/3d342d78-4b8a-42c6-984c-39f211d365b7-kube-api-access-99lcq\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048410    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/319af92a-d5fc-4fb5-81a6-4d9139adae04-konnectivity-ca\") pod \"konnectivity-agent-k42dq\" (UID: \"319af92a-d5fc-4fb5-81a6-4d9139adae04\") " pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048431    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-systemd\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048441    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-etc-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048500    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-socket-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048538    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-registration-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048561    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-slash\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048583    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/802e4941-e3f7-4467-beca-9a569b62ca6a-kubelet-config\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048604    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/802e4941-e3f7-4467-beca-9a569b62ca6a-dbus\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048642    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-serviceca\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048685    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-systemd\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-sys-fs\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.048712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-sys-fs\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048729    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-slash\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-log-socket\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.048764    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048766    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048790    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048815    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/802e4941-e3f7-4467-beca-9a569b62ca6a-kubelet-config\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.048820    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret podName:802e4941-e3f7-4467-beca-9a569b62ca6a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:40.548802116 +0000 UTC m=+2.995723085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret") pod "global-pull-secret-syncer-wvdhd" (UID: "802e4941-e3f7-4467-beca-9a569b62ca6a") : object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048845    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-env-overrides\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048870    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c145cde9-97cf-4583-9d5d-07bfd26e46ac-hosts-file\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048899    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7hj\" (UniqueName: \"kubernetes.io/projected/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-kube-api-access-mv7hj\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/319af92a-d5fc-4fb5-81a6-4d9139adae04-agent-certs\") pod \"konnectivity-agent-k42dq\" (UID: \"319af92a-d5fc-4fb5-81a6-4d9139adae04\") " pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d342d78-4b8a-42c6-984c-39f211d365b7-iptables-alerter-script\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-host\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049024    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-device-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-cni-bin\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.049405 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049069    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d342d78-4b8a-42c6-984c-39f211d365b7-host-slash\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049092    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-kubelet\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049128    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xsrw\" (UniqueName: \"kubernetes.io/projected/782b859e-b8e9-45da-b59a-baa9aeaece97-kube-api-access-2xsrw\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049184    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-ovn\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-systemd-units\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-run-netns\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049265    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-var-lib-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049284    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovnkube-script-lib\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049338    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-node-log\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049379    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-etc-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049289    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-node-log\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.048729    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c145cde9-97cf-4583-9d5d-07bfd26e46ac-tmp-dir\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-cni-netd\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049436    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/319af92a-d5fc-4fb5-81a6-4d9139adae04-konnectivity-ca\") pod \"konnectivity-agent-k42dq\" (UID: \"319af92a-d5fc-4fb5-81a6-4d9139adae04\") " pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovnkube-config\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxk9\" (UniqueName: \"kubernetes.io/projected/c145cde9-97cf-4583-9d5d-07bfd26e46ac-kube-api-access-lvxk9\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:40.050192 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049579    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-registration-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049644    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c145cde9-97cf-4583-9d5d-07bfd26e46ac-hosts-file\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049665    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049380    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/802e4941-e3f7-4467-beca-9a569b62ca6a-dbus\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049720    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-kubelet\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049733    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-log-socket\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-env-overrides\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049777    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-cni-netd\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049789    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049771    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-host\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049782    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-run-ovn\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049833    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d342d78-4b8a-42c6-984c-39f211d365b7-host-slash\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049842    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-systemd-units\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049850    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-cni-bin\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049854    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-var-lib-openvswitch\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049850    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-host-run-netns\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.049897    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/782b859e-b8e9-45da-b59a-baa9aeaece97-device-dir\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.050449    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovnkube-config\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.050854 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.050571    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d342d78-4b8a-42c6-984c-39f211d365b7-iptables-alerter-script\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:40.051713 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.051506    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-ovn-node-metrics-cert\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.051826 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.051809    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/319af92a-d5fc-4fb5-81a6-4d9139adae04-agent-certs\") pod \"konnectivity-agent-k42dq\" (UID: \"319af92a-d5fc-4fb5-81a6-4d9139adae04\") " pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:40.062312 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.062251    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94wh6\" (UniqueName: \"kubernetes.io/projected/7449b2b4-18f4-4ef6-b2e8-65ec79091d93-kube-api-access-94wh6\") pod \"node-ca-rkdsj\" (UID: \"7449b2b4-18f4-4ef6-b2e8-65ec79091d93\") " pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:40.062543 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.062524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99lcq\" (UniqueName: \"kubernetes.io/projected/3d342d78-4b8a-42c6-984c-39f211d365b7-kube-api-access-99lcq\") pod \"iptables-alerter-dd27j\" (UID: \"3d342d78-4b8a-42c6-984c-39f211d365b7\") " pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:40.068999 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.068976    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xsrw\" (UniqueName: \"kubernetes.io/projected/782b859e-b8e9-45da-b59a-baa9aeaece97-kube-api-access-2xsrw\") pod \"aws-ebs-csi-driver-node-7dq45\" (UID: \"782b859e-b8e9-45da-b59a-baa9aeaece97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.072383 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.072365    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvxk9\" (UniqueName: \"kubernetes.io/projected/c145cde9-97cf-4583-9d5d-07bfd26e46ac-kube-api-access-lvxk9\") pod \"node-resolver-r7qkz\" (UID: \"c145cde9-97cf-4583-9d5d-07bfd26e46ac\") " pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:40.077159 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.077138    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 16:58:40.077283 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.077164    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 16:58:40.077283 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.077179    2569 projected.go:196] Error preparing data for projected volume kube-api-access-962cx for pod openshift-network-diagnostics/network-check-target-flncg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:40.077283 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.077250    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx podName:1e32674a-e257-420c-9041-07b9d37e1642 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:40.577234013 +0000 UTC m=+3.024154991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-962cx" (UniqueName: "kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx") pod "network-check-target-flncg" (UID: "1e32674a-e257-420c-9041-07b9d37e1642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:40.077831 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.077810    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7hj\" (UniqueName: \"kubernetes.io/projected/190a2135-e2dc-461b-83e9-c2e2d8bff5fd-kube-api-access-mv7hj\") pod \"ovnkube-node-xkt6f\" (UID: \"190a2135-e2dc-461b-83e9-c2e2d8bff5fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.140385 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.140356    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p75f7"
Jul 01 16:58:40.147622 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.147602    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7llzk"
Jul 01 16:58:40.157721 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.157696    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8tsg5"
Jul 01 16:58:40.162878 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.162855    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rkdsj"
Jul 01 16:58:40.171707 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.171684    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:58:40.178503 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.178479    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r7qkz"
Jul 01 16:58:40.187160 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.187139    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45"
Jul 01 16:58:40.195808 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.195791    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:58:40.201296 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.201280    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dd27j"
Jul 01 16:58:40.452388 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.452352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:40.452573 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.452547    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:40.452645 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.452627    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:41.452605292 +0000 UTC m=+3.899526267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:40.552799 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.552768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:40.552981 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.552918    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:40.552981 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.552978    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret podName:802e4941-e3f7-4467-beca-9a569b62ca6a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:41.552961941 +0000 UTC m=+3.999882922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret") pod "global-pull-secret-syncer-wvdhd" (UID: "802e4941-e3f7-4467-beca-9a569b62ca6a") : object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:40.553373 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.553349    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 16:58:40.653912 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.653866    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:40.654070 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.654026    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 16:58:40.654070 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.654055    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 16:58:40.654070 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.654071    2569 projected.go:196] Error preparing data for projected volume kube-api-access-962cx for pod openshift-network-diagnostics/network-check-target-flncg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:40.654246 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.654129    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx podName:1e32674a-e257-420c-9041-07b9d37e1642 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:41.654114205 +0000 UTC m=+4.101035167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-962cx" (UniqueName: "kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx") pod "network-check-target-flncg" (UID: "1e32674a-e257-420c-9041-07b9d37e1642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:40.889920 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.889888    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7449b2b4_18f4_4ef6_b2e8_65ec79091d93.slice/crio-2334b5ce675a369bc28caa5d71faba4ded2870cef727c407f61583890e9b832c WatchSource:0}: Error finding container 2334b5ce675a369bc28caa5d71faba4ded2870cef727c407f61583890e9b832c: Status 404 returned error can't find the container with id 2334b5ce675a369bc28caa5d71faba4ded2870cef727c407f61583890e9b832c
Jul 01 16:58:40.896312 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.896289    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:40.896442 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:40.896418    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:40.896533 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.896506    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190a2135_e2dc_461b_83e9_c2e2d8bff5fd.slice/crio-0cf090ea64f43d25c433aef07cef0150c8237b3b82579f2fe47041ef31ec9885 WatchSource:0}: Error finding container 0cf090ea64f43d25c433aef07cef0150c8237b3b82579f2fe47041ef31ec9885: Status 404 returned error can't find the container with id 0cf090ea64f43d25c433aef07cef0150c8237b3b82579f2fe47041ef31ec9885
Jul 01 16:58:40.897188 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.897166    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56491b52_96d9_46ed_8cf2_7011c9e244df.slice/crio-0ee3b6766ffec1738f098d35df00d1712ab00a95105240abe66d1f4f11c16e1c WatchSource:0}: Error finding container 0ee3b6766ffec1738f098d35df00d1712ab00a95105240abe66d1f4f11c16e1c: Status 404 returned error can't find the container with id 0ee3b6766ffec1738f098d35df00d1712ab00a95105240abe66d1f4f11c16e1c
Jul 01 16:58:40.897282 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.897198    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:53:39 +0000 UTC" deadline="2027-12-08 15:39:15.70113404 +0000 UTC"
Jul 01 16:58:40.897282 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.897223    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12598h40m34.803915984s"
Jul 01 16:58:40.898635 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.898616    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc145cde9_97cf_4583_9d5d_07bfd26e46ac.slice/crio-bf2f938f786925483069a1bc935ba056e65f38e18ca73ec84031d82a9c06fbb4 WatchSource:0}: Error finding container bf2f938f786925483069a1bc935ba056e65f38e18ca73ec84031d82a9c06fbb4: Status 404 returned error can't find the container with id bf2f938f786925483069a1bc935ba056e65f38e18ca73ec84031d82a9c06fbb4
Jul 01 16:58:40.900558 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.900209    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319af92a_d5fc_4fb5_81a6_4d9139adae04.slice/crio-ca0229dbe97160d20b7a22410930cb5906ecd273434c6d449580ed27a998d29e WatchSource:0}: Error finding container ca0229dbe97160d20b7a22410930cb5906ecd273434c6d449580ed27a998d29e: Status 404 returned error can't find the container with id ca0229dbe97160d20b7a22410930cb5906ecd273434c6d449580ed27a998d29e
Jul 01 16:58:40.901752 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.901514    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c9c059_1760_4892_b800_e097e21861a2.slice/crio-25d59588ce7d07b6cb39b242312e8b127c77c26b0909d38354fce4f3c9cfddff WatchSource:0}: Error finding container 25d59588ce7d07b6cb39b242312e8b127c77c26b0909d38354fce4f3c9cfddff: Status 404 returned error can't find the container with id 25d59588ce7d07b6cb39b242312e8b127c77c26b0909d38354fce4f3c9cfddff
Jul 01 16:58:40.902859 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.902835    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e96b5f_59f3_4b27_ac1c_0255341339c6.slice/crio-0d63e4dcb7c9546a7e383431800a05a736b6536d5f709666cc80a0ca726e94fb WatchSource:0}: Error finding container 0d63e4dcb7c9546a7e383431800a05a736b6536d5f709666cc80a0ca726e94fb: Status 404 returned error can't find the container with id 0d63e4dcb7c9546a7e383431800a05a736b6536d5f709666cc80a0ca726e94fb
Jul 01 16:58:40.907901 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.905674    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"0cf090ea64f43d25c433aef07cef0150c8237b3b82579f2fe47041ef31ec9885"}
Jul 01 16:58:40.908674 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.908624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rkdsj" event={"ID":"7449b2b4-18f4-4ef6-b2e8-65ec79091d93","Type":"ContainerStarted","Data":"2334b5ce675a369bc28caa5d71faba4ded2870cef727c407f61583890e9b832c"}
Jul 01 16:58:40.909990 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.909971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k42dq" event={"ID":"319af92a-d5fc-4fb5-81a6-4d9139adae04","Type":"ContainerStarted","Data":"ca0229dbe97160d20b7a22410930cb5906ecd273434c6d449580ed27a998d29e"}
Jul 01 16:58:40.913085 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.913046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r7qkz" event={"ID":"c145cde9-97cf-4583-9d5d-07bfd26e46ac","Type":"ContainerStarted","Data":"bf2f938f786925483069a1bc935ba056e65f38e18ca73ec84031d82a9c06fbb4"}
Jul 01 16:58:40.914145 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:40.914124    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerStarted","Data":"0ee3b6766ffec1738f098d35df00d1712ab00a95105240abe66d1f4f11c16e1c"}
Jul 01 16:58:40.929188 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:58:40.929165    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782b859e_b8e9_45da_b59a_baa9aeaece97.slice/crio-d3c60916a6ada6215073b973274b464e4f3e0a0d5f9109aa51e0682b811e01af WatchSource:0}: Error finding container d3c60916a6ada6215073b973274b464e4f3e0a0d5f9109aa51e0682b811e01af: Status 404 returned error can't find the container with id d3c60916a6ada6215073b973274b464e4f3e0a0d5f9109aa51e0682b811e01af
Jul 01 16:58:41.460870 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.460547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:41.460870 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.460813    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:41.461092 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.460892    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:43.460869105 +0000 UTC m=+5.907790071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:41.561676 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.561635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:41.561854 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.561842    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:41.561923 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.561914    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret podName:802e4941-e3f7-4467-beca-9a569b62ca6a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:43.561897016 +0000 UTC m=+6.008817984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret") pod "global-pull-secret-syncer-wvdhd" (UID: "802e4941-e3f7-4467-beca-9a569b62ca6a") : object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:41.662237 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.662199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:41.662443 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.662423    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 16:58:41.662546 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.662449    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 16:58:41.662546 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.662478    2569 projected.go:196] Error preparing data for projected volume kube-api-access-962cx for pod openshift-network-diagnostics/network-check-target-flncg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:41.662546 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.662536    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx podName:1e32674a-e257-420c-9041-07b9d37e1642 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:43.66251784 +0000 UTC m=+6.109438808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-962cx" (UniqueName: "kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx") pod "network-check-target-flncg" (UID: "1e32674a-e257-420c-9041-07b9d37e1642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:41.899309 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.899188    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:41.899844 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.899310    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:41.899844 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.899551    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:41.899844 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:41.899638    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:41.899844 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.899714    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:53:39 +0000 UTC" deadline="2028-03-21 22:29:07.325996126 +0000 UTC"
Jul 01 16:58:41.899844 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.899754    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15101h30m25.426245141s"
Jul 01 16:58:41.931093 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.931060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7llzk" event={"ID":"68c9c059-1760-4892-b800-e097e21861a2","Type":"ContainerStarted","Data":"25d59588ce7d07b6cb39b242312e8b127c77c26b0909d38354fce4f3c9cfddff"}
Jul 01 16:58:41.948524 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.948493    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p75f7" event={"ID":"b5e96b5f-59f3-4b27-ac1c-0255341339c6","Type":"ContainerStarted","Data":"0d63e4dcb7c9546a7e383431800a05a736b6536d5f709666cc80a0ca726e94fb"}
Jul 01 16:58:41.972130 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.972064    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal" event={"ID":"74de3413fa164734c8b5ebbbbf272e87","Type":"ContainerStarted","Data":"3e59df2bed0021edefc582866f47bc2c78c3a3941a67216741d8d272c8c4bcee"}
Jul 01 16:58:41.978483 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.977987    2569 generic.go:356] "Generic (PLEG): container finished" podID="94931912ae664b057f65d93e94955987" containerID="fcc99c0cf35dfe7e5010ae0d650875eef582ff5af55b5504ee1fad045de98efb" exitCode=0
Jul 01 16:58:41.978483 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.978084    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" event={"ID":"94931912ae664b057f65d93e94955987","Type":"ContainerDied","Data":"fcc99c0cf35dfe7e5010ae0d650875eef582ff5af55b5504ee1fad045de98efb"}
Jul 01 16:58:41.988898 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:41.988594    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-165.ec2.internal" podStartSLOduration=2.988574829 podStartE2EDuration="2.988574829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:41.987736695 +0000 UTC m=+4.434657680" watchObservedRunningTime="2026-07-01 16:58:41.988574829 +0000 UTC m=+4.435495814"
Jul 01 16:58:42.000602 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:42.000520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dd27j" event={"ID":"3d342d78-4b8a-42c6-984c-39f211d365b7","Type":"ContainerStarted","Data":"91b0aca4428ff87af2091afa4d4dc4294c0c5237d3f0dc74f732f923943a901d"}
Jul 01 16:58:42.029965 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:42.029882    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45" event={"ID":"782b859e-b8e9-45da-b59a-baa9aeaece97","Type":"ContainerStarted","Data":"d3c60916a6ada6215073b973274b464e4f3e0a0d5f9109aa51e0682b811e01af"}
Jul 01 16:58:42.896367 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:42.896334    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:42.896570 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:42.896499    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:43.053570 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:43.053529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" event={"ID":"94931912ae664b057f65d93e94955987","Type":"ContainerStarted","Data":"1dd6203da2772a663acfa18c938ad9efeb69a09b5b3279735e5add6987ee0f1e"}
Jul 01 16:58:43.477862 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:43.477821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:43.478075 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.478056    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:43.478156 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.478127    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:47.478108236 +0000 UTC m=+9.925029198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:43.579147 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:43.579041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:43.579340 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.579192    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:43.579340 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.579268    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret podName:802e4941-e3f7-4467-beca-9a569b62ca6a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:47.579246913 +0000 UTC m=+10.026167879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret") pod "global-pull-secret-syncer-wvdhd" (UID: "802e4941-e3f7-4467-beca-9a569b62ca6a") : object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:43.679944 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:43.679900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:43.680108 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.680080    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 16:58:43.680108 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.680102    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 16:58:43.680235 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.680114    2569 projected.go:196] Error preparing data for projected volume kube-api-access-962cx for pod openshift-network-diagnostics/network-check-target-flncg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:43.680235 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.680170    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx podName:1e32674a-e257-420c-9041-07b9d37e1642 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:47.680152429 +0000 UTC m=+10.127073397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-962cx" (UniqueName: "kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx") pod "network-check-target-flncg" (UID: "1e32674a-e257-420c-9041-07b9d37e1642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:43.898216 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:43.897582    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:43.898216 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:43.897594    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:43.898216 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.897709    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:43.898216 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:43.898110    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:44.896835 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:44.896807    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:44.897267 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:44.896915    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:45.897028 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:45.896983    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:45.897491 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:45.897130    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:45.897614 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:45.897593    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:45.897740 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:45.897717    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:46.896701 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:46.896668    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:46.896869 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:46.896807    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:47.511684 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:47.511646    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:47.512157 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.511791    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:47.512157 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.511862    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:55.511841759 +0000 UTC m=+17.958762729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:47.612950 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:47.612365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:47.612950 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.612556    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:47.612950 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.612616    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret podName:802e4941-e3f7-4467-beca-9a569b62ca6a nodeName:}" failed. No retries permitted until 2026-07-01 16:58:55.612598069 +0000 UTC m=+18.059519035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret") pod "global-pull-secret-syncer-wvdhd" (UID: "802e4941-e3f7-4467-beca-9a569b62ca6a") : object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:47.713435 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:47.713389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:47.713644 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.713627    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 16:58:47.713721 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.713652    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 16:58:47.713721 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.713665    2569 projected.go:196] Error preparing data for projected volume kube-api-access-962cx for pod openshift-network-diagnostics/network-check-target-flncg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:47.713828 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.713721    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx podName:1e32674a-e257-420c-9041-07b9d37e1642 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:55.713704623 +0000 UTC m=+18.160625610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-962cx" (UniqueName: "kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx") pod "network-check-target-flncg" (UID: "1e32674a-e257-420c-9041-07b9d37e1642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:47.902913 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:47.902833    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:47.903064 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.902953    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:47.903355 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:47.903336    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:47.903487 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:47.903425    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:48.896983 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:48.896947    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:48.897449 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:48.897075    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:49.895985 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:49.895956    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:49.896152 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:49.896084    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:49.896527 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:49.896507    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:49.896639 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:49.896577    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:50.895979 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:50.895950    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:50.896489 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:50.896078    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:51.896988 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:51.896483    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:51.896988 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:51.896539    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:51.896988 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:51.896636    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:51.896988 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:51.896758    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:52.896245 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:52.896209    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:52.896408 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:52.896347    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:53.897270 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:53.896846    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:53.897270 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:53.896976    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:53.897270 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:53.897040    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:53.897270 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:53.897160    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:54.896533 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:54.896494    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:54.896729 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:54.896642    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:55.573383 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:55.573352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:55.573763 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.573507    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:55.573763 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.573567    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:11.573548195 +0000 UTC m=+34.020469157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:58:55.674088 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:55.674052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:55.674274 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.674187    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:55.674274 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.674251    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret podName:802e4941-e3f7-4467-beca-9a569b62ca6a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:11.67423398 +0000 UTC m=+34.121154943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret") pod "global-pull-secret-syncer-wvdhd" (UID: "802e4941-e3f7-4467-beca-9a569b62ca6a") : object "kube-system"/"original-pull-secret" not registered
Jul 01 16:58:55.774409 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:55.774382    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:55.774580 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.774508    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 16:58:55.774580 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.774523    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 16:58:55.774580 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.774531    2569 projected.go:196] Error preparing data for projected volume kube-api-access-962cx for pod openshift-network-diagnostics/network-check-target-flncg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:55.774580 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.774574    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx podName:1e32674a-e257-420c-9041-07b9d37e1642 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:11.774561652 +0000 UTC m=+34.221482614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-962cx" (UniqueName: "kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx") pod "network-check-target-flncg" (UID: "1e32674a-e257-420c-9041-07b9d37e1642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:58:55.896239 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:55.896206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:55.896392 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.896330    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:55.896472 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:55.896401    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:55.896530 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:55.896511    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:56.896988 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:56.896945    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:56.897432 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:56.897057    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:57.899015 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:57.898992    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:57.899410 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:57.898994    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:57.899410 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:57.899111    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:58:57.899410 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:57.899182    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:58.896050 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:58.896015    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:58:58.896246 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:58.896158    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:58:59.896443 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:59.896409    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:58:59.896986 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:59.896569    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:58:59.896986 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:58:59.896966    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:58:59.897091 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:58:59.897053    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:00.092536 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.092209    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r7qkz" event={"ID":"c145cde9-97cf-4583-9d5d-07bfd26e46ac","Type":"ContainerStarted","Data":"c7482d4dfbf396f7fd62582ebbfe55b72b2c7ff269fe5866caced4971a56347a"}
Jul 01 16:59:00.096290 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.095576    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rkdsj" event={"ID":"7449b2b4-18f4-4ef6-b2e8-65ec79091d93","Type":"ContainerStarted","Data":"c05dec77986278ec266a5a16715910ed72199c8f49d84251ad94f10ba599e04c"}
Jul 01 16:59:00.097932 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.097865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45" event={"ID":"782b859e-b8e9-45da-b59a-baa9aeaece97","Type":"ContainerStarted","Data":"5389e9bb65ddff14350f5c34a59bbfdf03480489375244a44666457a19d01c93"}
Jul 01 16:59:00.100822 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.100563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k42dq" event={"ID":"319af92a-d5fc-4fb5-81a6-4d9139adae04","Type":"ContainerStarted","Data":"e610dd70a9708c5773e93d534ca973fc310b50fcf353039d9253982761ef45e5"}
Jul 01 16:59:00.112952 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.112866    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-165.ec2.internal" podStartSLOduration=21.112852488 podStartE2EDuration="21.112852488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:43.077844709 +0000 UTC m=+5.524765696" watchObservedRunningTime="2026-07-01 16:59:00.112852488 +0000 UTC m=+22.559773472"
Jul 01 16:59:00.130899 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.130721    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k42dq" podStartSLOduration=3.281579915 podStartE2EDuration="22.130701577s" totalImagesPullingTime="18.849121662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:00.130199232 +0000 UTC m=+22.577120219" watchObservedRunningTime="2026-07-01 16:59:00.130701577 +0000 UTC m=+22.577622561"
Jul 01 16:59:00.131061 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.131037    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r7qkz" podStartSLOduration=3.229708269 podStartE2EDuration="22.131027151s" totalImagesPullingTime="18.901318882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:00.11332348 +0000 UTC m=+22.560244655" watchObservedRunningTime="2026-07-01 16:59:00.131027151 +0000 UTC m=+22.577948195"
Jul 01 16:59:00.146763 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.146694    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rkdsj" podStartSLOduration=3.236215 podStartE2EDuration="22.146673233s" totalImagesPullingTime="18.910458233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:00.146348755 +0000 UTC m=+22.593269742" watchObservedRunningTime="2026-07-01 16:59:00.146673233 +0000 UTC m=+22.593594218"
Jul 01 16:59:00.896681 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:00.896425    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:00.897327 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:00.896720    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:59:01.104542 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.104499    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7llzk" event={"ID":"68c9c059-1760-4892-b800-e097e21861a2","Type":"ContainerStarted","Data":"56b719569c325e0d6d272e4fdda62087646140b0158a0d51b61ac8a0570882f4"}
Jul 01 16:59:01.105995 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.105969    2569 generic.go:356] "Generic (PLEG): container finished" podID="56491b52-96d9-46ed-8cf2-7011c9e244df" containerID="556fee35b2c00aa4bc2244ae0e4d5609f7b30722c44535541f720f15b04effeb" exitCode=0
Jul 01 16:59:01.106094 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.106057    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerDied","Data":"556fee35b2c00aa4bc2244ae0e4d5609f7b30722c44535541f720f15b04effeb"}
Jul 01 16:59:01.108802 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.108782    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 16:59:01.109153 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.109135    2569 generic.go:356] "Generic (PLEG): container finished" podID="190a2135-e2dc-461b-83e9-c2e2d8bff5fd" containerID="b9044d90dafa0aabe447fd94c5d89c42385d9e9d0f595cae85daaa1f93dd848a" exitCode=1
Jul 01 16:59:01.109226 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.109198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"58681da2c5a5d78875f629b8e3c71c1fdbbeb89b2437e6ffd756dbdf91ccd014"}
Jul 01 16:59:01.109281 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.109252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"7a146cba2f662fc4eca12a44ea4fc13abd1d54c56994288be45c5bab65754b5f"}
Jul 01 16:59:01.109333 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.109298    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"32b1f2f661e5f7d1b56bce1eff7c88f9a80d288cd237f69afb8a6b5e50528006"}
Jul 01 16:59:01.109333 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.109330    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"7dbae2c9b16fc45da0634246550aaf435ab74bb2792f3381f2b16578f392765b"}
Jul 01 16:59:01.109423 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.109358    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerDied","Data":"b9044d90dafa0aabe447fd94c5d89c42385d9e9d0f595cae85daaa1f93dd848a"}
Jul 01 16:59:01.109423 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.109399    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"18466898d42859d11164f0a51af094d176478f428f0f49a78accf017783b4013"}
Jul 01 16:59:01.110611 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.110588    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p75f7" event={"ID":"b5e96b5f-59f3-4b27-ac1c-0255341339c6","Type":"ContainerStarted","Data":"5acb02353350aece39636e0af66dd0aa67db710e5d1ea7beb6732c622cad5845"}
Jul 01 16:59:01.188435 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.188337    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7llzk" podStartSLOduration=5.311843754 podStartE2EDuration="24.188321379s" totalImagesPullingTime="18.876477625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:01.132667698 +0000 UTC m=+23.579588681" watchObservedRunningTime="2026-07-01 16:59:01.188321379 +0000 UTC m=+23.635242363"
Jul 01 16:59:01.211511 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.211430    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p75f7" podStartSLOduration=5.037769242 podStartE2EDuration="24.211415754s" totalImagesPullingTime="19.173646512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:01.211011119 +0000 UTC m=+23.657932103" watchObservedRunningTime="2026-07-01 16:59:01.211415754 +0000 UTC m=+23.658336738"
Jul 01 16:59:01.419319 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.419292    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 01 16:59:01.500261 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.500185    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:59:01.515371 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.515348    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:59:01.515990 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.515973    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:59:01.896281 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.896207    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:01.896436 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.896207    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:01.896436 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:01.896328    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:59:01.896436 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:01.896397    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:01.897647 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.897584    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:59:01.419310973Z","UUID":"5de1c6ac-2958-4911-a012-cd3770971857","Handler":null,"Name":"","Endpoint":""}
Jul 01 16:59:01.899295 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.899273    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 01 16:59:01.899431 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:01.899317    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 01 16:59:02.115566 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:02.115525    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dd27j" event={"ID":"3d342d78-4b8a-42c6-984c-39f211d365b7","Type":"ContainerStarted","Data":"cb6303a21f5d155b26491b54113a9eef06302686333b322bbf6d48e8b08073e4"}
Jul 01 16:59:02.117891 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:02.117850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45" event={"ID":"782b859e-b8e9-45da-b59a-baa9aeaece97","Type":"ContainerStarted","Data":"ed05dbb3d3302da5f5ecf41aae0fd34ae6fceadb0123c20ed095bf5d1083bf98"}
Jul 01 16:59:02.118735 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:02.118714    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k42dq"
Jul 01 16:59:02.149370 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:02.149266    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dd27j" podStartSLOduration=5.269195466 podStartE2EDuration="24.149242926s" totalImagesPullingTime="18.88004746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:02.132553294 +0000 UTC m=+24.579474280" watchObservedRunningTime="2026-07-01 16:59:02.149242926 +0000 UTC m=+24.596163913"
Jul 01 16:59:02.896930 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:02.896900    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:02.897107 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:02.897016    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:59:03.123074 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:03.122986    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45" event={"ID":"782b859e-b8e9-45da-b59a-baa9aeaece97","Type":"ContainerStarted","Data":"519e345dff8563fea00803219696b7053a6e161f64ee0885ede951a4e23ff2c5"}
Jul 01 16:59:03.126247 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:03.126223    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 16:59:03.126654 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:03.126626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"29889976922ed09ca3ced41b58235554a8765462c9fc49a03a52555250626b15"}
Jul 01 16:59:03.145980 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:03.145935    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dq45" podStartSLOduration=4.132473764 podStartE2EDuration="25.145921935s" totalImagesPullingTime="21.013448171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:03.145309268 +0000 UTC m=+25.592230251" watchObservedRunningTime="2026-07-01 16:59:03.145921935 +0000 UTC m=+25.592842925"
Jul 01 16:59:03.899949 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:03.899921    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:03.900114 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:03.899920    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:03.900114 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:03.900036    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:59:03.900114 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:03.900088    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:04.896663 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:04.896487    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:04.897066 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:04.896765    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:59:05.898963 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:05.898941    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:05.899544 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:05.898950    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:05.899544 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:05.899035    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:59:05.899544 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:05.899101    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:06.137521 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:06.137394    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 16:59:06.137801 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:06.137777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"a2e14bdfc829be59c306519aaabff9928913cd7feeaccb5243c4d27edcacd5f4"}
Jul 01 16:59:06.138105 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:06.138082    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:59:06.138226 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:06.138149    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:59:06.138226 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:06.138215    2569 scope.go:117] "RemoveContainer" containerID="b9044d90dafa0aabe447fd94c5d89c42385d9e9d0f595cae85daaa1f93dd848a"
Jul 01 16:59:06.163663 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:06.163642    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:59:06.896222 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:06.896188    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:06.896374 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:06.896315    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:59:07.143925 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.143718    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 16:59:07.144364 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.144252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" event={"ID":"190a2135-e2dc-461b-83e9-c2e2d8bff5fd","Type":"ContainerStarted","Data":"9a5076531a2991e8a6da55d753849f9dcc19937181d5b2116c37627c5b6f682d"}
Jul 01 16:59:07.144571 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.144543    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:59:07.146051 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.146028    2569 generic.go:356] "Generic (PLEG): container finished" podID="56491b52-96d9-46ed-8cf2-7011c9e244df" containerID="20b4dabaa8438a4de279724b2f97415719d44a0f10cf04c7739591701cc23bbc" exitCode=0
Jul 01 16:59:07.146138 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.146057    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerDied","Data":"20b4dabaa8438a4de279724b2f97415719d44a0f10cf04c7739591701cc23bbc"}
Jul 01 16:59:07.160834 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.160815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:59:07.175840 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.175802    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f" podStartSLOduration=10.232912785 podStartE2EDuration="29.17579003s" totalImagesPullingTime="18.942877245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:07.175423627 +0000 UTC m=+29.622344612" watchObservedRunningTime="2026-07-01 16:59:07.17579003 +0000 UTC m=+29.622711013"
Jul 01 16:59:07.899498 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.899451    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:07.899639 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:07.899451    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:07.899639 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:07.899598    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:59:07.899760 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:07.899661    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:08.091607 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:08.091573    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wvdhd"]
Jul 01 16:59:08.095203 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:08.095101    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28fln"]
Jul 01 16:59:08.095203 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:08.095167    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-flncg"]
Jul 01 16:59:08.095390 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:08.095263    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:08.095390 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:08.095376    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:59:08.147827 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:08.147804    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:08.148147 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:08.147809    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:08.148147 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:08.147928    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:08.148147 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:08.147996    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:59:09.152258 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:09.152183    2569 generic.go:356] "Generic (PLEG): container finished" podID="56491b52-96d9-46ed-8cf2-7011c9e244df" containerID="470671993a203dfbfb1e9010706a49366c8e2357076c7228ccb68033ee99ffcf" exitCode=0
Jul 01 16:59:09.152258 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:09.152229    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerDied","Data":"470671993a203dfbfb1e9010706a49366c8e2357076c7228ccb68033ee99ffcf"}
Jul 01 16:59:09.896473 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:09.896291    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:09.896570 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:09.896292    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:09.896605 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:09.896563    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:59:09.896692 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:09.896664    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:59:09.896755 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:09.896391    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:09.896818 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:09.896796    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:10.156750 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:10.156661    2569 generic.go:356] "Generic (PLEG): container finished" podID="56491b52-96d9-46ed-8cf2-7011c9e244df" containerID="ad0b29b8a86b5837d5cde91b2f95c24d719cd20ed3d7aa6d658845a13732fd1c" exitCode=0
Jul 01 16:59:10.156750 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:10.156712    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerDied","Data":"ad0b29b8a86b5837d5cde91b2f95c24d719cd20ed3d7aa6d658845a13732fd1c"}
Jul 01 16:59:11.593088 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:11.593054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:11.593618 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.593173    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:59:11.593618 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.593235    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:43.593219381 +0000 UTC m=+66.040140343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 16:59:11.693492 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:11.693433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:11.693673 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.693609    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 16:59:11.693726 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.693693    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret podName:802e4941-e3f7-4467-beca-9a569b62ca6a nodeName:}" failed. No retries permitted until 2026-07-01 16:59:43.693673271 +0000 UTC m=+66.140594236 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret") pod "global-pull-secret-syncer-wvdhd" (UID: "802e4941-e3f7-4467-beca-9a569b62ca6a") : object "kube-system"/"original-pull-secret" not registered
Jul 01 16:59:11.794294 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:11.794257    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:11.794493 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.794384    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 16:59:11.794493 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.794401    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 16:59:11.794493 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.794415    2569 projected.go:196] Error preparing data for projected volume kube-api-access-962cx for pod openshift-network-diagnostics/network-check-target-flncg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:59:11.794493 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.794486    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx podName:1e32674a-e257-420c-9041-07b9d37e1642 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:43.79447199 +0000 UTC m=+66.241392971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-962cx" (UniqueName: "kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx") pod "network-check-target-flncg" (UID: "1e32674a-e257-420c-9041-07b9d37e1642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 16:59:11.896163 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:11.896078    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:11.896337 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:11.896078    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:11.896337 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.896210    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flncg" podUID="1e32674a-e257-420c-9041-07b9d37e1642"
Jul 01 16:59:11.896337 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:11.896080    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:11.896337 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.896306    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28fln" podUID="c53c1ddf-1614-4a13-93fb-f8cc474c2789"
Jul 01 16:59:11.896601 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:11.896349    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvdhd" podUID="802e4941-e3f7-4467-beca-9a569b62ca6a"
Jul 01 16:59:12.836562 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.836488    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-165.ec2.internal" event="NodeReady"
Jul 01 16:59:12.836974 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.836648    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 01 16:59:12.967780 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.967729    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h66qg"]
Jul 01 16:59:12.989466 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.989424    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-56svg"]
Jul 01 16:59:12.989621 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.989572    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:12.997677 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.997654    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 01 16:59:12.999705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.997677    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 01 16:59:12.999705 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:12.997853    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm6rt\""
Jul 01 16:59:13.011671 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.011610    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.012092 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.012072    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h66qg"]
Jul 01 16:59:13.012889 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.012864    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56svg"]
Jul 01 16:59:13.015883 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.015863    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 01 16:59:13.015997 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.015967    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7mnn7\""
Jul 01 16:59:13.016114 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.016097    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 01 16:59:13.016765 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.016747    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 01 16:59:13.109273 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.109190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd661844-e21f-443c-ac88-f8632cd4e46e-cert\") pod \"ingress-canary-56svg\" (UID: \"cd661844-e21f-443c-ac88-f8632cd4e46e\") " pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.109273 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.109234    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-tmp-dir\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.109273 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.109261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8bzq\" (UniqueName: \"kubernetes.io/projected/cd661844-e21f-443c-ac88-f8632cd4e46e-kube-api-access-l8bzq\") pod \"ingress-canary-56svg\" (UID: \"cd661844-e21f-443c-ac88-f8632cd4e46e\") " pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.109526 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.109295    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-config-volume\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.109526 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.109318    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h7b9\" (UniqueName: \"kubernetes.io/projected/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-kube-api-access-7h7b9\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.109526 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.109353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.210146 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.210120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd661844-e21f-443c-ac88-f8632cd4e46e-cert\") pod \"ingress-canary-56svg\" (UID: \"cd661844-e21f-443c-ac88-f8632cd4e46e\") " pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.210146 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.210150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-tmp-dir\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.210366 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.210170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8bzq\" (UniqueName: \"kubernetes.io/projected/cd661844-e21f-443c-ac88-f8632cd4e46e-kube-api-access-l8bzq\") pod \"ingress-canary-56svg\" (UID: \"cd661844-e21f-443c-ac88-f8632cd4e46e\") " pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.210366 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.210300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-config-volume\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.210366 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.210341    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h7b9\" (UniqueName: \"kubernetes.io/projected/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-kube-api-access-7h7b9\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.210517 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.210386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.210556 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.210525    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-tmp-dir\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.210599 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:13.210579    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 16:59:13.210639 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:13.210633    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls podName:e7f5afc9-5418-490a-9c51-cfb05c4f3c09 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:13.71061538 +0000 UTC m=+36.157536350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls") pod "dns-default-h66qg" (UID: "e7f5afc9-5418-490a-9c51-cfb05c4f3c09") : secret "dns-default-metrics-tls" not found
Jul 01 16:59:13.211069 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.211041    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-config-volume\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.214882 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.214860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd661844-e21f-443c-ac88-f8632cd4e46e-cert\") pod \"ingress-canary-56svg\" (UID: \"cd661844-e21f-443c-ac88-f8632cd4e46e\") " pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.230139 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.230106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h7b9\" (UniqueName: \"kubernetes.io/projected/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-kube-api-access-7h7b9\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.237665 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.237641    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8bzq\" (UniqueName: \"kubernetes.io/projected/cd661844-e21f-443c-ac88-f8632cd4e46e-kube-api-access-l8bzq\") pod \"ingress-canary-56svg\" (UID: \"cd661844-e21f-443c-ac88-f8632cd4e46e\") " pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.321913 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.321880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56svg"
Jul 01 16:59:13.714886 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.714838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:13.715073 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:13.714997    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 16:59:13.715136 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:13.715079    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls podName:e7f5afc9-5418-490a-9c51-cfb05c4f3c09 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:14.715057759 +0000 UTC m=+37.161978930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls") pod "dns-default-h66qg" (UID: "e7f5afc9-5418-490a-9c51-cfb05c4f3c09") : secret "dns-default-metrics-tls" not found
Jul 01 16:59:13.900371 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.900343    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:13.900371 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.900375    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:13.901279 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.900546    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:13.905165 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.905142    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 16:59:13.906300 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.906281    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 16:59:13.906711 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.906685    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 16:59:13.907678 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.907660    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 16:59:13.908375 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.908356    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6lq7p\""
Jul 01 16:59:13.909249 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:13.909228    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6c472\""
Jul 01 16:59:14.613767 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:14.613547    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56svg"]
Jul 01 16:59:14.696240 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:59:14.696215    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd661844_e21f_443c_ac88_f8632cd4e46e.slice/crio-62795b5c9e0bcb6d81a2a50f623575cd99477a2d6208282b23f328cb2ccd6f5c WatchSource:0}: Error finding container 62795b5c9e0bcb6d81a2a50f623575cd99477a2d6208282b23f328cb2ccd6f5c: Status 404 returned error can't find the container with id 62795b5c9e0bcb6d81a2a50f623575cd99477a2d6208282b23f328cb2ccd6f5c
Jul 01 16:59:14.723224 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:14.723206    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:14.723357 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:14.723342    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 16:59:14.723418 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:14.723402    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls podName:e7f5afc9-5418-490a-9c51-cfb05c4f3c09 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:16.723387699 +0000 UTC m=+39.170308663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls") pod "dns-default-h66qg" (UID: "e7f5afc9-5418-490a-9c51-cfb05c4f3c09") : secret "dns-default-metrics-tls" not found
Jul 01 16:59:15.170714 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:15.170686    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56svg" event={"ID":"cd661844-e21f-443c-ac88-f8632cd4e46e","Type":"ContainerStarted","Data":"62795b5c9e0bcb6d81a2a50f623575cd99477a2d6208282b23f328cb2ccd6f5c"}
Jul 01 16:59:15.174599 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:15.174564    2569 generic.go:356] "Generic (PLEG): container finished" podID="56491b52-96d9-46ed-8cf2-7011c9e244df" containerID="8eaeae1c2916db7c1398da2f96eb13d4d53c1f208661c793c4323144eb3a35c5" exitCode=0
Jul 01 16:59:15.174741 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:15.174647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerDied","Data":"8eaeae1c2916db7c1398da2f96eb13d4d53c1f208661c793c4323144eb3a35c5"}
Jul 01 16:59:16.181299 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:16.181259    2569 generic.go:356] "Generic (PLEG): container finished" podID="56491b52-96d9-46ed-8cf2-7011c9e244df" containerID="711ebad8ad67282eedf0736e1220da8172ddd015a98c46ffb939d826c2fef082" exitCode=0
Jul 01 16:59:16.181755 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:16.181301    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerDied","Data":"711ebad8ad67282eedf0736e1220da8172ddd015a98c46ffb939d826c2fef082"}
Jul 01 16:59:16.741272 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:16.741235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:16.741484 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:16.741410    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 16:59:16.741572 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:16.741503    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls podName:e7f5afc9-5418-490a-9c51-cfb05c4f3c09 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:20.741485628 +0000 UTC m=+43.188406592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls") pod "dns-default-h66qg" (UID: "e7f5afc9-5418-490a-9c51-cfb05c4f3c09") : secret "dns-default-metrics-tls" not found
Jul 01 16:59:17.185825 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:17.185579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56svg" event={"ID":"cd661844-e21f-443c-ac88-f8632cd4e46e","Type":"ContainerStarted","Data":"b93b47a5b6b827c2ba86dededa5bb9ef696e091a11fa83ba4778c105086877da"}
Jul 01 16:59:17.190929 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:17.190897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" event={"ID":"56491b52-96d9-46ed-8cf2-7011c9e244df","Type":"ContainerStarted","Data":"097c8406f98acba4cacc9f9fed53fafd04c7379a6abd7cf1b5cb9b6e41aeacc2"}
Jul 01 16:59:17.231602 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:17.231547    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-56svg" podStartSLOduration=2.9575267 podStartE2EDuration="5.231526884s" totalImagesPullingTime="2.274000184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:17.228981643 +0000 UTC m=+39.675902628" watchObservedRunningTime="2026-07-01 16:59:17.231526884 +0000 UTC m=+39.678447846"
Jul 01 16:59:17.288056 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:17.287966    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8tsg5" podStartSLOduration=9.403888736 podStartE2EDuration="39.287949936s" totalImagesPullingTime="29.8840612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:17.284661889 +0000 UTC m=+39.731582873" watchObservedRunningTime="2026-07-01 16:59:17.287949936 +0000 UTC m=+39.734870920"
Jul 01 16:59:20.770330 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:20.770299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:20.770719 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:20.770444    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 16:59:20.770719 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:20.770517    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls podName:e7f5afc9-5418-490a-9c51-cfb05c4f3c09 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:28.770503135 +0000 UTC m=+51.217424097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls") pod "dns-default-h66qg" (UID: "e7f5afc9-5418-490a-9c51-cfb05c4f3c09") : secret "dns-default-metrics-tls" not found
Jul 01 16:59:28.822703 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:28.822668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:28.823164 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:28.822794    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 16:59:28.823164 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:28.822842    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls podName:e7f5afc9-5418-490a-9c51-cfb05c4f3c09 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:44.822829669 +0000 UTC m=+67.269750631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls") pod "dns-default-h66qg" (UID: "e7f5afc9-5418-490a-9c51-cfb05c4f3c09") : secret "dns-default-metrics-tls" not found
Jul 01 16:59:39.163475 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:39.163422    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkt6f"
Jul 01 16:59:42.432656 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.432621    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"]
Jul 01 16:59:42.434846 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.434830    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.468008 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.467981    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 01 16:59:42.468135 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.468120    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 01 16:59:42.468766 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.468752    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jrct6\""
Jul 01 16:59:42.470415 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.470397    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 01 16:59:42.470415 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.470405    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 01 16:59:42.490809 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.490786    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"]
Jul 01 16:59:42.523308 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.523287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f848807-dc14-4528-81ab-3f5f000c0ac2-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.523410 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.523334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.523410 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.523358    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffqcz\" (UniqueName: \"kubernetes.io/projected/6f848807-dc14-4528-81ab-3f5f000c0ac2-kube-api-access-ffqcz\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.589498 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.589452    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-587cf9f4d5-p6b7c"]
Jul 01 16:59:42.591191 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.591176    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.598630 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.598604    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 01 16:59:42.598791 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.598759    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 01 16:59:42.598862 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.598833    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 01 16:59:42.598862 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.598844    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8mpw5\""
Jul 01 16:59:42.598944 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.598857    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 01 16:59:42.598944 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.598871    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 01 16:59:42.598944 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.598878    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 01 16:59:42.624227 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.624372 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.624372 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffqcz\" (UniqueName: \"kubernetes.io/projected/6f848807-dc14-4528-81ab-3f5f000c0ac2-kube-api-access-ffqcz\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.624372 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624282    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-stats-auth\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.624372 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmqd\" (UniqueName: \"kubernetes.io/projected/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-kube-api-access-9qmqd\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.624372 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:42.624359    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:42.624566 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-default-certificate\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.624566 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:42.624427    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls podName:6f848807-dc14-4528-81ab-3f5f000c0ac2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:43.124413237 +0000 UTC m=+65.571334199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g9cwq" (UID: "6f848807-dc14-4528-81ab-3f5f000c0ac2") : secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:42.624566 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f848807-dc14-4528-81ab-3f5f000c0ac2-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.624566 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.624538    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.625111 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.625093    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f848807-dc14-4528-81ab-3f5f000c0ac2-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.631923 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.631895    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-587cf9f4d5-p6b7c"]
Jul 01 16:59:42.651428 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.651400    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"]
Jul 01 16:59:42.653123 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.653107    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.658242 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.658218    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 01 16:59:42.658673 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.658654    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 01 16:59:42.658775 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.658655    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 01 16:59:42.658775 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.658704    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qhj4l\""
Jul 01 16:59:42.659004 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.658989    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 01 16:59:42.663545 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.663525    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffqcz\" (UniqueName: \"kubernetes.io/projected/6f848807-dc14-4528-81ab-3f5f000c0ac2-kube-api-access-ffqcz\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:42.676278 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.676254    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"]
Jul 01 16:59:42.725388 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-default-certificate\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.725388 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725381    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07713b9d-a31e-4f52-944e-daf359a2c946-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.725624 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725415    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.725624 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07713b9d-a31e-4f52-944e-daf359a2c946-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.725624 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.725624 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-stats-auth\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.725624 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725605    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmqd\" (UniqueName: \"kubernetes.io/projected/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-kube-api-access-9qmqd\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.725855 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:42.725658    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:43.225629409 +0000 UTC m=+65.672550375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : configmap references non-existent config key: service-ca.crt
Jul 01 16:59:42.725855 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.725744    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95v8\" (UniqueName: \"kubernetes.io/projected/07713b9d-a31e-4f52-944e-daf359a2c946-kube-api-access-x95v8\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.725855 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:42.725783    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 01 16:59:42.725855 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:42.725837    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:43.225824421 +0000 UTC m=+65.672745388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : secret "router-metrics-certs-default" not found
Jul 01 16:59:42.728041 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.728012    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-default-certificate\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.728167 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.728146    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-stats-auth\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.751549 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.751519    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"]
Jul 01 16:59:42.753330 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.753311    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:42.753943 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.753925    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmqd\" (UniqueName: \"kubernetes.io/projected/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-kube-api-access-9qmqd\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:42.761557 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.761536    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 01 16:59:42.762215 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.762194    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 01 16:59:42.764509 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.764487    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fhsd6\""
Jul 01 16:59:42.764907 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.764894    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 01 16:59:42.781656 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.781632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"]
Jul 01 16:59:42.826787 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.826754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07713b9d-a31e-4f52-944e-daf359a2c946-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.826965 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.826799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07713b9d-a31e-4f52-944e-daf359a2c946-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.827055 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.826984    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:42.827055 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.827022    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nthcv\" (UniqueName: \"kubernetes.io/projected/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-kube-api-access-nthcv\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:42.827055 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.827048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95v8\" (UniqueName: \"kubernetes.io/projected/07713b9d-a31e-4f52-944e-daf359a2c946-kube-api-access-x95v8\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.827362 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.827317    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07713b9d-a31e-4f52-944e-daf359a2c946-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.829181 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.829161    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07713b9d-a31e-4f52-944e-daf359a2c946-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.850193 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.850163    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95v8\" (UniqueName: \"kubernetes.io/projected/07713b9d-a31e-4f52-944e-daf359a2c946-kube-api-access-x95v8\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2zj2s\" (UID: \"07713b9d-a31e-4f52-944e-daf359a2c946\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:42.928391 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.928346    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:42.928391 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.928390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nthcv\" (UniqueName: \"kubernetes.io/projected/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-kube-api-access-nthcv\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:42.928597 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:42.928522    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 01 16:59:42.928637 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:42.928596    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls podName:444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae nodeName:}" failed. No retries permitted until 2026-07-01 16:59:43.428579719 +0000 UTC m=+65.875500681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-xj6c4" (UID: "444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae") : secret "samples-operator-tls" not found
Jul 01 16:59:42.948091 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.948062    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nthcv\" (UniqueName: \"kubernetes.io/projected/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-kube-api-access-nthcv\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:42.962790 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:42.962770    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"
Jul 01 16:59:43.101139 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.101111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s"]
Jul 01 16:59:43.104379 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:59:43.104357    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07713b9d_a31e_4f52_944e_daf359a2c946.slice/crio-9e8bcdb4d9cbc396c2c23c86d885f671fefedb10f76795d1fd0ef91ae61942ac WatchSource:0}: Error finding container 9e8bcdb4d9cbc396c2c23c86d885f671fefedb10f76795d1fd0ef91ae61942ac: Status 404 returned error can't find the container with id 9e8bcdb4d9cbc396c2c23c86d885f671fefedb10f76795d1fd0ef91ae61942ac
Jul 01 16:59:43.129944 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.129920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:43.130074 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.130058    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:43.130122 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.130113    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls podName:6f848807-dc14-4528-81ab-3f5f000c0ac2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:44.130097376 +0000 UTC m=+66.577018338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g9cwq" (UID: "6f848807-dc14-4528-81ab-3f5f000c0ac2") : secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:43.231000 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.230961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:43.231139 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.231011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:43.231139 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.231131    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:44.231113302 +0000 UTC m=+66.678034263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : configmap references non-existent config key: service-ca.crt
Jul 01 16:59:43.231227 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.231173    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 01 16:59:43.231269 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.231239    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:44.23122689 +0000 UTC m=+66.678147852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : secret "router-metrics-certs-default" not found
Jul 01 16:59:43.251666 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.251636    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s" event={"ID":"07713b9d-a31e-4f52-944e-daf359a2c946","Type":"ContainerStarted","Data":"9e8bcdb4d9cbc396c2c23c86d885f671fefedb10f76795d1fd0ef91ae61942ac"}
Jul 01 16:59:43.432798 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.432767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:43.433154 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.432890    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 01 16:59:43.433154 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.432943    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls podName:444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae nodeName:}" failed. No retries permitted until 2026-07-01 16:59:44.432929417 +0000 UTC m=+66.879850379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-xj6c4" (UID: "444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae") : secret "samples-operator-tls" not found
Jul 01 16:59:43.634433 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.634395    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 16:59:43.637092 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.637071    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 16:59:43.645372 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.645349    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 01 16:59:43.645471 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:43.645407    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs podName:c53c1ddf-1614-4a13-93fb-f8cc474c2789 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:47.645393823 +0000 UTC m=+130.092314786 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs") pod "network-metrics-daemon-28fln" (UID: "c53c1ddf-1614-4a13-93fb-f8cc474c2789") : secret "metrics-daemon-secret" not found
Jul 01 16:59:43.735294 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.735219    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:43.738419 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.738394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 16:59:43.748173 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.748149    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/802e4941-e3f7-4467-beca-9a569b62ca6a-original-pull-secret\") pod \"global-pull-secret-syncer-wvdhd\" (UID: \"802e4941-e3f7-4467-beca-9a569b62ca6a\") " pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:43.836029 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.835994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:43.839412 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.839383    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 16:59:43.849778 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.849755    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 16:59:43.860614 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.860590    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-962cx\" (UniqueName: \"kubernetes.io/projected/1e32674a-e257-420c-9041-07b9d37e1642-kube-api-access-962cx\") pod \"network-check-target-flncg\" (UID: \"1e32674a-e257-420c-9041-07b9d37e1642\") " pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:43.912373 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.912350    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvdhd"
Jul 01 16:59:43.921619 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.921598    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6lq7p\""
Jul 01 16:59:43.928961 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:43.928929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:44.108140 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.108107    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wvdhd"]
Jul 01 16:59:44.110129 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.110112    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-flncg"]
Jul 01 16:59:44.111242 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:59:44.111210    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802e4941_e3f7_4467_beca_9a569b62ca6a.slice/crio-505946c7064dcd6cb0da3f63cba149cbc6da6fedcc39bbf71a0c0a01ce3767cb WatchSource:0}: Error finding container 505946c7064dcd6cb0da3f63cba149cbc6da6fedcc39bbf71a0c0a01ce3767cb: Status 404 returned error can't find the container with id 505946c7064dcd6cb0da3f63cba149cbc6da6fedcc39bbf71a0c0a01ce3767cb
Jul 01 16:59:44.112087 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:59:44.112059    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e32674a_e257_420c_9041_07b9d37e1642.slice/crio-bd6b3540e93ccf127f6920382e1e986634d3ccfa15c6a371a6297db1ce5911b4 WatchSource:0}: Error finding container bd6b3540e93ccf127f6920382e1e986634d3ccfa15c6a371a6297db1ce5911b4: Status 404 returned error can't find the container with id bd6b3540e93ccf127f6920382e1e986634d3ccfa15c6a371a6297db1ce5911b4
Jul 01 16:59:44.138751 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.138723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:44.138894 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.138875    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:44.138953 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.138941    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls podName:6f848807-dc14-4528-81ab-3f5f000c0ac2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:46.138920593 +0000 UTC m=+68.585841575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g9cwq" (UID: "6f848807-dc14-4528-81ab-3f5f000c0ac2") : secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:44.239979 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.239943    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:44.240178 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.239995    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:44.240178 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.240147    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 01 16:59:44.240307 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.240148    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:46.240123882 +0000 UTC m=+68.687044859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : configmap references non-existent config key: service-ca.crt
Jul 01 16:59:44.240307 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.240283    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:46.24026368 +0000 UTC m=+68.687184648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : secret "router-metrics-certs-default" not found
Jul 01 16:59:44.255729 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.255654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-flncg" event={"ID":"1e32674a-e257-420c-9041-07b9d37e1642","Type":"ContainerStarted","Data":"bd6b3540e93ccf127f6920382e1e986634d3ccfa15c6a371a6297db1ce5911b4"}
Jul 01 16:59:44.256839 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.256806    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wvdhd" event={"ID":"802e4941-e3f7-4467-beca-9a569b62ca6a","Type":"ContainerStarted","Data":"505946c7064dcd6cb0da3f63cba149cbc6da6fedcc39bbf71a0c0a01ce3767cb"}
Jul 01 16:59:44.440909 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.440874    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:44.441258 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.441025    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 01 16:59:44.441258 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.441085    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls podName:444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae nodeName:}" failed. No retries permitted until 2026-07-01 16:59:46.44106873 +0000 UTC m=+68.887989697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-xj6c4" (UID: "444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae") : secret "samples-operator-tls" not found
Jul 01 16:59:44.844079 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:44.844039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 16:59:44.844243 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.844198    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 16:59:44.844315 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:44.844247    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls podName:e7f5afc9-5418-490a-9c51-cfb05c4f3c09 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:16.844235092 +0000 UTC m=+99.291156068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls") pod "dns-default-h66qg" (UID: "e7f5afc9-5418-490a-9c51-cfb05c4f3c09") : secret "dns-default-metrics-tls" not found
Jul 01 16:59:46.157014 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.156931    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:46.157442 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.157043    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:46.157442 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.157088    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls podName:6f848807-dc14-4528-81ab-3f5f000c0ac2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:50.157075153 +0000 UTC m=+72.603996115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g9cwq" (UID: "6f848807-dc14-4528-81ab-3f5f000c0ac2") : secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:46.166730 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.165814    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w72lj"]
Jul 01 16:59:46.169130 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.169093    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.177900 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.177370    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 01 16:59:46.183249 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.183183    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 01 16:59:46.183376 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.183301    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 01 16:59:46.183376 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.183316    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 01 16:59:46.184366 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.184343    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-57ng4\""
Jul 01 16:59:46.236754 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.236701    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w72lj"]
Jul 01 16:59:46.258266 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.258059    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.258266 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.258135    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:46.258266 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.258177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:46.258266 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.258201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb9b943f-e169-4639-bf76-57a77cbb93de-data-volume\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.258657 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.258316    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:50.258292368 +0000 UTC m=+72.705213335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : configmap references non-existent config key: service-ca.crt
Jul 01 16:59:46.258657 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.258326    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 01 16:59:46.258657 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.258345    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.258657 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.258399    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:50.258379727 +0000 UTC m=+72.705300698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : secret "router-metrics-certs-default" not found
Jul 01 16:59:46.258657 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.258423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb9b943f-e169-4639-bf76-57a77cbb93de-crio-socket\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.258657 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.258506    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d8t2\" (UniqueName: \"kubernetes.io/projected/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-api-access-5d8t2\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.266003 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.265969    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s" event={"ID":"07713b9d-a31e-4f52-944e-daf359a2c946","Type":"ContainerStarted","Data":"26c4ae3e7d9bdbe03788e52dbecaaca705230fa51ccbf58be933b0349f1212be"}
Jul 01 16:59:46.309074 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.309011    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s" podStartSLOduration=1.5379923519999998 podStartE2EDuration="4.308987923s" totalImagesPullingTime="2.770995571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:46.308039031 +0000 UTC m=+68.754960016" watchObservedRunningTime="2026-07-01 16:59:46.308987923 +0000 UTC m=+68.755908908"
Jul 01 16:59:46.359056 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.359018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.359230 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.359142    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb9b943f-e169-4639-bf76-57a77cbb93de-data-volume\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.359230 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.359172    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:46.359230 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.359180    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.359392 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.359241    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 16:59:46.359392 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.359248    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:46.85922976 +0000 UTC m=+69.306150742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:46.359392 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.359285    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:46.85927476 +0000 UTC m=+69.306195722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : configmap "kube-rbac-proxy" not found
Jul 01 16:59:46.359392 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.359307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb9b943f-e169-4639-bf76-57a77cbb93de-crio-socket\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.359392 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.359356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d8t2\" (UniqueName: \"kubernetes.io/projected/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-api-access-5d8t2\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.359685 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.359534    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb9b943f-e169-4639-bf76-57a77cbb93de-crio-socket\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.359685 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.359647    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb9b943f-e169-4639-bf76-57a77cbb93de-data-volume\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.390897 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.390783    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d8t2\" (UniqueName: \"kubernetes.io/projected/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-api-access-5d8t2\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.460329 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.460245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:46.460499 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.460382    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 01 16:59:46.460499 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.460452    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls podName:444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae nodeName:}" failed. No retries permitted until 2026-07-01 16:59:50.46043633 +0000 UTC m=+72.907357291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-xj6c4" (UID: "444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae") : secret "samples-operator-tls" not found
Jul 01 16:59:46.864134 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.864097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.864327 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:46.864212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:46.864327 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.864281    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:46.864430 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.864326    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 16:59:46.864430 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.864368    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:47.864348198 +0000 UTC m=+70.311269162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:46.864430 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:46.864387    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:47.864379478 +0000 UTC m=+70.311300440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : configmap "kube-rbac-proxy" not found
Jul 01 16:59:47.872712 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:47.872674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:47.873177 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:47.872775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:47.873177 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:47.872828    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 16:59:47.873177 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:47.872883    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:47.873177 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:47.872937    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:49.872916453 +0000 UTC m=+72.319837418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : configmap "kube-rbac-proxy" not found
Jul 01 16:59:47.873177 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:47.872958    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:49.872948425 +0000 UTC m=+72.319869392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:47.999142 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:47.999107    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r7qkz_c145cde9-97cf-4583-9d5d-07bfd26e46ac/dns-node-resolver/0.log"
Jul 01 16:59:49.209727 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:49.209691    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rkdsj_7449b2b4-18f4-4ef6-b2e8-65ec79091d93/node-ca/0.log"
Jul 01 16:59:49.599332 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:49.599297    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56svg_cd661844-e21f-443c-ac88-f8632cd4e46e/serve-healthcheck-canary/0.log"
Jul 01 16:59:49.890988 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:49.890896    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:49.890988 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:49.890976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:49.891243 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:49.891082    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 16:59:49.891243 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:49.891085    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:49.891243 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:49.891137    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:53.891123354 +0000 UTC m=+76.338044316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : configmap "kube-rbac-proxy" not found
Jul 01 16:59:49.891243 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:49.891150    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 16:59:53.891144254 +0000 UTC m=+76.338065216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:50.193077 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.192985    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:50.193283 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:50.193144    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:50.193283 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:50.193209    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls podName:6f848807-dc14-4528-81ab-3f5f000c0ac2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:58.193194501 +0000 UTC m=+80.640115463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g9cwq" (UID: "6f848807-dc14-4528-81ab-3f5f000c0ac2") : secret "cluster-monitoring-operator-tls" not found
Jul 01 16:59:50.278583 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.278552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wvdhd" event={"ID":"802e4941-e3f7-4467-beca-9a569b62ca6a","Type":"ContainerStarted","Data":"b721d5ed88c8eece522f2cff59cb5f5d3cff35128af76eaebf1edd0a15048de0"}
Jul 01 16:59:50.280090 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.280070    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-flncg" event={"ID":"1e32674a-e257-420c-9041-07b9d37e1642","Type":"ContainerStarted","Data":"a58220913e5654af351ff125435a977aa1d2438eb06b2024be5b87dc1af9a086"}
Jul 01 16:59:50.280206 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.280196    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 16:59:50.293716 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.293697    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:50.293766 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.293731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:50.293847 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:50.293833    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 01 16:59:50.293882 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:50.293867    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:58.293851238 +0000 UTC m=+80.740772201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : configmap references non-existent config key: service-ca.crt
Jul 01 16:59:50.293930 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:50.293888    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs podName:0ca11c81-9695-4c5b-a62a-ad5f64b4e96f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:58.293878061 +0000 UTC m=+80.740799022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs") pod "router-default-587cf9f4d5-p6b7c" (UID: "0ca11c81-9695-4c5b-a62a-ad5f64b4e96f") : secret "router-metrics-certs-default" not found
Jul 01 16:59:50.362472 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.362407    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wvdhd" podStartSLOduration=67.193593395 podStartE2EDuration="1m12.362394087s" totalImagesPullingTime="5.168800692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:50.361900332 +0000 UTC m=+72.808821303" watchObservedRunningTime="2026-07-01 16:59:50.362394087 +0000 UTC m=+72.809315071"
Jul 01 16:59:50.412237 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.412197    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-flncg" podStartSLOduration=67.256208783 podStartE2EDuration="1m12.412182846s" totalImagesPullingTime="5.155974063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:50.411031086 +0000 UTC m=+72.857952070" watchObservedRunningTime="2026-07-01 16:59:50.412182846 +0000 UTC m=+72.859103993"
Jul 01 16:59:50.496412 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:50.496341    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:50.496549 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:50.496487    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 01 16:59:50.496549 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:50.496535    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls podName:444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae nodeName:}" failed. No retries permitted until 2026-07-01 16:59:58.496522746 +0000 UTC m=+80.943443708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-xj6c4" (UID: "444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae") : secret "samples-operator-tls" not found
Jul 01 16:59:53.925401 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:53.925368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:53.925837 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:53.925482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 16:59:53.925837 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:53.925518    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:53.925837 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:53.925575    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 17:00:01.925560158 +0000 UTC m=+84.372481121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : secret "insights-runtime-extractor-tls" not found
Jul 01 16:59:53.925837 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:53.925575    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 16:59:53.925837 ip-10-0-138-165 kubenswrapper[2569]: E0701 16:59:53.925622    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm podName:bb9b943f-e169-4639-bf76-57a77cbb93de nodeName:}" failed. No retries permitted until 2026-07-01 17:00:01.925609665 +0000 UTC m=+84.372530627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w72lj" (UID: "bb9b943f-e169-4639-bf76-57a77cbb93de") : configmap "kube-rbac-proxy" not found
Jul 01 16:59:58.262146 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.262107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:58.264686 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.264655    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f848807-dc14-4528-81ab-3f5f000c0ac2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g9cwq\" (UID: \"6f848807-dc14-4528-81ab-3f5f000c0ac2\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:58.343561 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.343450    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"
Jul 01 16:59:58.362739 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.362707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:58.362845 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.362763    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:58.363310 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.363242    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-service-ca-bundle\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:58.365055 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.365034    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ca11c81-9695-4c5b-a62a-ad5f64b4e96f-metrics-certs\") pod \"router-default-587cf9f4d5-p6b7c\" (UID: \"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f\") " pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:58.491893 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.491856    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq"]
Jul 01 16:59:58.500012 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.499988    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:58.500593 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:59:58.500568    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f848807_dc14_4528_81ab_3f5f000c0ac2.slice/crio-af8ae83d750100c3ba140172ea749fa33a2116f8b3a0bb91e05b177d3f12128f WatchSource:0}: Error finding container af8ae83d750100c3ba140172ea749fa33a2116f8b3a0bb91e05b177d3f12128f: Status 404 returned error can't find the container with id af8ae83d750100c3ba140172ea749fa33a2116f8b3a0bb91e05b177d3f12128f
Jul 01 16:59:58.565067 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.565016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:58.567404 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.567380    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-xj6c4\" (UID: \"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:58.636923 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.636885    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-587cf9f4d5-p6b7c"]
Jul 01 16:59:58.639865 ip-10-0-138-165 kubenswrapper[2569]: W0701 16:59:58.639836    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca11c81_9695_4c5b_a62a_ad5f64b4e96f.slice/crio-b0266204e47f2ee1d6fa015c8463716f106e3211ed4a0d1e6b8c14dbb9e26c81 WatchSource:0}: Error finding container b0266204e47f2ee1d6fa015c8463716f106e3211ed4a0d1e6b8c14dbb9e26c81: Status 404 returned error can't find the container with id b0266204e47f2ee1d6fa015c8463716f106e3211ed4a0d1e6b8c14dbb9e26c81
Jul 01 16:59:58.665014 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.664995    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"
Jul 01 16:59:58.810069 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:58.809999    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4"]
Jul 01 16:59:59.304750 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:59.304278    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c" event={"ID":"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f","Type":"ContainerStarted","Data":"71eed93aed17014a774a1099a56a2dc09d3d5976c448eae6fa9d8771f8329f5e"}
Jul 01 16:59:59.304750 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:59.304335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c" event={"ID":"0ca11c81-9695-4c5b-a62a-ad5f64b4e96f","Type":"ContainerStarted","Data":"b0266204e47f2ee1d6fa015c8463716f106e3211ed4a0d1e6b8c14dbb9e26c81"}
Jul 01 16:59:59.305569 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:59.305539    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq" event={"ID":"6f848807-dc14-4528-81ab-3f5f000c0ac2","Type":"ContainerStarted","Data":"af8ae83d750100c3ba140172ea749fa33a2116f8b3a0bb91e05b177d3f12128f"}
Jul 01 16:59:59.306796 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:59.306776    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4" event={"ID":"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae","Type":"ContainerStarted","Data":"01171bd645caa6914d28900930bb1a48f1fd3b27f4a5977f9815c22cb5fb3d67"}
Jul 01 16:59:59.334701 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:59.334649    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c" podStartSLOduration=17.334630398 podStartE2EDuration="17.334630398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:59.334305981 +0000 UTC m=+81.781226966" watchObservedRunningTime="2026-07-01 16:59:59.334630398 +0000 UTC m=+81.781551386"
Jul 01 16:59:59.501125 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:59.501088    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 16:59:59.504109 ip-10-0-138-165 kubenswrapper[2569]: I0701 16:59:59.504084    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 17:00:00.310547 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:00.310514    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 17:00:00.311961 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:00.311937    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-587cf9f4d5-p6b7c"
Jul 01 17:00:01.314999 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.314964    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq" event={"ID":"6f848807-dc14-4528-81ab-3f5f000c0ac2","Type":"ContainerStarted","Data":"4f0deb326bbe9c94ae2a8ef84db7fca5bbffb23da493d32e7c787914e84a1900"}
Jul 01 17:00:01.316799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.316773    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4" event={"ID":"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae","Type":"ContainerStarted","Data":"d81b4e7fb8977412a252c02ccb09980c6935285c1b33270fe808b5ecf5b674bd"}
Jul 01 17:00:01.316929 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.316812    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4" event={"ID":"444bc7b0-08bc-48c7-a7ad-2b59a7d6c2ae","Type":"ContainerStarted","Data":"e2f8dd808841778439facd71d6939300fc9eac0f71685af7e5ad19884e5418ba"}
Jul 01 17:00:01.412632 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.412580    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g9cwq" podStartSLOduration=17.182495886 podStartE2EDuration="19.412561727s" totalImagesPullingTime="2.230065841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:01.376078471 +0000 UTC m=+83.822999450" watchObservedRunningTime="2026-07-01 17:00:01.412561727 +0000 UTC m=+83.859482712"
Jul 01 17:00:01.992307 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.992269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 17:00:01.992526 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.992333    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 17:00:01.992837 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.992817    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb9b943f-e169-4639-bf76-57a77cbb93de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 17:00:01.994749 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:01.994729    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb9b943f-e169-4639-bf76-57a77cbb93de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w72lj\" (UID: \"bb9b943f-e169-4639-bf76-57a77cbb93de\") " pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 17:00:02.082578 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:02.082546    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w72lj"
Jul 01 17:00:02.241258 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:02.241203    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-xj6c4" podStartSLOduration=18.36256624 podStartE2EDuration="20.241184639s" totalImagesPullingTime="1.878618399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:01.413415596 +0000 UTC m=+83.860336579" watchObservedRunningTime="2026-07-01 17:00:02.241184639 +0000 UTC m=+84.688105623"
Jul 01 17:00:02.241475 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:02.241346    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w72lj"]
Jul 01 17:00:02.244577 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:02.244549    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9b943f_e169_4639_bf76_57a77cbb93de.slice/crio-8d70f1a35516d91ff63d29a807e777dc5c3123bbbe43605db8852dab004b2fef WatchSource:0}: Error finding container 8d70f1a35516d91ff63d29a807e777dc5c3123bbbe43605db8852dab004b2fef: Status 404 returned error can't find the container with id 8d70f1a35516d91ff63d29a807e777dc5c3123bbbe43605db8852dab004b2fef
Jul 01 17:00:02.320396 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:02.320360    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w72lj" event={"ID":"bb9b943f-e169-4639-bf76-57a77cbb93de","Type":"ContainerStarted","Data":"8d70f1a35516d91ff63d29a807e777dc5c3123bbbe43605db8852dab004b2fef"}
Jul 01 17:00:06.337356 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:06.337321    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w72lj" event={"ID":"bb9b943f-e169-4639-bf76-57a77cbb93de","Type":"ContainerStarted","Data":"baf9f4c239b2264dbbdccd398ea741561094b47e0e0e3eb7961be18036cec880"}
Jul 01 17:00:08.346543 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:08.346507    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w72lj" event={"ID":"bb9b943f-e169-4639-bf76-57a77cbb93de","Type":"ContainerStarted","Data":"5ca55b2ad93153632b70ad219db329e719b37dd8d02eae41c9929b9a9c7f2001"}
Jul 01 17:00:10.355132 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:10.355049    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w72lj" event={"ID":"bb9b943f-e169-4639-bf76-57a77cbb93de","Type":"ContainerStarted","Data":"fdc17707b9c1db0858854d92e7f368961e7c0512136338fc5fa85e5db1989e96"}
Jul 01 17:00:10.400594 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:10.400539    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w72lj" podStartSLOduration=16.668658262 podStartE2EDuration="24.40052255s" totalImagesPullingTime="7.731864288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:59:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:10.398891949 +0000 UTC m=+92.845812932" watchObservedRunningTime="2026-07-01 17:00:10.40052255 +0000 UTC m=+92.847443535"
Jul 01 17:00:13.095700 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.095668    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"]
Jul 01 17:00:13.098895 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.098871    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.106328 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.106306    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 01 17:00:13.107278 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.107259    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 01 17:00:13.107412 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.107292    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 01 17:00:13.108599 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.108581    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 01 17:00:13.135541 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.135515    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"]
Jul 01 17:00:13.225414 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.225387    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"]
Jul 01 17:00:13.228212 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.228197    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"
Jul 01 17:00:13.231429 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.231404    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-88rnd\""
Jul 01 17:00:13.247039 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.247021    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"]
Jul 01 17:00:13.281070 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.281048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl2cj\" (UniqueName: \"kubernetes.io/projected/78e9a69d-7e75-477e-af4f-3260b75eee44-kube-api-access-vl2cj\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.281177 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.281093    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78e9a69d-7e75-477e-af4f-3260b75eee44-tmp\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.281177 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.281135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78e9a69d-7e75-477e-af4f-3260b75eee44-klusterlet-config\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.336923 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.336860    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"]
Jul 01 17:00:13.339672 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.339654    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-kz2r6"]
Jul 01 17:00:13.339788 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.339773    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"
Jul 01 17:00:13.342612 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.342594    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-kz2r6"
Jul 01 17:00:13.347390 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.347367    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 01 17:00:13.347515 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.347411    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jcwhh\""
Jul 01 17:00:13.347694 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.347674    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5njzc\""
Jul 01 17:00:13.347902 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.347879    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 01 17:00:13.357026 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.357009    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 01 17:00:13.361832 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.361811    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"]
Jul 01 17:00:13.372928 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.372903    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-kz2r6"]
Jul 01 17:00:13.382251 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.382229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl2cj\" (UniqueName: \"kubernetes.io/projected/78e9a69d-7e75-477e-af4f-3260b75eee44-kube-api-access-vl2cj\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.382369 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.382275    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78e9a69d-7e75-477e-af4f-3260b75eee44-tmp\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.382369 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.382315    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9cl\" (UniqueName: \"kubernetes.io/projected/5d34e5db-7ef9-49ab-8e07-20ccea101901-kube-api-access-gf9cl\") pod \"network-check-source-56499946bc-v5sl4\" (UID: \"5d34e5db-7ef9-49ab-8e07-20ccea101901\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"
Jul 01 17:00:13.382369 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.382356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78e9a69d-7e75-477e-af4f-3260b75eee44-klusterlet-config\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.382777 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.382757    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78e9a69d-7e75-477e-af4f-3260b75eee44-tmp\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.384933 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.384917    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78e9a69d-7e75-477e-af4f-3260b75eee44-klusterlet-config\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.438917 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.438891    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl2cj\" (UniqueName: \"kubernetes.io/projected/78e9a69d-7e75-477e-af4f-3260b75eee44-kube-api-access-vl2cj\") pod \"klusterlet-addon-workmgr-7868ffc448-hstz5\" (UID: \"78e9a69d-7e75-477e-af4f-3260b75eee44\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.482965 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.482939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66d6b2ec-a2a3-465a-9faf-fdeec8935c31-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-6sr4z\" (UID: \"66d6b2ec-a2a3-465a-9faf-fdeec8935c31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"
Jul 01 17:00:13.483096 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.482987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9cl\" (UniqueName: \"kubernetes.io/projected/5d34e5db-7ef9-49ab-8e07-20ccea101901-kube-api-access-gf9cl\") pod \"network-check-source-56499946bc-v5sl4\" (UID: \"5d34e5db-7ef9-49ab-8e07-20ccea101901\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"
Jul 01 17:00:13.483096 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.483040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ptgn\" (UniqueName: \"kubernetes.io/projected/4501a87c-0e31-4410-a241-5d4693658ffa-kube-api-access-6ptgn\") pod \"downloads-5499b6fb8f-kz2r6\" (UID: \"4501a87c-0e31-4410-a241-5d4693658ffa\") " pod="openshift-console/downloads-5499b6fb8f-kz2r6"
Jul 01 17:00:13.510973 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.510949    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9cl\" (UniqueName: \"kubernetes.io/projected/5d34e5db-7ef9-49ab-8e07-20ccea101901-kube-api-access-gf9cl\") pod \"network-check-source-56499946bc-v5sl4\" (UID: \"5d34e5db-7ef9-49ab-8e07-20ccea101901\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"
Jul 01 17:00:13.536577 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.536549    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"
Jul 01 17:00:13.584900 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.584113    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66d6b2ec-a2a3-465a-9faf-fdeec8935c31-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-6sr4z\" (UID: \"66d6b2ec-a2a3-465a-9faf-fdeec8935c31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"
Jul 01 17:00:13.584900 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.584214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ptgn\" (UniqueName: \"kubernetes.io/projected/4501a87c-0e31-4410-a241-5d4693658ffa-kube-api-access-6ptgn\") pod \"downloads-5499b6fb8f-kz2r6\" (UID: \"4501a87c-0e31-4410-a241-5d4693658ffa\") " pod="openshift-console/downloads-5499b6fb8f-kz2r6"
Jul 01 17:00:13.589631 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.587754    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66d6b2ec-a2a3-465a-9faf-fdeec8935c31-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-6sr4z\" (UID: \"66d6b2ec-a2a3-465a-9faf-fdeec8935c31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"
Jul 01 17:00:13.621703 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.621677    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ptgn\" (UniqueName: \"kubernetes.io/projected/4501a87c-0e31-4410-a241-5d4693658ffa-kube-api-access-6ptgn\") pod \"downloads-5499b6fb8f-kz2r6\" (UID: \"4501a87c-0e31-4410-a241-5d4693658ffa\") " pod="openshift-console/downloads-5499b6fb8f-kz2r6"
Jul 01 17:00:13.652953 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.652923    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"
Jul 01 17:00:13.657850 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.657831    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-kz2r6"
Jul 01 17:00:13.708598 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.708334    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:13.727996 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.727968    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-v5sl4"]
Jul 01 17:00:13.847794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.847739    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"]
Jul 01 17:00:13.848707 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:13.848683    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-kz2r6"]
Jul 01 17:00:13.849422 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:13.849396    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4501a87c_0e31_4410_a241_5d4693658ffa.slice/crio-98387bc46aaf1761b50559879979d362937e4ebf3fe37832acbba63f185ee511 WatchSource:0}: Error finding container 98387bc46aaf1761b50559879979d362937e4ebf3fe37832acbba63f185ee511: Status 404 returned error can't find the container with id 98387bc46aaf1761b50559879979d362937e4ebf3fe37832acbba63f185ee511
Jul 01 17:00:13.850165 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:13.850148    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d6b2ec_a2a3_465a_9faf_fdeec8935c31.slice/crio-e7ce05ad337960cc22cc1b853f7361361bb55277ba2472557aaafe13cdc3c849 WatchSource:0}: Error finding container e7ce05ad337960cc22cc1b853f7361361bb55277ba2472557aaafe13cdc3c849: Status 404 returned error can't find the container with id e7ce05ad337960cc22cc1b853f7361361bb55277ba2472557aaafe13cdc3c849
Jul 01 17:00:13.983451 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:13.983423    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e9a69d_7e75_477e_af4f_3260b75eee44.slice/crio-297a12d3d1130fcb6baf5045a83ac64f922c19dce40985e2357090eeb06d4c12 WatchSource:0}: Error finding container 297a12d3d1130fcb6baf5045a83ac64f922c19dce40985e2357090eeb06d4c12: Status 404 returned error can't find the container with id 297a12d3d1130fcb6baf5045a83ac64f922c19dce40985e2357090eeb06d4c12
Jul 01 17:00:14.029852 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:14.029822    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"]
Jul 01 17:00:14.369540 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:14.369500    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5" event={"ID":"78e9a69d-7e75-477e-af4f-3260b75eee44","Type":"ContainerStarted","Data":"297a12d3d1130fcb6baf5045a83ac64f922c19dce40985e2357090eeb06d4c12"}
Jul 01 17:00:14.370841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:14.370818    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-kz2r6" event={"ID":"4501a87c-0e31-4410-a241-5d4693658ffa","Type":"ContainerStarted","Data":"98387bc46aaf1761b50559879979d362937e4ebf3fe37832acbba63f185ee511"}
Jul 01 17:00:14.372255 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:14.372230    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z" event={"ID":"66d6b2ec-a2a3-465a-9faf-fdeec8935c31","Type":"ContainerStarted","Data":"e7ce05ad337960cc22cc1b853f7361361bb55277ba2472557aaafe13cdc3c849"}
Jul 01 17:00:14.374179 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:14.374153    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4" event={"ID":"5d34e5db-7ef9-49ab-8e07-20ccea101901","Type":"ContainerStarted","Data":"7cd7710b5e7753d764b776e835acd46ddbd94c13aaf9119a4f68d96087a66368"}
Jul 01 17:00:14.374284 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:14.374191    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4" event={"ID":"5d34e5db-7ef9-49ab-8e07-20ccea101901","Type":"ContainerStarted","Data":"8cb471aaa35381e50430e364ed4f4938b9c1e4338ec4f277d2e35a3fa1bb66c7"}
Jul 01 17:00:14.433139 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:14.433089    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-v5sl4" podStartSLOduration=1.433070636 podStartE2EDuration="1.433070636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:14.430886032 +0000 UTC m=+96.877807027" watchObservedRunningTime="2026-07-01 17:00:14.433070636 +0000 UTC m=+96.879991619"
Jul 01 17:00:15.380421 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:15.380372    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z" event={"ID":"66d6b2ec-a2a3-465a-9faf-fdeec8935c31","Type":"ContainerStarted","Data":"e6eb0c79b7b919984fc522df17eb850b3122308bed0aab8cb495448a0e6dc875"}
Jul 01 17:00:15.380911 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:15.380893    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"
Jul 01 17:00:15.386169 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:15.386129    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z"
Jul 01 17:00:15.410853 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:15.410803    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-6sr4z" podStartSLOduration=1.3555165009999999 podStartE2EDuration="2.410789077s" totalImagesPullingTime="1.055272576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:15.407766675 +0000 UTC m=+97.854687670" watchObservedRunningTime="2026-07-01 17:00:15.410789077 +0000 UTC m=+97.857710060"
Jul 01 17:00:16.912339 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:16.912299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 17:00:16.915155 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:16.915124    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7f5afc9-5418-490a-9c51-cfb05c4f3c09-metrics-tls\") pod \"dns-default-h66qg\" (UID: \"e7f5afc9-5418-490a-9c51-cfb05c4f3c09\") " pod="openshift-dns/dns-default-h66qg"
Jul 01 17:00:17.165824 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.165705    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-548b5f5b57-t78nh"]
Jul 01 17:00:17.169530 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.169507    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.176593 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.176567    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jg9bp\""
Jul 01 17:00:17.176999 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.176964    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 01 17:00:17.177782 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.177728    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 01 17:00:17.177993 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.177977    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 01 17:00:17.190707 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.190687    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 01 17:00:17.199591 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.199555    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 01 17:00:17.204257 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.204238    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm6rt\""
Jul 01 17:00:17.210337 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.210319    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h66qg"
Jul 01 17:00:17.246596 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.246569    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548b5f5b57-t78nh"]
Jul 01 17:00:17.316982 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.316935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-oauth-config\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.316982 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.316981    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-console-config\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.317276 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.317014    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-service-ca\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.317276 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.317046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-oauth-serving-cert\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.317276 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.317095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wmfk\" (UniqueName: \"kubernetes.io/projected/16e986bb-0b19-4082-9088-a524f888f904-kube-api-access-5wmfk\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.317276 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.317258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-serving-cert\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.418535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.418428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-serving-cert\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.418535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.418485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-oauth-config\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.418535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.418504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-console-config\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.418535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.418533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-service-ca\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.418912 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.418562    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-oauth-serving-cert\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.418912 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.418591    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmfk\" (UniqueName: \"kubernetes.io/projected/16e986bb-0b19-4082-9088-a524f888f904-kube-api-access-5wmfk\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.419392 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.419321    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-service-ca\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.419708 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.419683    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-console-config\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.419787 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.419690    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-oauth-serving-cert\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.421632 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.421609    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-serving-cert\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.428326 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.428305    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-oauth-config\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.492515 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.491950    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wmfk\" (UniqueName: \"kubernetes.io/projected/16e986bb-0b19-4082-9088-a524f888f904-kube-api-access-5wmfk\") pod \"console-548b5f5b57-t78nh\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") " pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:17.780903 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:17.780827    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:18.716938 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:18.716900    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548b5f5b57-t78nh"]
Jul 01 17:00:18.744045 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:18.743999    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h66qg"]
Jul 01 17:00:18.956102 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:18.956063    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e986bb_0b19_4082_9088_a524f888f904.slice/crio-bc0ea890f7c7b18595fb4518967a1ebb21f2368794a98e9b1d9053cc6baa71d4 WatchSource:0}: Error finding container bc0ea890f7c7b18595fb4518967a1ebb21f2368794a98e9b1d9053cc6baa71d4: Status 404 returned error can't find the container with id bc0ea890f7c7b18595fb4518967a1ebb21f2368794a98e9b1d9053cc6baa71d4
Jul 01 17:00:18.956974 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:18.956941    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f5afc9_5418_490a_9c51_cfb05c4f3c09.slice/crio-a2f62b2a9e92a290346f4b481e35b13e22c2b012e690fb17d4881342a75a6bcf WatchSource:0}: Error finding container a2f62b2a9e92a290346f4b481e35b13e22c2b012e690fb17d4881342a75a6bcf: Status 404 returned error can't find the container with id a2f62b2a9e92a290346f4b481e35b13e22c2b012e690fb17d4881342a75a6bcf
Jul 01 17:00:19.396510 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:19.396471    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5" event={"ID":"78e9a69d-7e75-477e-af4f-3260b75eee44","Type":"ContainerStarted","Data":"1c0679799928b4916fa74c24c531a720f6aafb6ccd6e9b226634c59458ac33d5"}
Jul 01 17:00:19.396698 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:19.396645    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:19.397837 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:19.397809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548b5f5b57-t78nh" event={"ID":"16e986bb-0b19-4082-9088-a524f888f904","Type":"ContainerStarted","Data":"bc0ea890f7c7b18595fb4518967a1ebb21f2368794a98e9b1d9053cc6baa71d4"}
Jul 01 17:00:19.398550 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:19.398526    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5"
Jul 01 17:00:19.398953 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:19.398932    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h66qg" event={"ID":"e7f5afc9-5418-490a-9c51-cfb05c4f3c09","Type":"ContainerStarted","Data":"a2f62b2a9e92a290346f4b481e35b13e22c2b012e690fb17d4881342a75a6bcf"}
Jul 01 17:00:19.428864 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:19.427356    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7868ffc448-hstz5" podStartSLOduration=1.406729275 podStartE2EDuration="6.427338075s" totalImagesPullingTime="5.0206088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:19.422916422 +0000 UTC m=+101.869837406" watchObservedRunningTime="2026-07-01 17:00:19.427338075 +0000 UTC m=+101.874259060"
Jul 01 17:00:20.957957 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:20.957907    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb88746f7-7w7q9"]
Jul 01 17:00:20.974057 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:20.974026    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:20.988253 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:20.988227    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 01 17:00:21.000388 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.000338    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb88746f7-7w7q9"]
Jul 01 17:00:21.151958 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.151923    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4trkm\" (UniqueName: \"kubernetes.io/projected/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-kube-api-access-4trkm\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.152141 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.151974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-oauth-serving-cert\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.152141 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.151991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-oauth-config\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.152141 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.152024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-trusted-ca-bundle\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.152141 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.152055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-serving-cert\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.152141 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.152133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-config\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.152384 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.152178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-service-ca\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.252830 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.252753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-trusted-ca-bundle\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.252830 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.252788    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-serving-cert\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.252830 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.252811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-config\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.253098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.252835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-service-ca\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.253098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.252873    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4trkm\" (UniqueName: \"kubernetes.io/projected/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-kube-api-access-4trkm\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.253098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.252913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-oauth-serving-cert\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.253098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.253051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-oauth-config\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.253553 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.253520    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-config\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.253553 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.253536    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-oauth-serving-cert\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.253877 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.253855    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-service-ca\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.254132 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.254107    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-trusted-ca-bundle\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.255498 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.255473    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-oauth-config\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.255649 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.255631    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-serving-cert\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.266307 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.266256    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4trkm\" (UniqueName: \"kubernetes.io/projected/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-kube-api-access-4trkm\") pod \"console-5cb88746f7-7w7q9\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") " pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.283862 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.283840    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:21.284836 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.284819    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-flncg"
Jul 01 17:00:21.555321 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:21.555288    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb88746f7-7w7q9"]
Jul 01 17:00:21.561880 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:21.561825    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd62d64_801f_4a54_a5b6_7c12c0ee7f5c.slice/crio-4af4d537ccaae44df5fd29fe462d5cb326de1a934713d4ed6195e27f18d3f321 WatchSource:0}: Error finding container 4af4d537ccaae44df5fd29fe462d5cb326de1a934713d4ed6195e27f18d3f321: Status 404 returned error can't find the container with id 4af4d537ccaae44df5fd29fe462d5cb326de1a934713d4ed6195e27f18d3f321
Jul 01 17:00:22.415515 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:22.415451    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h66qg" event={"ID":"e7f5afc9-5418-490a-9c51-cfb05c4f3c09","Type":"ContainerStarted","Data":"acb4ff358e0e8dcef69bd4b7a9f2b8e498ecc8380cde6e23e2fb58d0120e0436"}
Jul 01 17:00:22.415950 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:22.415545    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h66qg" event={"ID":"e7f5afc9-5418-490a-9c51-cfb05c4f3c09","Type":"ContainerStarted","Data":"41f38d3aeb9a9774d8049780c344369d1f221bf0e5a85474b07c9e2264eb90ac"}
Jul 01 17:00:22.416440 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:22.416373    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h66qg"
Jul 01 17:00:22.418403 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:22.418330    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb88746f7-7w7q9" event={"ID":"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c","Type":"ContainerStarted","Data":"4af4d537ccaae44df5fd29fe462d5cb326de1a934713d4ed6195e27f18d3f321"}
Jul 01 17:00:22.444127 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:22.444067    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h66qg" podStartSLOduration=68.040356735 podStartE2EDuration="1m10.444047878s" totalImagesPullingTime="2.403691143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:22.44302041 +0000 UTC m=+104.889941395" watchObservedRunningTime="2026-07-01 17:00:22.444047878 +0000 UTC m=+104.890968863"
Jul 01 17:00:24.884776 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.884571    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c6pqs"]
Jul 01 17:00:24.888812 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.888790    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.896135 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.896010    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 01 17:00:24.896291 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.896272    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 01 17:00:24.898630 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.898611    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 01 17:00:24.898943 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.898928    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 01 17:00:24.907726 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.907706    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l7mm4\""
Jul 01 17:00:24.972162 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.972132    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-2qpvl"]
Jul 01 17:00:24.975298 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.975281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:24.978159 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.978140    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 01 17:00:24.978379 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.978358    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 01 17:00:24.978481 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.978400    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 01 17:00:24.981620 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.981602    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4crjr\""
Jul 01 17:00:24.985302 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkx4\" (UniqueName: \"kubernetes.io/projected/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-kube-api-access-xxkx4\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985376 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985312    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:24.985376 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-wtmp\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985376 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-sys\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985525 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985525 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985442    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-root\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985525 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-tls\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985525 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985497    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985525 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:24.985755 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3fee4958-e063-459a-a9ea-177f2ac1434f-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:24.985755 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:24.985755 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985658    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-textfile\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:24.985755 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4958-e063-459a-a9ea-177f2ac1434f-metrics-client-ca\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:24.985755 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985706    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rk8r\" (UniqueName: \"kubernetes.io/projected/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-api-access-7rk8r\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:24.985974 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:24.985774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-metrics-client-ca\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.000771 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.000742    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-2qpvl"]
Jul 01 17:00:25.086403 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.086587 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3fee4958-e063-459a-a9ea-177f2ac1434f-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.086587 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086481    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.086587 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-textfile\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.086587 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086539    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4958-e063-459a-a9ea-177f2ac1434f-metrics-client-ca\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.086587 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rk8r\" (UniqueName: \"kubernetes.io/projected/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-api-access-7rk8r\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-metrics-client-ca\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkx4\" (UniqueName: \"kubernetes.io/projected/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-kube-api-access-xxkx4\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086702    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-wtmp\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-sys\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-root\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.086784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086778    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-tls\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.087033 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.087033 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086917    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-textfile\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.087033 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.086934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3fee4958-e063-459a-a9ea-177f2ac1434f-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.087033 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:00:25.087025    2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 01 17:00:25.087186 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:00:25.087090    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-tls podName:3fee4958-e063-459a-a9ea-177f2ac1434f nodeName:}" failed. No retries permitted until 2026-07-01 17:00:25.587072298 +0000 UTC m=+108.033993259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-2qpvl" (UID: "3fee4958-e063-459a-a9ea-177f2ac1434f") : secret "kube-state-metrics-tls" not found
Jul 01 17:00:25.087186 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.087162    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.087313 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.087290    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.087367 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.087334    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-root\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.087517 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.087494    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-wtmp\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.087687 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.087663    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-sys\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.088050 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.087958    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-metrics-client-ca\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.088294 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.088256    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fee4958-e063-459a-a9ea-177f2ac1434f-metrics-client-ca\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.089880 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.089835    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.090206 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.090183    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.090276 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.090232    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-node-exporter-tls\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.100231 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.100210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rk8r\" (UniqueName: \"kubernetes.io/projected/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-api-access-7rk8r\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.100346 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.100247    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkx4\" (UniqueName: \"kubernetes.io/projected/a3c8b9c4-79c6-4895-9d02-6f36015ef5f6-kube-api-access-xxkx4\") pod \"node-exporter-c6pqs\" (UID: \"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6\") " pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.198914 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.198833    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6pqs"
Jul 01 17:00:25.212629 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:25.212600    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c8b9c4_79c6_4895_9d02_6f36015ef5f6.slice/crio-40e539ad605a3f46371fe3b9f2f8297f0425449cec7e46284ae2c1b337eb828b WatchSource:0}: Error finding container 40e539ad605a3f46371fe3b9f2f8297f0425449cec7e46284ae2c1b337eb828b: Status 404 returned error can't find the container with id 40e539ad605a3f46371fe3b9f2f8297f0425449cec7e46284ae2c1b337eb828b
Jul 01 17:00:25.432909 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.432861    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548b5f5b57-t78nh" event={"ID":"16e986bb-0b19-4082-9088-a524f888f904","Type":"ContainerStarted","Data":"93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d"}
Jul 01 17:00:25.434830 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.434668    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb88746f7-7w7q9" event={"ID":"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c","Type":"ContainerStarted","Data":"074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad"}
Jul 01 17:00:25.436582 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.436547    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6pqs" event={"ID":"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6","Type":"ContainerStarted","Data":"40e539ad605a3f46371fe3b9f2f8297f0425449cec7e46284ae2c1b337eb828b"}
Jul 01 17:00:25.468378 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.468296    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-548b5f5b57-t78nh" podStartSLOduration=3.038361221 podStartE2EDuration="8.468281264s" totalImagesPullingTime="5.429920043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:25.467656153 +0000 UTC m=+107.914577138" watchObservedRunningTime="2026-07-01 17:00:25.468281264 +0000 UTC m=+107.915202247"
Jul 01 17:00:25.531351 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.531299    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb88746f7-7w7q9" podStartSLOduration=2.672423386 podStartE2EDuration="5.531284772s" totalImagesPullingTime="2.858861386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:25.529015162 +0000 UTC m=+107.975936147" watchObservedRunningTime="2026-07-01 17:00:25.531284772 +0000 UTC m=+107.978205756"
Jul 01 17:00:25.592186 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.592151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.594861 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.594830    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fee4958-e063-459a-a9ea-177f2ac1434f-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-2qpvl\" (UID: \"3fee4958-e063-459a-a9ea-177f2ac1434f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:25.883904 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:25.883863    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl"
Jul 01 17:00:26.048268 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:26.048234    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fee4958_e063_459a_a9ea_177f2ac1434f.slice/crio-43574e845675b1b017029d4d0855e77d29a9031120dca6ed3fe0b62e436f60f0 WatchSource:0}: Error finding container 43574e845675b1b017029d4d0855e77d29a9031120dca6ed3fe0b62e436f60f0: Status 404 returned error can't find the container with id 43574e845675b1b017029d4d0855e77d29a9031120dca6ed3fe0b62e436f60f0
Jul 01 17:00:26.051150 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:26.051110    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-2qpvl"]
Jul 01 17:00:26.442696 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:26.442585    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl" event={"ID":"3fee4958-e063-459a-a9ea-177f2ac1434f","Type":"ContainerStarted","Data":"43574e845675b1b017029d4d0855e77d29a9031120dca6ed3fe0b62e436f60f0"}
Jul 01 17:00:27.448077 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.448033    2569 generic.go:356] "Generic (PLEG): container finished" podID="a3c8b9c4-79c6-4895-9d02-6f36015ef5f6" containerID="5ce41a7120e8712c4fcda11cf8dd605708d06530fa769813d511892dc2de6f68" exitCode=0
Jul 01 17:00:27.448778 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.448096    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6pqs" event={"ID":"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6","Type":"ContainerDied","Data":"5ce41a7120e8712c4fcda11cf8dd605708d06530fa769813d511892dc2de6f68"}
Jul 01 17:00:27.609684 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.609655    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"]
Jul 01 17:00:27.613326 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.613307    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.618510 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.617844    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 01 17:00:27.618510 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.617903    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pcjlg\""
Jul 01 17:00:27.618510 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.618103    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-50kh6718fflrq\""
Jul 01 17:00:27.618510 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.618135    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 01 17:00:27.618510 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.618344    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 01 17:00:27.618802 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.618539    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 01 17:00:27.618802 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.618726    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 01 17:00:27.633288 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.633193    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"]
Jul 01 17:00:27.713544 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713442    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-grpc-tls\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.713544 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlvgh\" (UniqueName: \"kubernetes.io/projected/d0c463a1-aa9b-4458-8d3e-8b5dea116845-kube-api-access-qlvgh\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.713826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.713826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0c463a1-aa9b-4458-8d3e-8b5dea116845-metrics-client-ca\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.713826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713649    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.713826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.713826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713775    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-tls\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.713826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.713819    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.781742 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.781706    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:27.781895 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.781765    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:27.786202 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.786182    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:27.814298 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.814439 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-tls\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.814439 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.814439 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-grpc-tls\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.814666 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814515    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlvgh\" (UniqueName: \"kubernetes.io/projected/d0c463a1-aa9b-4458-8d3e-8b5dea116845-kube-api-access-qlvgh\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.814666 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.814773 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0c463a1-aa9b-4458-8d3e-8b5dea116845-metrics-client-ca\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.814773 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.814727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.816525 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.816477    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0c463a1-aa9b-4458-8d3e-8b5dea116845-metrics-client-ca\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.818094 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.818068    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.818390 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.818374    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-tls\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.818905 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.818864    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.819000 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.818934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-grpc-tls\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.819000 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.818963    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.820060 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.820022    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0c463a1-aa9b-4458-8d3e-8b5dea116845-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.824948 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.824926    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlvgh\" (UniqueName: \"kubernetes.io/projected/d0c463a1-aa9b-4458-8d3e-8b5dea116845-kube-api-access-qlvgh\") pod \"thanos-querier-fb4fc8d4f-4xxqr\" (UID: \"d0c463a1-aa9b-4458-8d3e-8b5dea116845\") " pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:27.924967 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:27.924935    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:28.082059 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:28.082031    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"]
Jul 01 17:00:28.083662 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:28.083632    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c463a1_aa9b_4458_8d3e_8b5dea116845.slice/crio-a96f11e4c8789ed41ecb0c53a7c2c867b94d5c510fd8869fb8c778ace6de335c WatchSource:0}: Error finding container a96f11e4c8789ed41ecb0c53a7c2c867b94d5c510fd8869fb8c778ace6de335c: Status 404 returned error can't find the container with id a96f11e4c8789ed41ecb0c53a7c2c867b94d5c510fd8869fb8c778ace6de335c
Jul 01 17:00:28.454664 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:28.454622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" event={"ID":"d0c463a1-aa9b-4458-8d3e-8b5dea116845","Type":"ContainerStarted","Data":"a96f11e4c8789ed41ecb0c53a7c2c867b94d5c510fd8869fb8c778ace6de335c"}
Jul 01 17:00:28.458711 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:28.458424    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6pqs" event={"ID":"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6","Type":"ContainerStarted","Data":"89ab45add405039078985932183a0177eb5e2e64a288af832fb9eb4535412501"}
Jul 01 17:00:28.458711 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:28.458496    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6pqs" event={"ID":"a3c8b9c4-79c6-4895-9d02-6f36015ef5f6","Type":"ContainerStarted","Data":"c3002e170553a39cb7cce807ef2d4de70666ee7ad607ffc2dae5ef34ac202442"}
Jul 01 17:00:28.464238 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:28.464210    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:28.487717 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:28.487670    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c6pqs" podStartSLOduration=3.067895215 podStartE2EDuration="4.487654551s" totalImagesPullingTime="1.342032488s" totalInitContainerRuntime="77.726848ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:28.486826795 +0000 UTC m=+110.933747793" watchObservedRunningTime="2026-07-01 17:00:28.487654551 +0000 UTC m=+110.934575534"
Jul 01 17:00:31.284016 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:31.283982    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:31.284431 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:31.284064    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:31.289167 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:31.289144    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:31.474570 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:31.474539    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:00:31.542304 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:31.542227    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548b5f5b57-t78nh"]
Jul 01 17:00:33.429849 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:33.429818    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h66qg"
Jul 01 17:00:34.884816 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:34.884781    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f59f4c5b7-ffwbb"]
Jul 01 17:00:35.051989 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.051955    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f59f4c5b7-ffwbb"]
Jul 01 17:00:35.052164 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.052033    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.176612 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.176513    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-oauth-config\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.176612 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.176561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-service-ca\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.176612 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.176590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t768\" (UniqueName: \"kubernetes.io/projected/edbe8bf2-f992-4458-ba84-e96e3780d574-kube-api-access-6t768\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.176841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.176670    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-trusted-ca-bundle\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.176841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.176720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-console-config\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.176841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.176793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-serving-cert\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.176974 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.176848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-oauth-serving-cert\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.277604 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.277564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-oauth-config\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.277799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.277620    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-service-ca\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.277799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.277650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t768\" (UniqueName: \"kubernetes.io/projected/edbe8bf2-f992-4458-ba84-e96e3780d574-kube-api-access-6t768\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.277799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.277710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-trusted-ca-bundle\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.277799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.277740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-console-config\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.277799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.277793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-serving-cert\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.278107 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.277837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-oauth-serving-cert\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.278569 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.278513    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-console-config\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.278569 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.278541    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-service-ca\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.278853 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.278832    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-oauth-serving-cert\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.279002 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.278975    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-trusted-ca-bundle\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.280543 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.280520    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-oauth-config\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.280704 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.280662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-serving-cert\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.295841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.295814    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t768\" (UniqueName: \"kubernetes.io/projected/edbe8bf2-f992-4458-ba84-e96e3780d574-kube-api-access-6t768\") pod \"console-7f59f4c5b7-ffwbb\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") " pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:35.363532 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:35.363495    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:37.497392 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.497045    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl" event={"ID":"3fee4958-e063-459a-a9ea-177f2ac1434f","Type":"ContainerStarted","Data":"23e4bd2c76c4e9efac4e75a356bc22efb41b939f757238d6d9916104daaa4ddd"}
Jul 01 17:00:37.498785 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.498749    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-kz2r6" event={"ID":"4501a87c-0e31-4410-a241-5d4693658ffa","Type":"ContainerStarted","Data":"f907cd3b0252b7da414706acf8f04661a82d5f5b64c452eec8e998d44301cf34"}
Jul 01 17:00:37.500560 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.500529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" event={"ID":"d0c463a1-aa9b-4458-8d3e-8b5dea116845","Type":"ContainerStarted","Data":"0bf6f1c094dbe0e505c43f702114f1f6397a4e35a5ff512fca5f27b454f82a1e"}
Jul 01 17:00:37.501493 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.501135    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-kz2r6"
Jul 01 17:00:37.502450 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.502341    2569 patch_prober.go:28] interesting pod/downloads-5499b6fb8f-kz2r6 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" start-of-body=
Jul 01 17:00:37.502450 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.502384    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5499b6fb8f-kz2r6" podUID="4501a87c-0e31-4410-a241-5d4693658ffa" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused"
Jul 01 17:00:37.572153 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.571927    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-kz2r6" podStartSLOduration=1.02639753 podStartE2EDuration="24.571890688s" totalImagesPullingTime="23.545493158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:37.529015292 +0000 UTC m=+119.975936276" watchObservedRunningTime="2026-07-01 17:00:37.571890688 +0000 UTC m=+120.018811676"
Jul 01 17:00:37.573616 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:37.573479    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f59f4c5b7-ffwbb"]
Jul 01 17:00:37.576168 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:37.576076    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedbe8bf2_f992_4458_ba84_e96e3780d574.slice/crio-d0bce96550935118c1e5cf1eed9a430aee6921a936baf5a79c5e3c6df21f21fd WatchSource:0}: Error finding container d0bce96550935118c1e5cf1eed9a430aee6921a936baf5a79c5e3c6df21f21fd: Status 404 returned error can't find the container with id d0bce96550935118c1e5cf1eed9a430aee6921a936baf5a79c5e3c6df21f21fd
Jul 01 17:00:38.507083 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.507042    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" event={"ID":"d0c463a1-aa9b-4458-8d3e-8b5dea116845","Type":"ContainerStarted","Data":"c7c0f3f3660d69beb0be2fe6f46df40bf5e50757c0042bc9b2404f2a401e8198"}
Jul 01 17:00:38.507592 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.507172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" event={"ID":"d0c463a1-aa9b-4458-8d3e-8b5dea116845","Type":"ContainerStarted","Data":"4e2a9e001bd23c1595dbbe498dd7011f290f8d7cb2a90d8080aeae727b33eea2"}
Jul 01 17:00:38.508987 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.508951    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f59f4c5b7-ffwbb" event={"ID":"edbe8bf2-f992-4458-ba84-e96e3780d574","Type":"ContainerStarted","Data":"7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738"}
Jul 01 17:00:38.509106 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.509005    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f59f4c5b7-ffwbb" event={"ID":"edbe8bf2-f992-4458-ba84-e96e3780d574","Type":"ContainerStarted","Data":"d0bce96550935118c1e5cf1eed9a430aee6921a936baf5a79c5e3c6df21f21fd"}
Jul 01 17:00:38.511839 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.511809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl" event={"ID":"3fee4958-e063-459a-a9ea-177f2ac1434f","Type":"ContainerStarted","Data":"ab53a4598acd9e572dfdc8422fe649bca177caad9917a008af01d25f722b0def"}
Jul 01 17:00:38.511954 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.511868    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl" event={"ID":"3fee4958-e063-459a-a9ea-177f2ac1434f","Type":"ContainerStarted","Data":"efcb0628c6b255f9b5e1093e0314708850572a2eb61924a4d4b874f975c2a0b0"}
Jul 01 17:00:38.521126 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.521103    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-kz2r6"
Jul 01 17:00:38.538082 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.538026    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f59f4c5b7-ffwbb" podStartSLOduration=4.538009153 podStartE2EDuration="4.538009153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:38.537368501 +0000 UTC m=+120.984289485" watchObservedRunningTime="2026-07-01 17:00:38.538009153 +0000 UTC m=+120.984930138"
Jul 01 17:00:38.591852 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:38.591795    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-2qpvl" podStartSLOduration=3.245975081 podStartE2EDuration="14.591777966s" totalImagesPullingTime="11.345802885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:38.591261945 +0000 UTC m=+121.038182930" watchObservedRunningTime="2026-07-01 17:00:38.591777966 +0000 UTC m=+121.038698949"
Jul 01 17:00:39.521125 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:39.521042    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" event={"ID":"d0c463a1-aa9b-4458-8d3e-8b5dea116845","Type":"ContainerStarted","Data":"19f8519422e37b5692fd65158c5a6a888698f6561513227802b038ecba553858"}
Jul 01 17:00:39.521125 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:39.521122    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" event={"ID":"d0c463a1-aa9b-4458-8d3e-8b5dea116845","Type":"ContainerStarted","Data":"380193bc3d7016b8b88058b058060b7750f1e9e4039a0ef6b966ce17f5e61fd8"}
Jul 01 17:00:39.521668 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:39.521171    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" event={"ID":"d0c463a1-aa9b-4458-8d3e-8b5dea116845","Type":"ContainerStarted","Data":"5908d7bce79869a8108cc3fa86435d674873596b3d7cfd585107cf048ac6b583"}
Jul 01 17:00:39.548351 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:39.548296    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr" podStartSLOduration=1.961108455 podStartE2EDuration="12.54827806s" totalImagesPullingTime="10.587169605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:39.546131594 +0000 UTC m=+121.993052578" watchObservedRunningTime="2026-07-01 17:00:39.54827806 +0000 UTC m=+121.995199044"
Jul 01 17:00:40.526658 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:40.526472    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:45.364188 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:45.364141    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:45.364766 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:45.364292    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:45.369671 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:45.369647    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:45.559574 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:45.559535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:00:45.643288 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:45.643207    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb88746f7-7w7q9"]
Jul 01 17:00:46.537046 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:46.537015    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-fb4fc8d4f-4xxqr"
Jul 01 17:00:47.702734 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:47.702704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 17:00:47.705128 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:47.705106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c53c1ddf-1614-4a13-93fb-f8cc474c2789-metrics-certs\") pod \"network-metrics-daemon-28fln\" (UID: \"c53c1ddf-1614-4a13-93fb-f8cc474c2789\") " pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 17:00:47.828256 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:47.828229    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6c472\""
Jul 01 17:00:47.835428 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:47.835406    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28fln"
Jul 01 17:00:48.012448 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:48.012421    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28fln"]
Jul 01 17:00:48.017500 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:00:48.017444    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53c1ddf_1614_4a13_93fb_f8cc474c2789.slice/crio-ffcd70cadec256b32768787d72634335369920b098b061dd7d713a41a1938738 WatchSource:0}: Error finding container ffcd70cadec256b32768787d72634335369920b098b061dd7d713a41a1938738: Status 404 returned error can't find the container with id ffcd70cadec256b32768787d72634335369920b098b061dd7d713a41a1938738
Jul 01 17:00:48.561778 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:48.561743    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28fln" event={"ID":"c53c1ddf-1614-4a13-93fb-f8cc474c2789","Type":"ContainerStarted","Data":"ffcd70cadec256b32768787d72634335369920b098b061dd7d713a41a1938738"}
Jul 01 17:00:50.571932 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:50.571892    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28fln" event={"ID":"c53c1ddf-1614-4a13-93fb-f8cc474c2789","Type":"ContainerStarted","Data":"cb2fd7aabc3527acf8011e54b71ded23da0d821f2808bcc86bba2fa555e28122"}
Jul 01 17:00:50.572321 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:50.571963    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28fln" event={"ID":"c53c1ddf-1614-4a13-93fb-f8cc474c2789","Type":"ContainerStarted","Data":"069af2b6325b0f3ba876b468da25a19acd8d6686369e745ec472d6e1218b50b0"}
Jul 01 17:00:50.592443 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:50.592396    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-28fln" podStartSLOduration=132.089158103 podStartE2EDuration="2m13.592379788s" totalImagesPullingTime="1.503221685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:50.591674578 +0000 UTC m=+133.038595566" watchObservedRunningTime="2026-07-01 17:00:50.592379788 +0000 UTC m=+133.039300771"
Jul 01 17:00:56.573806 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.573758    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-548b5f5b57-t78nh" podUID="16e986bb-0b19-4082-9088-a524f888f904" containerName="console" containerID="cri-o://93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d" gracePeriod=15
Jul 01 17:00:56.858499 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.858417    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:56.982342 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982317    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-oauth-config\") pod \"16e986bb-0b19-4082-9088-a524f888f904\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") "
Jul 01 17:00:56.982518 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982364    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wmfk\" (UniqueName: \"kubernetes.io/projected/16e986bb-0b19-4082-9088-a524f888f904-kube-api-access-5wmfk\") pod \"16e986bb-0b19-4082-9088-a524f888f904\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") "
Jul 01 17:00:56.982518 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982408    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-console-config\") pod \"16e986bb-0b19-4082-9088-a524f888f904\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") "
Jul 01 17:00:56.982518 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982433    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-oauth-serving-cert\") pod \"16e986bb-0b19-4082-9088-a524f888f904\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") "
Jul 01 17:00:56.982518 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982475    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-service-ca\") pod \"16e986bb-0b19-4082-9088-a524f888f904\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") "
Jul 01 17:00:56.982518 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982496    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-serving-cert\") pod \"16e986bb-0b19-4082-9088-a524f888f904\" (UID: \"16e986bb-0b19-4082-9088-a524f888f904\") "
Jul 01 17:00:56.982863 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982836    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-console-config" (OuterVolumeSpecName: "console-config") pod "16e986bb-0b19-4082-9088-a524f888f904" (UID: "16e986bb-0b19-4082-9088-a524f888f904"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:00:56.982939 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.982915    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16e986bb-0b19-4082-9088-a524f888f904" (UID: "16e986bb-0b19-4082-9088-a524f888f904"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:00:56.983056 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.983024    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-service-ca" (OuterVolumeSpecName: "service-ca") pod "16e986bb-0b19-4082-9088-a524f888f904" (UID: "16e986bb-0b19-4082-9088-a524f888f904"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:00:56.984863 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.984836    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e986bb-0b19-4082-9088-a524f888f904-kube-api-access-5wmfk" (OuterVolumeSpecName: "kube-api-access-5wmfk") pod "16e986bb-0b19-4082-9088-a524f888f904" (UID: "16e986bb-0b19-4082-9088-a524f888f904"). InnerVolumeSpecName "kube-api-access-5wmfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:00:56.984966 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.984942    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16e986bb-0b19-4082-9088-a524f888f904" (UID: "16e986bb-0b19-4082-9088-a524f888f904"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:00:56.984966 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:56.984952    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16e986bb-0b19-4082-9088-a524f888f904" (UID: "16e986bb-0b19-4082-9088-a524f888f904"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:00:57.082974 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.082946    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-oauth-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:00:57.082974 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.082972    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wmfk\" (UniqueName: \"kubernetes.io/projected/16e986bb-0b19-4082-9088-a524f888f904-kube-api-access-5wmfk\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:00:57.083191 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.082987    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-console-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:00:57.083191 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.083000    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-oauth-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:00:57.083191 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.083011    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16e986bb-0b19-4082-9088-a524f888f904-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:00:57.083191 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.083022    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16e986bb-0b19-4082-9088-a524f888f904-console-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:00:57.606048 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.606019    2569 generic.go:356] "Generic (PLEG): container finished" podID="16e986bb-0b19-4082-9088-a524f888f904" containerID="93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d" exitCode=0
Jul 01 17:00:57.606522 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.606062    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548b5f5b57-t78nh"
Jul 01 17:00:57.606522 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.606104    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548b5f5b57-t78nh" event={"ID":"16e986bb-0b19-4082-9088-a524f888f904","Type":"ContainerDied","Data":"93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d"}
Jul 01 17:00:57.606522 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.606151    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548b5f5b57-t78nh" event={"ID":"16e986bb-0b19-4082-9088-a524f888f904","Type":"ContainerDied","Data":"bc0ea890f7c7b18595fb4518967a1ebb21f2368794a98e9b1d9053cc6baa71d4"}
Jul 01 17:00:57.606522 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.606173    2569 scope.go:117] "RemoveContainer" containerID="93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d"
Jul 01 17:00:57.614809 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.614794    2569 scope.go:117] "RemoveContainer" containerID="93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d"
Jul 01 17:00:57.615042 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:00:57.615021    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d\": container with ID starting with 93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d not found: ID does not exist" containerID="93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d"
Jul 01 17:00:57.615090 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.615052    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d"} err="failed to get container status \"93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d\": rpc error: code = NotFound desc = could not find container \"93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d\": container with ID starting with 93fc2f0f2dca98e1e09dbdc349588ae5fd5a4c6ef10289ef006fcc3918ad9e2d not found: ID does not exist"
Jul 01 17:00:57.628986 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.628968    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548b5f5b57-t78nh"]
Jul 01 17:00:57.632478 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.632444    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-548b5f5b57-t78nh"]
Jul 01 17:00:57.901423 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:00:57.901348    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e986bb-0b19-4082-9088-a524f888f904" path="/var/lib/kubelet/pods/16e986bb-0b19-4082-9088-a524f888f904/volumes"
Jul 01 17:01:10.667042 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.666986    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cb88746f7-7w7q9" podUID="1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" containerName="console" containerID="cri-o://074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad" gracePeriod=15
Jul 01 17:01:10.936185 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.936123    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:01:10.995635 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.995606    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4trkm\" (UniqueName: \"kubernetes.io/projected/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-kube-api-access-4trkm\") pod \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") "
Jul 01 17:01:10.995796 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.995645    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-oauth-config\") pod \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") "
Jul 01 17:01:10.995796 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.995671    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-service-ca\") pod \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") "
Jul 01 17:01:10.995893 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.995793    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-serving-cert\") pod \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") "
Jul 01 17:01:10.995893 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.995849    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-config\") pod \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") "
Jul 01 17:01:10.995994 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.995901    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-trusted-ca-bundle\") pod \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") "
Jul 01 17:01:10.995994 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.995935    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-oauth-serving-cert\") pod \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\" (UID: \"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c\") "
Jul 01 17:01:10.996104 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.996012    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" (UID: "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:01:10.996242 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.996212    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-config" (OuterVolumeSpecName: "console-config") pod "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" (UID: "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:01:10.996325 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.996242    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" (UID: "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:01:10.996382 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.996326    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:01:10.996382 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.996343    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-oauth-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:01:10.996382 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.996356    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:01:10.996930 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.996907    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" (UID: "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:01:10.997943 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.997910    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-kube-api-access-4trkm" (OuterVolumeSpecName: "kube-api-access-4trkm") pod "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" (UID: "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c"). InnerVolumeSpecName "kube-api-access-4trkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:01:10.998037 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.998005    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" (UID: "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:01:10.998122 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:10.998055    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" (UID: "1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:01:11.097744 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.097713    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4trkm\" (UniqueName: \"kubernetes.io/projected/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-kube-api-access-4trkm\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:01:11.097744 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.097739    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-oauth-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:01:11.097744 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.097748    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-console-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:01:11.097952 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.097758    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c-trusted-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:01:11.660713 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.660680    2569 generic.go:356] "Generic (PLEG): container finished" podID="1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" containerID="074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad" exitCode=0
Jul 01 17:01:11.660921 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.660730    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb88746f7-7w7q9"
Jul 01 17:01:11.660921 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.660733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb88746f7-7w7q9" event={"ID":"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c","Type":"ContainerDied","Data":"074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad"}
Jul 01 17:01:11.660921 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.660783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb88746f7-7w7q9" event={"ID":"1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c","Type":"ContainerDied","Data":"4af4d537ccaae44df5fd29fe462d5cb326de1a934713d4ed6195e27f18d3f321"}
Jul 01 17:01:11.660921 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.660810    2569 scope.go:117] "RemoveContainer" containerID="074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad"
Jul 01 17:01:11.676042 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.675869    2569 scope.go:117] "RemoveContainer" containerID="074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad"
Jul 01 17:01:11.676248 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:01:11.676144    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad\": container with ID starting with 074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad not found: ID does not exist" containerID="074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad"
Jul 01 17:01:11.676248 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.676167    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad"} err="failed to get container status \"074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad\": rpc error: code = NotFound desc = could not find container \"074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad\": container with ID starting with 074e011de4e11552c30e43a178ab486e28a3e6a7656ef630f395158265aa7bad not found: ID does not exist"
Jul 01 17:01:11.688331 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.688309    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb88746f7-7w7q9"]
Jul 01 17:01:11.693111 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.693087    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb88746f7-7w7q9"]
Jul 01 17:01:11.901231 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:11.901207    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" path="/var/lib/kubelet/pods/1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c/volumes"
Jul 01 17:01:12.666638 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:12.666606    2569 generic.go:356] "Generic (PLEG): container finished" podID="07713b9d-a31e-4f52-944e-daf359a2c946" containerID="26c4ae3e7d9bdbe03788e52dbecaaca705230fa51ccbf58be933b0349f1212be" exitCode=0
Jul 01 17:01:12.666812 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:12.666662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s" event={"ID":"07713b9d-a31e-4f52-944e-daf359a2c946","Type":"ContainerDied","Data":"26c4ae3e7d9bdbe03788e52dbecaaca705230fa51ccbf58be933b0349f1212be"}
Jul 01 17:01:12.667011 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:12.666997    2569 scope.go:117] "RemoveContainer" containerID="26c4ae3e7d9bdbe03788e52dbecaaca705230fa51ccbf58be933b0349f1212be"
Jul 01 17:01:13.672403 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:13.672368    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2zj2s" event={"ID":"07713b9d-a31e-4f52-944e-daf359a2c946","Type":"ContainerStarted","Data":"3eda70c938b978219399135fdfb3b92a14a803477e2c8db84829b6a4e85e74a3"}
Jul 01 17:01:45.901582 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.901556    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcd67d78b-zh67x"]
Jul 01 17:01:45.901985 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.901875    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" containerName="console"
Jul 01 17:01:45.901985 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.901886    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" containerName="console"
Jul 01 17:01:45.901985 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.901899    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e986bb-0b19-4082-9088-a524f888f904" containerName="console"
Jul 01 17:01:45.901985 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.901904    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e986bb-0b19-4082-9088-a524f888f904" containerName="console"
Jul 01 17:01:45.901985 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.901949    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e986bb-0b19-4082-9088-a524f888f904" containerName="console"
Jul 01 17:01:45.901985 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.901957    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd62d64-801f-4a54-a5b6-7c12c0ee7f5c" containerName="console"
Jul 01 17:01:45.904712 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.904692    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:45.928736 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.928717    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcd67d78b-zh67x"]
Jul 01 17:01:45.981631 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.981605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-trusted-ca-bundle\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:45.981777 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.981656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-serving-cert\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:45.981777 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.981684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-console-config\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:45.981777 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.981712    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97vvf\" (UniqueName: \"kubernetes.io/projected/46d6f9da-f327-446f-9689-0c9ef2175afc-kube-api-access-97vvf\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:45.981777 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.981730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-oauth-config\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:45.981777 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.981749    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-service-ca\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:45.981777 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:45.981771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-oauth-serving-cert\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.082516 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.082486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-serving-cert\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.082516 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.082518    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-console-config\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.082709 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.082630    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97vvf\" (UniqueName: \"kubernetes.io/projected/46d6f9da-f327-446f-9689-0c9ef2175afc-kube-api-access-97vvf\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.082709 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.082665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-oauth-config\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.082709 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.082685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-service-ca\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.082837 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.082710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-oauth-serving-cert\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.082837 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.082779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-trusted-ca-bundle\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.083282 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.083257    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-console-config\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.083401 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.083336    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-service-ca\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.083649 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.083631    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-trusted-ca-bundle\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.083826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.083801    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-oauth-serving-cert\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.085108 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.085087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-serving-cert\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.085177 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.085163    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-oauth-config\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.091932 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.091909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97vvf\" (UniqueName: \"kubernetes.io/projected/46d6f9da-f327-446f-9689-0c9ef2175afc-kube-api-access-97vvf\") pod \"console-7bcd67d78b-zh67x\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") " pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.214320 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.214254    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:46.344924 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.344893    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcd67d78b-zh67x"]
Jul 01 17:01:46.348494 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:01:46.348469    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d6f9da_f327_446f_9689_0c9ef2175afc.slice/crio-d1871e8f920d813568047281708646c56dc6e620b7f0852e502b987f42857f5e WatchSource:0}: Error finding container d1871e8f920d813568047281708646c56dc6e620b7f0852e502b987f42857f5e: Status 404 returned error can't find the container with id d1871e8f920d813568047281708646c56dc6e620b7f0852e502b987f42857f5e
Jul 01 17:01:46.801675 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.801638    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd67d78b-zh67x" event={"ID":"46d6f9da-f327-446f-9689-0c9ef2175afc","Type":"ContainerStarted","Data":"bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3"}
Jul 01 17:01:46.801871 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.801693    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd67d78b-zh67x" event={"ID":"46d6f9da-f327-446f-9689-0c9ef2175afc","Type":"ContainerStarted","Data":"d1871e8f920d813568047281708646c56dc6e620b7f0852e502b987f42857f5e"}
Jul 01 17:01:46.821559 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:46.821514    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcd67d78b-zh67x" podStartSLOduration=1.821497133 podStartE2EDuration="1.821497133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:01:46.819809807 +0000 UTC m=+189.266730791" watchObservedRunningTime="2026-07-01 17:01:46.821497133 +0000 UTC m=+189.268418117"
Jul 01 17:01:56.214959 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:56.214919    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:56.215502 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:56.214982    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:56.219737 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:56.219716    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:56.841871 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:56.841841    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:01:56.892127 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:01:56.892092    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f59f4c5b7-ffwbb"]
Jul 01 17:02:21.919729 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:21.919687    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f59f4c5b7-ffwbb" podUID="edbe8bf2-f992-4458-ba84-e96e3780d574" containerName="console" containerID="cri-o://7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738" gracePeriod=15
Jul 01 17:02:22.161323 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.161297    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:02:22.253749 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.253666    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-oauth-serving-cert\") pod \"edbe8bf2-f992-4458-ba84-e96e3780d574\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") "
Jul 01 17:02:22.253749 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.253709    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-trusted-ca-bundle\") pod \"edbe8bf2-f992-4458-ba84-e96e3780d574\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") "
Jul 01 17:02:22.253749 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.253742    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-console-config\") pod \"edbe8bf2-f992-4458-ba84-e96e3780d574\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") "
Jul 01 17:02:22.254024 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.253786    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-serving-cert\") pod \"edbe8bf2-f992-4458-ba84-e96e3780d574\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") "
Jul 01 17:02:22.254024 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.253826    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-oauth-config\") pod \"edbe8bf2-f992-4458-ba84-e96e3780d574\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") "
Jul 01 17:02:22.254024 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.253851    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t768\" (UniqueName: \"kubernetes.io/projected/edbe8bf2-f992-4458-ba84-e96e3780d574-kube-api-access-6t768\") pod \"edbe8bf2-f992-4458-ba84-e96e3780d574\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") "
Jul 01 17:02:22.254024 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.253884    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-service-ca\") pod \"edbe8bf2-f992-4458-ba84-e96e3780d574\" (UID: \"edbe8bf2-f992-4458-ba84-e96e3780d574\") "
Jul 01 17:02:22.254232 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.254093    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "edbe8bf2-f992-4458-ba84-e96e3780d574" (UID: "edbe8bf2-f992-4458-ba84-e96e3780d574"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:02:22.254350 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.254329    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-console-config" (OuterVolumeSpecName: "console-config") pod "edbe8bf2-f992-4458-ba84-e96e3780d574" (UID: "edbe8bf2-f992-4458-ba84-e96e3780d574"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:02:22.254404 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.254328    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "edbe8bf2-f992-4458-ba84-e96e3780d574" (UID: "edbe8bf2-f992-4458-ba84-e96e3780d574"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:02:22.254404 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.254375    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-service-ca" (OuterVolumeSpecName: "service-ca") pod "edbe8bf2-f992-4458-ba84-e96e3780d574" (UID: "edbe8bf2-f992-4458-ba84-e96e3780d574"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:02:22.256194 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.256165    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "edbe8bf2-f992-4458-ba84-e96e3780d574" (UID: "edbe8bf2-f992-4458-ba84-e96e3780d574"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:02:22.256320 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.256211    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "edbe8bf2-f992-4458-ba84-e96e3780d574" (UID: "edbe8bf2-f992-4458-ba84-e96e3780d574"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:02:22.256320 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.256221    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edbe8bf2-f992-4458-ba84-e96e3780d574-kube-api-access-6t768" (OuterVolumeSpecName: "kube-api-access-6t768") pod "edbe8bf2-f992-4458-ba84-e96e3780d574" (UID: "edbe8bf2-f992-4458-ba84-e96e3780d574"). InnerVolumeSpecName "kube-api-access-6t768". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:02:22.354537 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.354486    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-oauth-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:02:22.354537 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.354528    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t768\" (UniqueName: \"kubernetes.io/projected/edbe8bf2-f992-4458-ba84-e96e3780d574-kube-api-access-6t768\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:02:22.354537 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.354538    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:02:22.354537 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.354548    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-oauth-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:02:22.354537 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.354557    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-trusted-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:02:22.354837 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.354565    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edbe8bf2-f992-4458-ba84-e96e3780d574-console-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:02:22.354837 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.354573    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbe8bf2-f992-4458-ba84-e96e3780d574-console-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:02:22.941761 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.941729    2569 generic.go:356] "Generic (PLEG): container finished" podID="edbe8bf2-f992-4458-ba84-e96e3780d574" containerID="7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738" exitCode=0
Jul 01 17:02:22.942231 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.941770    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f59f4c5b7-ffwbb"
Jul 01 17:02:22.942231 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.941787    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f59f4c5b7-ffwbb" event={"ID":"edbe8bf2-f992-4458-ba84-e96e3780d574","Type":"ContainerDied","Data":"7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738"}
Jul 01 17:02:22.942231 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.941827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f59f4c5b7-ffwbb" event={"ID":"edbe8bf2-f992-4458-ba84-e96e3780d574","Type":"ContainerDied","Data":"d0bce96550935118c1e5cf1eed9a430aee6921a936baf5a79c5e3c6df21f21fd"}
Jul 01 17:02:22.942231 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.941845    2569 scope.go:117] "RemoveContainer" containerID="7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738"
Jul 01 17:02:22.950389 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.950367    2569 scope.go:117] "RemoveContainer" containerID="7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738"
Jul 01 17:02:22.950670 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:02:22.950647    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738\": container with ID starting with 7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738 not found: ID does not exist" containerID="7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738"
Jul 01 17:02:22.950727 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.950680    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738"} err="failed to get container status \"7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738\": rpc error: code = NotFound desc = could not find container \"7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738\": container with ID starting with 7fba85ce2e44904266c4ea8183db3cbd6e392cd064368ad70b581b24c9651738 not found: ID does not exist"
Jul 01 17:02:22.974140 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.974108    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f59f4c5b7-ffwbb"]
Jul 01 17:02:22.980226 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:22.980197    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f59f4c5b7-ffwbb"]
Jul 01 17:02:23.905977 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:02:23.905943    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edbe8bf2-f992-4458-ba84-e96e3780d574" path="/var/lib/kubelet/pods/edbe8bf2-f992-4458-ba84-e96e3780d574/volumes"
Jul 01 17:03:09.255848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.255763    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"]
Jul 01 17:03:09.256284 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.256092    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbe8bf2-f992-4458-ba84-e96e3780d574" containerName="console"
Jul 01 17:03:09.256284 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.256105    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbe8bf2-f992-4458-ba84-e96e3780d574" containerName="console"
Jul 01 17:03:09.256284 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.256170    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="edbe8bf2-f992-4458-ba84-e96e3780d574" containerName="console"
Jul 01 17:03:09.258154 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.258139    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.261035 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.261012    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gz42v\""
Jul 01 17:03:09.261168 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.261138    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 01 17:03:09.262132 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.262117    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 01 17:03:09.268312 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.268291    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"]
Jul 01 17:03:09.426596 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.426561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.426753 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.426610    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.426753 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.426635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmd4w\" (UniqueName: \"kubernetes.io/projected/43c2edca-2a03-4339-b095-bc20a7c55540-kube-api-access-qmd4w\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.527961 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.527880    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.527961 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.527926    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.527961 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.527947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmd4w\" (UniqueName: \"kubernetes.io/projected/43c2edca-2a03-4339-b095-bc20a7c55540-kube-api-access-qmd4w\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.528254 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.528233    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.528318 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.528301    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.539334 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.539307    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmd4w\" (UniqueName: \"kubernetes.io/projected/43c2edca-2a03-4339-b095-bc20a7c55540-kube-api-access-qmd4w\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.567169 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.567135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:09.701589 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:09.701554    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"]
Jul 01 17:03:09.704293 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:03:09.704263    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c2edca_2a03_4339_b095_bc20a7c55540.slice/crio-52d0c506acf3b32864b1ec1d6f6e3c55e7cfd67084c67cf245e83c0df4517013 WatchSource:0}: Error finding container 52d0c506acf3b32864b1ec1d6f6e3c55e7cfd67084c67cf245e83c0df4517013: Status 404 returned error can't find the container with id 52d0c506acf3b32864b1ec1d6f6e3c55e7cfd67084c67cf245e83c0df4517013
Jul 01 17:03:10.115870 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:10.115838    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd" event={"ID":"43c2edca-2a03-4339-b095-bc20a7c55540","Type":"ContainerStarted","Data":"52d0c506acf3b32864b1ec1d6f6e3c55e7cfd67084c67cf245e83c0df4517013"}
Jul 01 17:03:19.156399 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:19.156363    2569 generic.go:356] "Generic (PLEG): container finished" podID="43c2edca-2a03-4339-b095-bc20a7c55540" containerID="56dd7032454d0c9ec7ffdba8f23a17fc61891bbcbe8d30d056b5d62038977ae6" exitCode=0
Jul 01 17:03:19.156776 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:19.156435    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd" event={"ID":"43c2edca-2a03-4339-b095-bc20a7c55540","Type":"ContainerDied","Data":"56dd7032454d0c9ec7ffdba8f23a17fc61891bbcbe8d30d056b5d62038977ae6"}
Jul 01 17:03:21.165599 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:21.165564    2569 generic.go:356] "Generic (PLEG): container finished" podID="43c2edca-2a03-4339-b095-bc20a7c55540" containerID="75aa38ae27f0cc45f4927bd991b125b708868d6edf64d855533251844bef76ca" exitCode=0
Jul 01 17:03:21.165934 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:21.165644    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd" event={"ID":"43c2edca-2a03-4339-b095-bc20a7c55540","Type":"ContainerDied","Data":"75aa38ae27f0cc45f4927bd991b125b708868d6edf64d855533251844bef76ca"}
Jul 01 17:03:29.199704 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:29.199614    2569 generic.go:356] "Generic (PLEG): container finished" podID="43c2edca-2a03-4339-b095-bc20a7c55540" containerID="04137822354a62ef43b3fc4b55cd266f256e174669f84524be256948f2c14a57" exitCode=0
Jul 01 17:03:29.199704 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:29.199658    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd" event={"ID":"43c2edca-2a03-4339-b095-bc20a7c55540","Type":"ContainerDied","Data":"04137822354a62ef43b3fc4b55cd266f256e174669f84524be256948f2c14a57"}
Jul 01 17:03:30.333625 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.333601    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:30.396429 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.396404    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-util\") pod \"43c2edca-2a03-4339-b095-bc20a7c55540\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") "
Jul 01 17:03:30.396573 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.396442    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmd4w\" (UniqueName: \"kubernetes.io/projected/43c2edca-2a03-4339-b095-bc20a7c55540-kube-api-access-qmd4w\") pod \"43c2edca-2a03-4339-b095-bc20a7c55540\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") "
Jul 01 17:03:30.396573 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.396498    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-bundle\") pod \"43c2edca-2a03-4339-b095-bc20a7c55540\" (UID: \"43c2edca-2a03-4339-b095-bc20a7c55540\") "
Jul 01 17:03:30.397140 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.397108    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-bundle" (OuterVolumeSpecName: "bundle") pod "43c2edca-2a03-4339-b095-bc20a7c55540" (UID: "43c2edca-2a03-4339-b095-bc20a7c55540"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:03:30.398733 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.398710    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c2edca-2a03-4339-b095-bc20a7c55540-kube-api-access-qmd4w" (OuterVolumeSpecName: "kube-api-access-qmd4w") pod "43c2edca-2a03-4339-b095-bc20a7c55540" (UID: "43c2edca-2a03-4339-b095-bc20a7c55540"). InnerVolumeSpecName "kube-api-access-qmd4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:03:30.403352 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.403328    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-util" (OuterVolumeSpecName: "util") pod "43c2edca-2a03-4339-b095-bc20a7c55540" (UID: "43c2edca-2a03-4339-b095-bc20a7c55540"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:03:30.497774 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.497702    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-util\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:03:30.497774 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.497729    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmd4w\" (UniqueName: \"kubernetes.io/projected/43c2edca-2a03-4339-b095-bc20a7c55540-kube-api-access-qmd4w\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:03:30.497774 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:30.497743    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c2edca-2a03-4339-b095-bc20a7c55540-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:03:31.208423 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:31.208392    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd" event={"ID":"43c2edca-2a03-4339-b095-bc20a7c55540","Type":"ContainerDied","Data":"52d0c506acf3b32864b1ec1d6f6e3c55e7cfd67084c67cf245e83c0df4517013"}
Jul 01 17:03:31.208596 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:31.208443    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52d0c506acf3b32864b1ec1d6f6e3c55e7cfd67084c67cf245e83c0df4517013"
Jul 01 17:03:31.208596 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:31.208401    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895tbzd"
Jul 01 17:03:37.849792 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:37.849762    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:03:37.853527 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:37.853504    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 01 17:03:37.853753 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:37.853739    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:03:38.227817 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.227741    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"]
Jul 01 17:03:38.229848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.228033    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c2edca-2a03-4339-b095-bc20a7c55540" containerName="extract"
Jul 01 17:03:38.229848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.228044    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c2edca-2a03-4339-b095-bc20a7c55540" containerName="extract"
Jul 01 17:03:38.229848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.228057    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c2edca-2a03-4339-b095-bc20a7c55540" containerName="util"
Jul 01 17:03:38.229848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.228062    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c2edca-2a03-4339-b095-bc20a7c55540" containerName="util"
Jul 01 17:03:38.229848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.228068    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c2edca-2a03-4339-b095-bc20a7c55540" containerName="pull"
Jul 01 17:03:38.229848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.228073    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c2edca-2a03-4339-b095-bc20a7c55540" containerName="pull"
Jul 01 17:03:38.229848 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.228121    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c2edca-2a03-4339-b095-bc20a7c55540" containerName="extract"
Jul 01 17:03:38.230635 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.230620    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.235412 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.235390    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 01 17:03:38.235663 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.235646    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 01 17:03:38.235833 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.235820    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-btz2s\""
Jul 01 17:03:38.235986 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.235975    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 01 17:03:38.251204 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.251183    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"]
Jul 01 17:03:38.256108 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.256079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1990ee0a-6077-4416-827a-d01066ba77f8-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-g9htm\" (UID: \"1990ee0a-6077-4416-827a-d01066ba77f8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.256205 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.256151    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j49dq\" (UniqueName: \"kubernetes.io/projected/1990ee0a-6077-4416-827a-d01066ba77f8-kube-api-access-j49dq\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-g9htm\" (UID: \"1990ee0a-6077-4416-827a-d01066ba77f8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.357338 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.357307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j49dq\" (UniqueName: \"kubernetes.io/projected/1990ee0a-6077-4416-827a-d01066ba77f8-kube-api-access-j49dq\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-g9htm\" (UID: \"1990ee0a-6077-4416-827a-d01066ba77f8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.357541 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.357350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1990ee0a-6077-4416-827a-d01066ba77f8-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-g9htm\" (UID: \"1990ee0a-6077-4416-827a-d01066ba77f8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.359729 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.359706    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1990ee0a-6077-4416-827a-d01066ba77f8-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-g9htm\" (UID: \"1990ee0a-6077-4416-827a-d01066ba77f8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.378862 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.378833    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j49dq\" (UniqueName: \"kubernetes.io/projected/1990ee0a-6077-4416-827a-d01066ba77f8-kube-api-access-j49dq\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-g9htm\" (UID: \"1990ee0a-6077-4416-827a-d01066ba77f8\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.541007 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.540932    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:38.719351 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:38.719312    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"]
Jul 01 17:03:38.723336 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:03:38.723296    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1990ee0a_6077_4416_827a_d01066ba77f8.slice/crio-fe881b79a39a465d49cb53fde9e68d13b31d83ae02f6494732db801a8cba6ec3 WatchSource:0}: Error finding container fe881b79a39a465d49cb53fde9e68d13b31d83ae02f6494732db801a8cba6ec3: Status 404 returned error can't find the container with id fe881b79a39a465d49cb53fde9e68d13b31d83ae02f6494732db801a8cba6ec3
Jul 01 17:03:39.241782 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:39.241744    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm" event={"ID":"1990ee0a-6077-4416-827a-d01066ba77f8","Type":"ContainerStarted","Data":"fe881b79a39a465d49cb53fde9e68d13b31d83ae02f6494732db801a8cba6ec3"}
Jul 01 17:03:42.256859 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.256826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm" event={"ID":"1990ee0a-6077-4416-827a-d01066ba77f8","Type":"ContainerStarted","Data":"43bcd922a733d5bc6fd33d5acf777993abfa0a3124b1d69a2062237fdc2d3569"}
Jul 01 17:03:42.257253 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.256887    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:03:42.282441 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.282396    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm" podStartSLOduration=1.496979981 podStartE2EDuration="4.282380315s" totalImagesPullingTime="2.785400334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:03:42.280126935 +0000 UTC m=+304.727047925" watchObservedRunningTime="2026-07-01 17:03:42.282380315 +0000 UTC m=+304.729301299"
Jul 01 17:03:42.904764 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.901707    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-g9q4s"]
Jul 01 17:03:42.906082 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.906060    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:42.908736 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.908714    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 01 17:03:42.908841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.908740    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 01 17:03:42.908841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.908724    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-s9zld\""
Jul 01 17:03:42.916077 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.916052    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-g9q4s"]
Jul 01 17:03:42.994009 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.993979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-certificates\") pod \"keda-admission-5fbd5c4644-g9q4s\" (UID: \"4ea788e3-c97d-4e51-81a7-e4130fcaa199\") " pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:42.994172 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:42.994021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qbxl\" (UniqueName: \"kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-kube-api-access-8qbxl\") pod \"keda-admission-5fbd5c4644-g9q4s\" (UID: \"4ea788e3-c97d-4e51-81a7-e4130fcaa199\") " pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:43.094509 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.094480    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-certificates\") pod \"keda-admission-5fbd5c4644-g9q4s\" (UID: \"4ea788e3-c97d-4e51-81a7-e4130fcaa199\") " pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:43.094671 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.094521    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qbxl\" (UniqueName: \"kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-kube-api-access-8qbxl\") pod \"keda-admission-5fbd5c4644-g9q4s\" (UID: \"4ea788e3-c97d-4e51-81a7-e4130fcaa199\") " pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:43.094671 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:03:43.094635    2569 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 01 17:03:43.094671 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:03:43.094664    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-g9q4s: secret "keda-admission-webhooks-certs" not found
Jul 01 17:03:43.094822 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:03:43.094724    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-certificates podName:4ea788e3-c97d-4e51-81a7-e4130fcaa199 nodeName:}" failed. No retries permitted until 2026-07-01 17:03:43.594702837 +0000 UTC m=+306.041623816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-certificates") pod "keda-admission-5fbd5c4644-g9q4s" (UID: "4ea788e3-c97d-4e51-81a7-e4130fcaa199") : secret "keda-admission-webhooks-certs" not found
Jul 01 17:03:43.103402 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.103376    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qbxl\" (UniqueName: \"kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-kube-api-access-8qbxl\") pod \"keda-admission-5fbd5c4644-g9q4s\" (UID: \"4ea788e3-c97d-4e51-81a7-e4130fcaa199\") " pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:43.598230 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.598202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-certificates\") pod \"keda-admission-5fbd5c4644-g9q4s\" (UID: \"4ea788e3-c97d-4e51-81a7-e4130fcaa199\") " pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:43.600782 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.600761    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4ea788e3-c97d-4e51-81a7-e4130fcaa199-certificates\") pod \"keda-admission-5fbd5c4644-g9q4s\" (UID: \"4ea788e3-c97d-4e51-81a7-e4130fcaa199\") " pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:43.817650 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.817617    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:43.952614 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.952581    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-g9q4s"]
Jul 01 17:03:43.955790 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:03:43.955765    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea788e3_c97d_4e51_81a7_e4130fcaa199.slice/crio-3252667f338958703fc160865245d1006bfaa40777d34c468f7f0d883039ae59 WatchSource:0}: Error finding container 3252667f338958703fc160865245d1006bfaa40777d34c468f7f0d883039ae59: Status 404 returned error can't find the container with id 3252667f338958703fc160865245d1006bfaa40777d34c468f7f0d883039ae59
Jul 01 17:03:43.957018 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:43.956998    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 17:03:44.265738 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:44.265644    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s" event={"ID":"4ea788e3-c97d-4e51-81a7-e4130fcaa199","Type":"ContainerStarted","Data":"3252667f338958703fc160865245d1006bfaa40777d34c468f7f0d883039ae59"}
Jul 01 17:03:46.275091 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:46.275056    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s" event={"ID":"4ea788e3-c97d-4e51-81a7-e4130fcaa199","Type":"ContainerStarted","Data":"833dff93d0450cb5e35c5cc01966446b0d1e2e90d61d1384d02a82c9012e4a2a"}
Jul 01 17:03:46.275592 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:46.275124    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:03:46.297578 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:03:46.297530    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s" podStartSLOduration=2.7799661909999998 podStartE2EDuration="4.297511s" totalImagesPullingTime="1.517544809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:03:46.296087203 +0000 UTC m=+308.743008188" watchObservedRunningTime="2026-07-01 17:03:46.297511 +0000 UTC m=+308.744431986"
Jul 01 17:04:03.263270 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:04:03.263241    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-g9htm"
Jul 01 17:04:07.281749 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:04:07.281720    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-g9q4s"
Jul 01 17:05:03.020167 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.020087    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"]
Jul 01 17:05:03.023493 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.023471    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.028613 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.028592    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 01 17:05:03.029601 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.029579    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 17:05:03.029785 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.029600    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 17:05:03.029785 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.029622    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-r87vl\""
Jul 01 17:05:03.035199 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.035182    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"]
Jul 01 17:05:03.072358 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.072327    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-n6kzn"]
Jul 01 17:05:03.075601 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.075583    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.078815 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.078798    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-5wwg2\""
Jul 01 17:05:03.078898 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.078888    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 17:05:03.090610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.090592    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-n6kzn"]
Jul 01 17:05:03.128084 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.128054    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b3e1155-b23c-4bd1-87f9-4515734bd26f-cert\") pod \"llmisvc-controller-manager-67d95fdc48-5l5jz\" (UID: \"5b3e1155-b23c-4bd1-87f9-4515734bd26f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.128213 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.128097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6gn7\" (UniqueName: \"kubernetes.io/projected/5b3e1155-b23c-4bd1-87f9-4515734bd26f-kube-api-access-x6gn7\") pod \"llmisvc-controller-manager-67d95fdc48-5l5jz\" (UID: \"5b3e1155-b23c-4bd1-87f9-4515734bd26f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.229489 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.229437    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5xv6\" (UniqueName: \"kubernetes.io/projected/8317ae2d-0d4f-49b8-9e1f-2368498a793c-kube-api-access-j5xv6\") pod \"seaweedfs-64568bcd49-n6kzn\" (UID: \"8317ae2d-0d4f-49b8-9e1f-2368498a793c\") " pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.229630 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.229498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8317ae2d-0d4f-49b8-9e1f-2368498a793c-data\") pod \"seaweedfs-64568bcd49-n6kzn\" (UID: \"8317ae2d-0d4f-49b8-9e1f-2368498a793c\") " pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.229630 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.229545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b3e1155-b23c-4bd1-87f9-4515734bd26f-cert\") pod \"llmisvc-controller-manager-67d95fdc48-5l5jz\" (UID: \"5b3e1155-b23c-4bd1-87f9-4515734bd26f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.229630 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.229576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6gn7\" (UniqueName: \"kubernetes.io/projected/5b3e1155-b23c-4bd1-87f9-4515734bd26f-kube-api-access-x6gn7\") pod \"llmisvc-controller-manager-67d95fdc48-5l5jz\" (UID: \"5b3e1155-b23c-4bd1-87f9-4515734bd26f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.229735 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:05:03.229657    2569 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 01 17:05:03.229735 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:05:03.229720    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3e1155-b23c-4bd1-87f9-4515734bd26f-cert podName:5b3e1155-b23c-4bd1-87f9-4515734bd26f nodeName:}" failed. No retries permitted until 2026-07-01 17:05:03.729703344 +0000 UTC m=+386.176624310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b3e1155-b23c-4bd1-87f9-4515734bd26f-cert") pod "llmisvc-controller-manager-67d95fdc48-5l5jz" (UID: "5b3e1155-b23c-4bd1-87f9-4515734bd26f") : secret "llmisvc-webhook-server-cert" not found
Jul 01 17:05:03.239063 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.239033    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6gn7\" (UniqueName: \"kubernetes.io/projected/5b3e1155-b23c-4bd1-87f9-4515734bd26f-kube-api-access-x6gn7\") pod \"llmisvc-controller-manager-67d95fdc48-5l5jz\" (UID: \"5b3e1155-b23c-4bd1-87f9-4515734bd26f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.330566 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.330537    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xv6\" (UniqueName: \"kubernetes.io/projected/8317ae2d-0d4f-49b8-9e1f-2368498a793c-kube-api-access-j5xv6\") pod \"seaweedfs-64568bcd49-n6kzn\" (UID: \"8317ae2d-0d4f-49b8-9e1f-2368498a793c\") " pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.330696 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.330573    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8317ae2d-0d4f-49b8-9e1f-2368498a793c-data\") pod \"seaweedfs-64568bcd49-n6kzn\" (UID: \"8317ae2d-0d4f-49b8-9e1f-2368498a793c\") " pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.330988 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.330967    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8317ae2d-0d4f-49b8-9e1f-2368498a793c-data\") pod \"seaweedfs-64568bcd49-n6kzn\" (UID: \"8317ae2d-0d4f-49b8-9e1f-2368498a793c\") " pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.339804 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.339776    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5xv6\" (UniqueName: \"kubernetes.io/projected/8317ae2d-0d4f-49b8-9e1f-2368498a793c-kube-api-access-j5xv6\") pod \"seaweedfs-64568bcd49-n6kzn\" (UID: \"8317ae2d-0d4f-49b8-9e1f-2368498a793c\") " pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.384716 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.384694    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:03.511410 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.511387    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-n6kzn"]
Jul 01 17:05:03.514321 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:05:03.514297    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8317ae2d_0d4f_49b8_9e1f_2368498a793c.slice/crio-82e7bef1b59264a6c7ceee7c907b5e4d2e530fb2b79219ebc89d9bd1d0c842b2 WatchSource:0}: Error finding container 82e7bef1b59264a6c7ceee7c907b5e4d2e530fb2b79219ebc89d9bd1d0c842b2: Status 404 returned error can't find the container with id 82e7bef1b59264a6c7ceee7c907b5e4d2e530fb2b79219ebc89d9bd1d0c842b2
Jul 01 17:05:03.592767 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.592694    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-n6kzn" event={"ID":"8317ae2d-0d4f-49b8-9e1f-2368498a793c","Type":"ContainerStarted","Data":"82e7bef1b59264a6c7ceee7c907b5e4d2e530fb2b79219ebc89d9bd1d0c842b2"}
Jul 01 17:05:03.733521 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.733494    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b3e1155-b23c-4bd1-87f9-4515734bd26f-cert\") pod \"llmisvc-controller-manager-67d95fdc48-5l5jz\" (UID: \"5b3e1155-b23c-4bd1-87f9-4515734bd26f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.735935 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.735908    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b3e1155-b23c-4bd1-87f9-4515734bd26f-cert\") pod \"llmisvc-controller-manager-67d95fdc48-5l5jz\" (UID: \"5b3e1155-b23c-4bd1-87f9-4515734bd26f\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:03.933709 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:03.933638    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:04.061073 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:04.061049    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"]
Jul 01 17:05:04.063301 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:05:04.063275    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5b3e1155_b23c_4bd1_87f9_4515734bd26f.slice/crio-79e89026afb26364f0786f4a788984ec668cad37adf6d21c2fdda1603f63ab94 WatchSource:0}: Error finding container 79e89026afb26364f0786f4a788984ec668cad37adf6d21c2fdda1603f63ab94: Status 404 returned error can't find the container with id 79e89026afb26364f0786f4a788984ec668cad37adf6d21c2fdda1603f63ab94
Jul 01 17:05:04.598174 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:04.598142    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz" event={"ID":"5b3e1155-b23c-4bd1-87f9-4515734bd26f","Type":"ContainerStarted","Data":"79e89026afb26364f0786f4a788984ec668cad37adf6d21c2fdda1603f63ab94"}
Jul 01 17:05:07.616551 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:07.616517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-n6kzn" event={"ID":"8317ae2d-0d4f-49b8-9e1f-2368498a793c","Type":"ContainerStarted","Data":"4a13d15298374a4d7a060555d87c0afa77860434f75aad3b03423a46abc09735"}
Jul 01 17:05:07.616988 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:07.616748    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:07.645515 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:07.645441    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-n6kzn" podStartSLOduration=1.212415628 podStartE2EDuration="4.64542031s" totalImagesPullingTime="3.433004682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:05:07.644188827 +0000 UTC m=+390.091109812" watchObservedRunningTime="2026-07-01 17:05:07.64542031 +0000 UTC m=+390.092341295"
Jul 01 17:05:09.626276 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:09.626240    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz" event={"ID":"5b3e1155-b23c-4bd1-87f9-4515734bd26f","Type":"ContainerStarted","Data":"fbfb3b6b4c3c57a7ba19d1dd91f1e45e90a9d1a4e7e55b79c87efbee61b8cba2"}
Jul 01 17:05:09.626715 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:09.626314    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:09.654718 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:09.654663    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz" podStartSLOduration=3.092229623 podStartE2EDuration="7.654641432s" totalImagesPullingTime="4.562411809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:05:09.653091602 +0000 UTC m=+392.100012770" watchObservedRunningTime="2026-07-01 17:05:09.654641432 +0000 UTC m=+392.101562417"
Jul 01 17:05:13.623407 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:13.623373    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-n6kzn"
Jul 01 17:05:40.633790 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:40.633761    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-5l5jz"
Jul 01 17:05:42.059986 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.059957    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-84f4454459-sj5ld"]
Jul 01 17:05:42.064524 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.064505    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.067942 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.067920    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-x72nx\""
Jul 01 17:05:42.068077 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.067921    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 01 17:05:42.072532 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.072510    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84f4454459-sj5ld"]
Jul 01 17:05:42.127944 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.127916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmk4\" (UniqueName: \"kubernetes.io/projected/c84c4c43-89df-4087-9ff0-29cb4d2ab3d6-kube-api-access-hvmk4\") pod \"kserve-controller-manager-84f4454459-sj5ld\" (UID: \"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6\") " pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.127944 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.127952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c84c4c43-89df-4087-9ff0-29cb4d2ab3d6-cert\") pod \"kserve-controller-manager-84f4454459-sj5ld\" (UID: \"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6\") " pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.229007 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.228966    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmk4\" (UniqueName: \"kubernetes.io/projected/c84c4c43-89df-4087-9ff0-29cb4d2ab3d6-kube-api-access-hvmk4\") pod \"kserve-controller-manager-84f4454459-sj5ld\" (UID: \"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6\") " pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.229007 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.229012    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c84c4c43-89df-4087-9ff0-29cb4d2ab3d6-cert\") pod \"kserve-controller-manager-84f4454459-sj5ld\" (UID: \"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6\") " pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.231511 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.231482    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c84c4c43-89df-4087-9ff0-29cb4d2ab3d6-cert\") pod \"kserve-controller-manager-84f4454459-sj5ld\" (UID: \"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6\") " pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.239890 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.239864    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmk4\" (UniqueName: \"kubernetes.io/projected/c84c4c43-89df-4087-9ff0-29cb4d2ab3d6-kube-api-access-hvmk4\") pod \"kserve-controller-manager-84f4454459-sj5ld\" (UID: \"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6\") " pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.376083 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.376044    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:42.510088 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.510065    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84f4454459-sj5ld"]
Jul 01 17:05:42.512258 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:05:42.512237    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84c4c43_89df_4087_9ff0_29cb4d2ab3d6.slice/crio-dc3a1ce49c515ddd291537253594f1ee97bdd1c89595547f716857f892736397 WatchSource:0}: Error finding container dc3a1ce49c515ddd291537253594f1ee97bdd1c89595547f716857f892736397: Status 404 returned error can't find the container with id dc3a1ce49c515ddd291537253594f1ee97bdd1c89595547f716857f892736397
Jul 01 17:05:42.765439 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:42.765355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84f4454459-sj5ld" event={"ID":"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6","Type":"ContainerStarted","Data":"dc3a1ce49c515ddd291537253594f1ee97bdd1c89595547f716857f892736397"}
Jul 01 17:05:43.046358 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.046271    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cdf5994cb-2f7m2"]
Jul 01 17:05:43.048938 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.048917    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.072760 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.072732    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdf5994cb-2f7m2"]
Jul 01 17:05:43.137700 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.137666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-oauth-serving-cert\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.137898 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.137782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-trusted-ca-bundle\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.137898 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.137839    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-serving-cert\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.137898 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.137861    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-config\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.137898 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.137886    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nphlq\" (UniqueName: \"kubernetes.io/projected/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-kube-api-access-nphlq\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.138112 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.137965    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-service-ca\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.138112 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.138006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-oauth-config\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.239794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.239380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nphlq\" (UniqueName: \"kubernetes.io/projected/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-kube-api-access-nphlq\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.239794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.239431    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-service-ca\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.239794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.239475    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-oauth-config\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.239794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.239513    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-oauth-serving-cert\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.239794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.239572    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-trusted-ca-bundle\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.239794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.239627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-serving-cert\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.239794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.239648    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-config\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.240370 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.240253    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-service-ca\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.240583 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.240559    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-config\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.240798 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.240646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-oauth-serving-cert\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.241434 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.241407    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-trusted-ca-bundle\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.242971 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.242934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-oauth-config\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.243096 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.243075    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-console-serving-cert\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.248875 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.248851    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nphlq\" (UniqueName: \"kubernetes.io/projected/ed7d3bea-6f2e-4652-b5d2-ea80a66bb097-kube-api-access-nphlq\") pod \"console-cdf5994cb-2f7m2\" (UID: \"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097\") " pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.362694 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.362636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:43.526898 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.526685    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdf5994cb-2f7m2"]
Jul 01 17:05:43.529845 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:05:43.529815    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7d3bea_6f2e_4652_b5d2_ea80a66bb097.slice/crio-b77bb1bff1449ac21897721e7288be125154737f8507d60ea5e48960a625da3a WatchSource:0}: Error finding container b77bb1bff1449ac21897721e7288be125154737f8507d60ea5e48960a625da3a: Status 404 returned error can't find the container with id b77bb1bff1449ac21897721e7288be125154737f8507d60ea5e48960a625da3a
Jul 01 17:05:43.776160 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.776072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdf5994cb-2f7m2" event={"ID":"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097","Type":"ContainerStarted","Data":"1d968b4fee4506684086c59eb6ed2c273aa5acd4d5f2f22df3e98ed3b458acce"}
Jul 01 17:05:43.776160 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.776137    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdf5994cb-2f7m2" event={"ID":"ed7d3bea-6f2e-4652-b5d2-ea80a66bb097","Type":"ContainerStarted","Data":"b77bb1bff1449ac21897721e7288be125154737f8507d60ea5e48960a625da3a"}
Jul 01 17:05:43.796583 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:43.796524    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cdf5994cb-2f7m2" podStartSLOduration=0.796504945 podStartE2EDuration="796.504945ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:05:43.795049672 +0000 UTC m=+426.241970680" watchObservedRunningTime="2026-07-01 17:05:43.796504945 +0000 UTC m=+426.243425928"
Jul 01 17:05:45.790105 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:45.790072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84f4454459-sj5ld" event={"ID":"c84c4c43-89df-4087-9ff0-29cb4d2ab3d6","Type":"ContainerStarted","Data":"6532be2ec125ce3f6153b468981569495c9175f4a0ad29da45437cc2039e02d0"}
Jul 01 17:05:45.790536 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:45.790213    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:05:45.808137 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:45.808089    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-84f4454459-sj5ld" podStartSLOduration=1.459266201 podStartE2EDuration="3.808074446s" totalImagesPullingTime="2.348808245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:05:45.806423361 +0000 UTC m=+428.253344346" watchObservedRunningTime="2026-07-01 17:05:45.808074446 +0000 UTC m=+428.254995431"
Jul 01 17:05:53.362872 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:53.362831    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:53.363376 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:53.362907    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:53.367698 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:53.367676    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:53.826764 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:53.826740    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cdf5994cb-2f7m2"
Jul 01 17:05:53.887539 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:05:53.887502    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcd67d78b-zh67x"]
Jul 01 17:06:16.798904 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:16.798871    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-84f4454459-sj5ld"
Jul 01 17:06:18.914553 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:18.914500    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bcd67d78b-zh67x" podUID="46d6f9da-f327-446f-9689-0c9ef2175afc" containerName="console" containerID="cri-o://bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3" gracePeriod=15
Jul 01 17:06:19.161162 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.161135    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:06:19.229098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229023    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-service-ca\") pod \"46d6f9da-f327-446f-9689-0c9ef2175afc\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") "
Jul 01 17:06:19.229098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229073    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-serving-cert\") pod \"46d6f9da-f327-446f-9689-0c9ef2175afc\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") "
Jul 01 17:06:19.229098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229094    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-trusted-ca-bundle\") pod \"46d6f9da-f327-446f-9689-0c9ef2175afc\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") "
Jul 01 17:06:19.229351 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229109    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97vvf\" (UniqueName: \"kubernetes.io/projected/46d6f9da-f327-446f-9689-0c9ef2175afc-kube-api-access-97vvf\") pod \"46d6f9da-f327-446f-9689-0c9ef2175afc\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") "
Jul 01 17:06:19.229351 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229322    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-oauth-config\") pod \"46d6f9da-f327-446f-9689-0c9ef2175afc\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") "
Jul 01 17:06:19.229478 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229359    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-oauth-serving-cert\") pod \"46d6f9da-f327-446f-9689-0c9ef2175afc\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") "
Jul 01 17:06:19.229478 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229401    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-console-config\") pod \"46d6f9da-f327-446f-9689-0c9ef2175afc\" (UID: \"46d6f9da-f327-446f-9689-0c9ef2175afc\") "
Jul 01 17:06:19.229583 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229542    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-service-ca" (OuterVolumeSpecName: "service-ca") pod "46d6f9da-f327-446f-9689-0c9ef2175afc" (UID: "46d6f9da-f327-446f-9689-0c9ef2175afc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:06:19.229658 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229592    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46d6f9da-f327-446f-9689-0c9ef2175afc" (UID: "46d6f9da-f327-446f-9689-0c9ef2175afc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:06:19.229833 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229807    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-service-ca\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:06:19.229900 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229831    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-trusted-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:06:19.229900 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229789    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46d6f9da-f327-446f-9689-0c9ef2175afc" (UID: "46d6f9da-f327-446f-9689-0c9ef2175afc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:06:19.229988 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.229864    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-console-config" (OuterVolumeSpecName: "console-config") pod "46d6f9da-f327-446f-9689-0c9ef2175afc" (UID: "46d6f9da-f327-446f-9689-0c9ef2175afc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:06:19.231390 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.231368    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d6f9da-f327-446f-9689-0c9ef2175afc-kube-api-access-97vvf" (OuterVolumeSpecName: "kube-api-access-97vvf") pod "46d6f9da-f327-446f-9689-0c9ef2175afc" (UID: "46d6f9da-f327-446f-9689-0c9ef2175afc"). InnerVolumeSpecName "kube-api-access-97vvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:06:19.231526 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.231401    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46d6f9da-f327-446f-9689-0c9ef2175afc" (UID: "46d6f9da-f327-446f-9689-0c9ef2175afc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:06:19.231526 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.231418    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46d6f9da-f327-446f-9689-0c9ef2175afc" (UID: "46d6f9da-f327-446f-9689-0c9ef2175afc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:06:19.330839 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.330800    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-oauth-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:06:19.330839 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.330837    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-oauth-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:06:19.331008 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.330858    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46d6f9da-f327-446f-9689-0c9ef2175afc-console-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:06:19.331008 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.330867    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46d6f9da-f327-446f-9689-0c9ef2175afc-console-serving-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:06:19.331008 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.330876    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97vvf\" (UniqueName: \"kubernetes.io/projected/46d6f9da-f327-446f-9689-0c9ef2175afc-kube-api-access-97vvf\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:06:19.933145 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.933118    2569 generic.go:356] "Generic (PLEG): container finished" podID="46d6f9da-f327-446f-9689-0c9ef2175afc" containerID="bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3" exitCode=0
Jul 01 17:06:19.933535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.933165    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd67d78b-zh67x"
Jul 01 17:06:19.933535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.933209    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd67d78b-zh67x" event={"ID":"46d6f9da-f327-446f-9689-0c9ef2175afc","Type":"ContainerDied","Data":"bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3"}
Jul 01 17:06:19.933535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.933256    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd67d78b-zh67x" event={"ID":"46d6f9da-f327-446f-9689-0c9ef2175afc","Type":"ContainerDied","Data":"d1871e8f920d813568047281708646c56dc6e620b7f0852e502b987f42857f5e"}
Jul 01 17:06:19.933535 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.933276    2569 scope.go:117] "RemoveContainer" containerID="bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3"
Jul 01 17:06:19.941645 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.941628    2569 scope.go:117] "RemoveContainer" containerID="bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3"
Jul 01 17:06:19.941878 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:06:19.941859    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3\": container with ID starting with bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3 not found: ID does not exist" containerID="bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3"
Jul 01 17:06:19.941936 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.941887    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3"} err="failed to get container status \"bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3\": rpc error: code = NotFound desc = could not find container \"bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3\": container with ID starting with bba25a68869a4eef5b9148e6df4541511f774fabc2b051b916797881cf6715f3 not found: ID does not exist"
Jul 01 17:06:19.951429 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.951409    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcd67d78b-zh67x"]
Jul 01 17:06:19.956196 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:19.956177    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcd67d78b-zh67x"]
Jul 01 17:06:21.901692 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:06:21.901664    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46d6f9da-f327-446f-9689-0c9ef2175afc" path="/var/lib/kubelet/pods/46d6f9da-f327-446f-9689-0c9ef2175afc/volumes"
Jul 01 17:08:06.250480 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.250437    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"]
Jul 01 17:08:06.250932 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.250783    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d6f9da-f327-446f-9689-0c9ef2175afc" containerName="console"
Jul 01 17:08:06.250932 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.250794    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d6f9da-f327-446f-9689-0c9ef2175afc" containerName="console"
Jul 01 17:08:06.250932 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.250861    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d6f9da-f327-446f-9689-0c9ef2175afc" containerName="console"
Jul 01 17:08:06.253919 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.253903    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.257011 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.256977    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 01 17:08:06.257140 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.257036    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 17:08:06.257690 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.257665    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-csvp5\""
Jul 01 17:08:06.257787 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.257753    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 17:08:06.258357 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.258338    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 17:08:06.258760 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.258744    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:08:06.259047 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.259026    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 01 17:08:06.267971 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.267947    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"]
Jul 01 17:08:06.276990 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.276962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1867322-cdf6-4580-b98f-156391fc5b4a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.277110 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.277018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1867322-cdf6-4580-b98f-156391fc5b4a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.277110 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.277082    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4qb\" (UniqueName: \"kubernetes.io/projected/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-api-access-jh4qb\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.277195 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.277136    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.277237 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.277218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.377815 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.377769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.377996 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.377834    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1867322-cdf6-4580-b98f-156391fc5b4a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.377996 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.377864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1867322-cdf6-4580-b98f-156391fc5b4a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.377996 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.377914    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4qb\" (UniqueName: \"kubernetes.io/projected/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-api-access-jh4qb\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.377996 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.377972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.378480 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.378443    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1867322-cdf6-4580-b98f-156391fc5b4a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.378591 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.378535    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.378704 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.378686    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.380406 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.380390    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1867322-cdf6-4580-b98f-156391fc5b4a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.389958 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.389938    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4qb\" (UniqueName: \"kubernetes.io/projected/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-api-access-jh4qb\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-pbj9r\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.569034 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.568950    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:06.724101 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:06.724073    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"]
Jul 01 17:08:06.725401 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:08:06.725374    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1867322_cdf6_4580_b98f_156391fc5b4a.slice/crio-79589ee772b050c1040259a0e1de6ed3785a1545d4dc6d1d9383b3d2c9a11320 WatchSource:0}: Error finding container 79589ee772b050c1040259a0e1de6ed3785a1545d4dc6d1d9383b3d2c9a11320: Status 404 returned error can't find the container with id 79589ee772b050c1040259a0e1de6ed3785a1545d4dc6d1d9383b3d2c9a11320
Jul 01 17:08:07.378601 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:07.378559    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerStarted","Data":"79589ee772b050c1040259a0e1de6ed3785a1545d4dc6d1d9383b3d2c9a11320"}
Jul 01 17:08:11.402119 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:11.402083    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerStarted","Data":"a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5"}
Jul 01 17:08:15.419737 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:15.419703    2569 generic.go:356] "Generic (PLEG): container finished" podID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerID="a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5" exitCode=0
Jul 01 17:08:15.420109 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:15.419780    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerDied","Data":"a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5"}
Jul 01 17:08:28.496081 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:28.495990    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerStarted","Data":"d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5"}
Jul 01 17:08:30.507584 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:30.507542    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerStarted","Data":"1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201"}
Jul 01 17:08:30.508008 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:30.507693    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:30.531367 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:30.531304    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podStartSLOduration=1.66711451 podStartE2EDuration="24.531287661s" totalImagesPullingTime="19.056309801s" totalInitContainerRuntime="3.80786335s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:08:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:08:30.529492882 +0000 UTC m=+592.976413868" watchObservedRunningTime="2026-07-01 17:08:30.531287661 +0000 UTC m=+592.978208644"
Jul 01 17:08:31.512806 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:31.512764    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:31.514107 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:31.514083    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:08:32.516620 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:32.516579    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:08:37.520950 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:37.520923    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:08:37.521412 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:37.521354    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:08:37.885307 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:37.885278    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:08:37.885483 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:37.885423    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:08:47.521638 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:47.521592    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:08:57.521978 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:08:57.521931    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:09:07.521732 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:09:07.521650    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:09:17.521522 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:09:17.521481    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:09:27.521342 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:09:27.521304    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:09:37.521864 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:09:37.521827    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:09:43.901685 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:09:43.901660    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:10:06.128828 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.128794    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"]
Jul 01 17:10:06.132197 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.132174    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.140112 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.140079    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 01 17:10:06.140877 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.140857    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 01 17:10:06.147367 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.147345    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"]
Jul 01 17:10:06.197262 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.197230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/781659ea-35ed-46c3-b4ce-ec0cd4625d61-proxy-tls\") pod \"model-chainer-54fd6d96b6-gg5gt\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") " pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.197405 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.197293    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/781659ea-35ed-46c3-b4ce-ec0cd4625d61-openshift-service-ca-bundle\") pod \"model-chainer-54fd6d96b6-gg5gt\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") " pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.298593 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.298558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/781659ea-35ed-46c3-b4ce-ec0cd4625d61-openshift-service-ca-bundle\") pod \"model-chainer-54fd6d96b6-gg5gt\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") " pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.298756 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.298617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/781659ea-35ed-46c3-b4ce-ec0cd4625d61-proxy-tls\") pod \"model-chainer-54fd6d96b6-gg5gt\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") " pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.299294 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.299275    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/781659ea-35ed-46c3-b4ce-ec0cd4625d61-openshift-service-ca-bundle\") pod \"model-chainer-54fd6d96b6-gg5gt\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") " pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.301024 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.301005    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/781659ea-35ed-46c3-b4ce-ec0cd4625d61-proxy-tls\") pod \"model-chainer-54fd6d96b6-gg5gt\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") " pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.443521 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.443423    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:06.573026 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.573003    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"]
Jul 01 17:10:06.575389 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:10:06.575366    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781659ea_35ed_46c3_b4ce_ec0cd4625d61.slice/crio-8bad89ccdef92cba87c4319597a35622d60d12eb1f67f2c33c1ff3041fb8c9ed WatchSource:0}: Error finding container 8bad89ccdef92cba87c4319597a35622d60d12eb1f67f2c33c1ff3041fb8c9ed: Status 404 returned error can't find the container with id 8bad89ccdef92cba87c4319597a35622d60d12eb1f67f2c33c1ff3041fb8c9ed
Jul 01 17:10:06.577449 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.577431    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 17:10:06.933518 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:06.933487    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" event={"ID":"781659ea-35ed-46c3-b4ce-ec0cd4625d61","Type":"ContainerStarted","Data":"8bad89ccdef92cba87c4319597a35622d60d12eb1f67f2c33c1ff3041fb8c9ed"}
Jul 01 17:10:09.948943 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:09.948909    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" event={"ID":"781659ea-35ed-46c3-b4ce-ec0cd4625d61","Type":"ContainerStarted","Data":"3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f"}
Jul 01 17:10:09.949319 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:09.949043    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:09.965584 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:09.965488    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podStartSLOduration=1.371797511 podStartE2EDuration="3.965447113s" totalImagesPullingTime="2.593649602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:10:09.964941551 +0000 UTC m=+692.411862535" watchObservedRunningTime="2026-07-01 17:10:09.965447113 +0000 UTC m=+692.412368097"
Jul 01 17:10:15.959638 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:15.959607    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:16.293643 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:16.293565    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"]
Jul 01 17:10:16.293774 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:16.293727    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer" containerID="cri-o://3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f" gracePeriod=30
Jul 01 17:10:16.597962 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:16.597934    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"]
Jul 01 17:10:16.598297 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:16.598266    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container" containerID="cri-o://d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5" gracePeriod=30
Jul 01 17:10:16.598637 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:16.598410    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kube-rbac-proxy" containerID="cri-o://1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201" gracePeriod=30
Jul 01 17:10:16.979739 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:16.979668    2569 generic.go:356] "Generic (PLEG): container finished" podID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerID="1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201" exitCode=2
Jul 01 17:10:16.979739 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:16.979715    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerDied","Data":"1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201"}
Jul 01 17:10:17.517856 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:17.517815    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 17:10:20.958038 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:20.958001    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:10:21.155244 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.155221    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:10:21.329953 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.329925    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh4qb\" (UniqueName: \"kubernetes.io/projected/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-api-access-jh4qb\") pod \"d1867322-cdf6-4580-b98f-156391fc5b4a\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") "
Jul 01 17:10:21.330129 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.329978    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1867322-cdf6-4580-b98f-156391fc5b4a-kserve-provision-location\") pod \"d1867322-cdf6-4580-b98f-156391fc5b4a\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") "
Jul 01 17:10:21.330129 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.330008    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-cabundle-cert\") pod \"d1867322-cdf6-4580-b98f-156391fc5b4a\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") "
Jul 01 17:10:21.330129 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.330050    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1867322-cdf6-4580-b98f-156391fc5b4a-proxy-tls\") pod \"d1867322-cdf6-4580-b98f-156391fc5b4a\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") "
Jul 01 17:10:21.330129 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.330103    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-rbac-proxy-sar-config\") pod \"d1867322-cdf6-4580-b98f-156391fc5b4a\" (UID: \"d1867322-cdf6-4580-b98f-156391fc5b4a\") "
Jul 01 17:10:21.330385 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.330362    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1867322-cdf6-4580-b98f-156391fc5b4a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d1867322-cdf6-4580-b98f-156391fc5b4a" (UID: "d1867322-cdf6-4580-b98f-156391fc5b4a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:10:21.330528 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.330493    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d1867322-cdf6-4580-b98f-156391fc5b4a" (UID: "d1867322-cdf6-4580-b98f-156391fc5b4a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:10:21.330638 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.330588    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d1867322-cdf6-4580-b98f-156391fc5b4a" (UID: "d1867322-cdf6-4580-b98f-156391fc5b4a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:10:21.332261 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.332241    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-api-access-jh4qb" (OuterVolumeSpecName: "kube-api-access-jh4qb") pod "d1867322-cdf6-4580-b98f-156391fc5b4a" (UID: "d1867322-cdf6-4580-b98f-156391fc5b4a"). InnerVolumeSpecName "kube-api-access-jh4qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:10:21.332330 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.332279    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1867322-cdf6-4580-b98f-156391fc5b4a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d1867322-cdf6-4580-b98f-156391fc5b4a" (UID: "d1867322-cdf6-4580-b98f-156391fc5b4a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:10:21.431618 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.431587    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1867322-cdf6-4580-b98f-156391fc5b4a-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:10:21.431618 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.431613    2569 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:10:21.431618 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.431624    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh4qb\" (UniqueName: \"kubernetes.io/projected/d1867322-cdf6-4580-b98f-156391fc5b4a-kube-api-access-jh4qb\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:10:21.431824 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.431632    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1867322-cdf6-4580-b98f-156391fc5b4a-kserve-provision-location\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:10:21.431824 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:21.431641    2569 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d1867322-cdf6-4580-b98f-156391fc5b4a-cabundle-cert\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:10:22.003809 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.003769    2569 generic.go:356] "Generic (PLEG): container finished" podID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerID="d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5" exitCode=0
Jul 01 17:10:22.004260 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.003852    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"
Jul 01 17:10:22.004260 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.003851    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerDied","Data":"d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5"}
Jul 01 17:10:22.004260 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.003909    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r" event={"ID":"d1867322-cdf6-4580-b98f-156391fc5b4a","Type":"ContainerDied","Data":"79589ee772b050c1040259a0e1de6ed3785a1545d4dc6d1d9383b3d2c9a11320"}
Jul 01 17:10:22.004260 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.003937    2569 scope.go:117] "RemoveContainer" containerID="1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201"
Jul 01 17:10:22.012527 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.012329    2569 scope.go:117] "RemoveContainer" containerID="d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5"
Jul 01 17:10:22.019813 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.019794    2569 scope.go:117] "RemoveContainer" containerID="a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5"
Jul 01 17:10:22.024118 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.024095    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"]
Jul 01 17:10:22.027648 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.027629    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-pbj9r"]
Jul 01 17:10:22.029040 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.029019    2569 scope.go:117] "RemoveContainer" containerID="1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201"
Jul 01 17:10:22.029315 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:10:22.029294    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201\": container with ID starting with 1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201 not found: ID does not exist" containerID="1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201"
Jul 01 17:10:22.029405 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.029321    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201"} err="failed to get container status \"1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201\": rpc error: code = NotFound desc = could not find container \"1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201\": container with ID starting with 1a25c857001eed0ddbbeba0b39647f370046f0bf12611f22f76e680cf685e201 not found: ID does not exist"
Jul 01 17:10:22.029405 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.029343    2569 scope.go:117] "RemoveContainer" containerID="d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5"
Jul 01 17:10:22.029638 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:10:22.029612    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5\": container with ID starting with d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5 not found: ID does not exist" containerID="d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5"
Jul 01 17:10:22.029705 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.029632    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5"} err="failed to get container status \"d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5\": rpc error: code = NotFound desc = could not find container \"d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5\": container with ID starting with d209c4d973652ac87523d25d05ed16cbc6648b626a60765bbcfbff2a1a802cf5 not found: ID does not exist"
Jul 01 17:10:22.029705 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.029657    2569 scope.go:117] "RemoveContainer" containerID="a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5"
Jul 01 17:10:22.029929 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:10:22.029912    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5\": container with ID starting with a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5 not found: ID does not exist" containerID="a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5"
Jul 01 17:10:22.030024 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:22.029932    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5"} err="failed to get container status \"a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5\": rpc error: code = NotFound desc = could not find container \"a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5\": container with ID starting with a5e4b6f743198ea7ca27d6a300e4581d21868331c7f0a4d110f30c263effc0a5 not found: ID does not exist"
Jul 01 17:10:23.901860 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:23.901825    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" path="/var/lib/kubelet/pods/d1867322-cdf6-4580-b98f-156391fc5b4a/volumes"
Jul 01 17:10:25.957166 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:25.957125    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:10:30.957727 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:30.957634    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:10:30.958181 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:30.957750    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:35.957624 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:35.957586    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:10:40.958057 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:40.958014    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:10:45.957879 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:45.957829    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:10:46.943584 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:46.943562    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:47.026724 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.026687    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/781659ea-35ed-46c3-b4ce-ec0cd4625d61-openshift-service-ca-bundle\") pod \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") "
Jul 01 17:10:47.027177 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.026782    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/781659ea-35ed-46c3-b4ce-ec0cd4625d61-proxy-tls\") pod \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\" (UID: \"781659ea-35ed-46c3-b4ce-ec0cd4625d61\") "
Jul 01 17:10:47.027177 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.027092    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/781659ea-35ed-46c3-b4ce-ec0cd4625d61-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "781659ea-35ed-46c3-b4ce-ec0cd4625d61" (UID: "781659ea-35ed-46c3-b4ce-ec0cd4625d61"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:10:47.028897 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.028877    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/781659ea-35ed-46c3-b4ce-ec0cd4625d61-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "781659ea-35ed-46c3-b4ce-ec0cd4625d61" (UID: "781659ea-35ed-46c3-b4ce-ec0cd4625d61"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:10:47.116166 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.116136    2569 generic.go:356] "Generic (PLEG): container finished" podID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerID="3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f" exitCode=0
Jul 01 17:10:47.116322 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.116186    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"
Jul 01 17:10:47.116322 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.116220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" event={"ID":"781659ea-35ed-46c3-b4ce-ec0cd4625d61","Type":"ContainerDied","Data":"3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f"}
Jul 01 17:10:47.116322 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.116272    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt" event={"ID":"781659ea-35ed-46c3-b4ce-ec0cd4625d61","Type":"ContainerDied","Data":"8bad89ccdef92cba87c4319597a35622d60d12eb1f67f2c33c1ff3041fb8c9ed"}
Jul 01 17:10:47.116322 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.116300    2569 scope.go:117] "RemoveContainer" containerID="3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f"
Jul 01 17:10:47.125031 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.125014    2569 scope.go:117] "RemoveContainer" containerID="3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f"
Jul 01 17:10:47.125292 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:10:47.125269    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f\": container with ID starting with 3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f not found: ID does not exist" containerID="3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f"
Jul 01 17:10:47.125375 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.125298    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f"} err="failed to get container status \"3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f\": rpc error: code = NotFound desc = could not find container \"3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f\": container with ID starting with 3418c94e2dce1ac40448e4f0077e7a8e86081a7c659c5b37e5ac97820a8e2d0f not found: ID does not exist"
Jul 01 17:10:47.127738 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.127722    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/781659ea-35ed-46c3-b4ce-ec0cd4625d61-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:10:47.127786 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.127740    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/781659ea-35ed-46c3-b4ce-ec0cd4625d61-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:10:47.141911 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.141884    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"]
Jul 01 17:10:47.147292 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.147258    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-54fd6d96b6-gg5gt"]
Jul 01 17:10:47.902606 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:10:47.902573    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" path="/var/lib/kubelet/pods/781659ea-35ed-46c3-b4ce-ec0cd4625d61/volumes"
Jul 01 17:11:00.619687 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.619654    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"]
Jul 01 17:11:00.620083 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620068    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kube-rbac-proxy"
Jul 01 17:11:00.620132 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620086    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kube-rbac-proxy"
Jul 01 17:11:00.620132 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620106    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="storage-initializer"
Jul 01 17:11:00.620132 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620115    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="storage-initializer"
Jul 01 17:11:00.620225 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620134    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container"
Jul 01 17:11:00.620225 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620142    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container"
Jul 01 17:11:00.620225 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620152    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer"
Jul 01 17:11:00.620225 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620159    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer"
Jul 01 17:11:00.620340 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620235    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kube-rbac-proxy"
Jul 01 17:11:00.620340 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620245    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1867322-cdf6-4580-b98f-156391fc5b4a" containerName="kserve-container"
Jul 01 17:11:00.620340 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.620250    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="781659ea-35ed-46c3-b4ce-ec0cd4625d61" containerName="model-chainer"
Jul 01 17:11:00.624370 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.624357    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:00.626954 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.626930    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:11:00.627081 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.626913    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-3c336-kube-rbac-proxy-sar-config\""
Jul 01 17:11:00.627081 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.626985    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-csvp5\""
Jul 01 17:11:00.627081 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.626986    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-3c336-serving-cert\""
Jul 01 17:11:00.635152 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.635131    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"]
Jul 01 17:11:00.732799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.732769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f954d33-263e-402e-87e2-24efc5c36fe2-openshift-service-ca-bundle\") pod \"switch-graph-3c336-67f978898d-48sxc\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") " pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:00.732978 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.732829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls\") pod \"switch-graph-3c336-67f978898d-48sxc\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") " pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:00.834287 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.834254    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f954d33-263e-402e-87e2-24efc5c36fe2-openshift-service-ca-bundle\") pod \"switch-graph-3c336-67f978898d-48sxc\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") " pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:00.834503 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.834310    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls\") pod \"switch-graph-3c336-67f978898d-48sxc\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") " pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:00.834503 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:11:00.834415    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-3c336-serving-cert: secret "switch-graph-3c336-serving-cert" not found
Jul 01 17:11:00.834503 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:11:00.834500    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls podName:2f954d33-263e-402e-87e2-24efc5c36fe2 nodeName:}" failed. No retries permitted until 2026-07-01 17:11:01.334483096 +0000 UTC m=+743.781404058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls") pod "switch-graph-3c336-67f978898d-48sxc" (UID: "2f954d33-263e-402e-87e2-24efc5c36fe2") : secret "switch-graph-3c336-serving-cert" not found
Jul 01 17:11:00.834984 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:00.834960    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f954d33-263e-402e-87e2-24efc5c36fe2-openshift-service-ca-bundle\") pod \"switch-graph-3c336-67f978898d-48sxc\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") " pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:01.339381 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:01.339346    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls\") pod \"switch-graph-3c336-67f978898d-48sxc\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") " pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:01.341790 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:01.341760    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls\") pod \"switch-graph-3c336-67f978898d-48sxc\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") " pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:01.535173 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:01.535137    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:01.670317 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:01.670296    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"]
Jul 01 17:11:01.672789 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:11:01.672761    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f954d33_263e_402e_87e2_24efc5c36fe2.slice/crio-861d833b16ddeccbc96098c01bfc6eb66cc0a1a4337217893c16cd83c2aca4ae WatchSource:0}: Error finding container 861d833b16ddeccbc96098c01bfc6eb66cc0a1a4337217893c16cd83c2aca4ae: Status 404 returned error can't find the container with id 861d833b16ddeccbc96098c01bfc6eb66cc0a1a4337217893c16cd83c2aca4ae
Jul 01 17:11:02.184278 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:02.184246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" event={"ID":"2f954d33-263e-402e-87e2-24efc5c36fe2","Type":"ContainerStarted","Data":"f4410f7b7ab47f092333c09fbb5449578f2a7a396c909d3c3170e00e1d24ed59"}
Jul 01 17:11:02.184478 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:02.184299    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" event={"ID":"2f954d33-263e-402e-87e2-24efc5c36fe2","Type":"ContainerStarted","Data":"861d833b16ddeccbc96098c01bfc6eb66cc0a1a4337217893c16cd83c2aca4ae"}
Jul 01 17:11:02.184478 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:02.184423    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:02.203920 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:02.203878    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podStartSLOduration=2.20386342 podStartE2EDuration="2.20386342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:11:02.202255507 +0000 UTC m=+744.649176505" watchObservedRunningTime="2026-07-01 17:11:02.20386342 +0000 UTC m=+744.650784403"
Jul 01 17:11:08.194913 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:08.194884    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:11:16.456222 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.456185    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"]
Jul 01 17:11:16.459760 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.459741    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.462409 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.462384    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-ce016-kube-rbac-proxy-sar-config\""
Jul 01 17:11:16.462551 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.462384    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-ce016-serving-cert\""
Jul 01 17:11:16.470663 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.470639    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"]
Jul 01 17:11:16.563082 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.563050    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4169310d-a7c3-4f9d-a766-d78b52814468-proxy-tls\") pod \"sequence-graph-ce016-7b6cbf87f8-94t72\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") " pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.563244 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.563107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4169310d-a7c3-4f9d-a766-d78b52814468-openshift-service-ca-bundle\") pod \"sequence-graph-ce016-7b6cbf87f8-94t72\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") " pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.664128 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.664094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4169310d-a7c3-4f9d-a766-d78b52814468-proxy-tls\") pod \"sequence-graph-ce016-7b6cbf87f8-94t72\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") " pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.664269 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.664177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4169310d-a7c3-4f9d-a766-d78b52814468-openshift-service-ca-bundle\") pod \"sequence-graph-ce016-7b6cbf87f8-94t72\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") " pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.664800 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.664783    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4169310d-a7c3-4f9d-a766-d78b52814468-openshift-service-ca-bundle\") pod \"sequence-graph-ce016-7b6cbf87f8-94t72\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") " pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.666496 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.666476    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4169310d-a7c3-4f9d-a766-d78b52814468-proxy-tls\") pod \"sequence-graph-ce016-7b6cbf87f8-94t72\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") " pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.770525 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.770420    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:16.900749 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:16.900725    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"]
Jul 01 17:11:16.902705 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:11:16.902678    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4169310d_a7c3_4f9d_a766_d78b52814468.slice/crio-715e3f3c8c6fa45ed95ce301995c590a66a89fd1f31fb7c2ebf97a08f5c2f9cc WatchSource:0}: Error finding container 715e3f3c8c6fa45ed95ce301995c590a66a89fd1f31fb7c2ebf97a08f5c2f9cc: Status 404 returned error can't find the container with id 715e3f3c8c6fa45ed95ce301995c590a66a89fd1f31fb7c2ebf97a08f5c2f9cc
Jul 01 17:11:17.250766 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:17.250733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" event={"ID":"4169310d-a7c3-4f9d-a766-d78b52814468","Type":"ContainerStarted","Data":"a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77"}
Jul 01 17:11:17.250766 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:17.250784    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" event={"ID":"4169310d-a7c3-4f9d-a766-d78b52814468","Type":"ContainerStarted","Data":"715e3f3c8c6fa45ed95ce301995c590a66a89fd1f31fb7c2ebf97a08f5c2f9cc"}
Jul 01 17:11:17.251046 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:17.250816    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:11:17.272426 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:17.272375    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podStartSLOduration=1.272361136 podStartE2EDuration="1.272361136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:11:17.270221318 +0000 UTC m=+759.717142302" watchObservedRunningTime="2026-07-01 17:11:17.272361136 +0000 UTC m=+759.719282168"
Jul 01 17:11:23.260562 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:11:23.260536    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:13:37.912708 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:13:37.912641    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:13:37.913907 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:13:37.913878    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:18:37.938646 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:18:37.938619    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:18:37.941088 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:18:37.940816    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:19:15.314573 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:15.314542    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"]
Jul 01 17:19:15.315518 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:15.314835    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336" containerID="cri-o://f4410f7b7ab47f092333c09fbb5449578f2a7a396c909d3c3170e00e1d24ed59" gracePeriod=30
Jul 01 17:19:18.193133 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:18.193083    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:23.192720 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:23.192681    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:28.193164 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:28.193122    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:28.193669 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:28.193225    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:19:31.215156 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:31.215123    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"]
Jul 01 17:19:31.215577 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:31.215327    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016" containerID="cri-o://a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77" gracePeriod=30
Jul 01 17:19:33.192871 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:33.192833    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:33.258922 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:33.258887    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:38.198102 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:38.198060    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:38.258736 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:38.258698    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:43.192747 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:43.192710    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:43.258796 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:43.258759    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:43.258988 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:43.258866    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:19:45.440657 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.440617    2569 generic.go:356] "Generic (PLEG): container finished" podID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerID="f4410f7b7ab47f092333c09fbb5449578f2a7a396c909d3c3170e00e1d24ed59" exitCode=0
Jul 01 17:19:45.441107 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.440671    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" event={"ID":"2f954d33-263e-402e-87e2-24efc5c36fe2","Type":"ContainerDied","Data":"f4410f7b7ab47f092333c09fbb5449578f2a7a396c909d3c3170e00e1d24ed59"}
Jul 01 17:19:45.466155 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.466132    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:19:45.621555 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.621521    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f954d33-263e-402e-87e2-24efc5c36fe2-openshift-service-ca-bundle\") pod \"2f954d33-263e-402e-87e2-24efc5c36fe2\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") "
Jul 01 17:19:45.621754 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.621645    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls\") pod \"2f954d33-263e-402e-87e2-24efc5c36fe2\" (UID: \"2f954d33-263e-402e-87e2-24efc5c36fe2\") "
Jul 01 17:19:45.621947 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.621922    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f954d33-263e-402e-87e2-24efc5c36fe2-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "2f954d33-263e-402e-87e2-24efc5c36fe2" (UID: "2f954d33-263e-402e-87e2-24efc5c36fe2"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:19:45.623826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.623797    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2f954d33-263e-402e-87e2-24efc5c36fe2" (UID: "2f954d33-263e-402e-87e2-24efc5c36fe2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:19:45.722313 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.722277    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f954d33-263e-402e-87e2-24efc5c36fe2-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:19:45.722313 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:45.722306    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f954d33-263e-402e-87e2-24efc5c36fe2-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:19:46.446693 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:46.446664    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"
Jul 01 17:19:46.447251 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:46.446656    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc" event={"ID":"2f954d33-263e-402e-87e2-24efc5c36fe2","Type":"ContainerDied","Data":"861d833b16ddeccbc96098c01bfc6eb66cc0a1a4337217893c16cd83c2aca4ae"}
Jul 01 17:19:46.447251 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:46.446849    2569 scope.go:117] "RemoveContainer" containerID="f4410f7b7ab47f092333c09fbb5449578f2a7a396c909d3c3170e00e1d24ed59"
Jul 01 17:19:46.464028 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:46.464003    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"]
Jul 01 17:19:46.466038 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:46.466018    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3c336-67f978898d-48sxc"]
Jul 01 17:19:47.901881 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:47.901850    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" path="/var/lib/kubelet/pods/2f954d33-263e-402e-87e2-24efc5c36fe2/volumes"
Jul 01 17:19:48.259231 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:48.259142    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:53.258892 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:53.258853    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:19:58.258886 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:19:58.258852    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:01.368445 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.368422    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:20:01.451933 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.451902    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4169310d-a7c3-4f9d-a766-d78b52814468-openshift-service-ca-bundle\") pod \"4169310d-a7c3-4f9d-a766-d78b52814468\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") "
Jul 01 17:20:01.452081 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.451993    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4169310d-a7c3-4f9d-a766-d78b52814468-proxy-tls\") pod \"4169310d-a7c3-4f9d-a766-d78b52814468\" (UID: \"4169310d-a7c3-4f9d-a766-d78b52814468\") "
Jul 01 17:20:01.452226 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.452203    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4169310d-a7c3-4f9d-a766-d78b52814468-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4169310d-a7c3-4f9d-a766-d78b52814468" (UID: "4169310d-a7c3-4f9d-a766-d78b52814468"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:20:01.454093 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.454076    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4169310d-a7c3-4f9d-a766-d78b52814468-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4169310d-a7c3-4f9d-a766-d78b52814468" (UID: "4169310d-a7c3-4f9d-a766-d78b52814468"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:20:01.515701 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.515641    2569 generic.go:356] "Generic (PLEG): container finished" podID="4169310d-a7c3-4f9d-a766-d78b52814468" containerID="a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77" exitCode=0
Jul 01 17:20:01.515701 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.515677    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"
Jul 01 17:20:01.515850 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.515723    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" event={"ID":"4169310d-a7c3-4f9d-a766-d78b52814468","Type":"ContainerDied","Data":"a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77"}
Jul 01 17:20:01.515850 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.515767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72" event={"ID":"4169310d-a7c3-4f9d-a766-d78b52814468","Type":"ContainerDied","Data":"715e3f3c8c6fa45ed95ce301995c590a66a89fd1f31fb7c2ebf97a08f5c2f9cc"}
Jul 01 17:20:01.515850 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.515789    2569 scope.go:117] "RemoveContainer" containerID="a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77"
Jul 01 17:20:01.524756 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.524740    2569 scope.go:117] "RemoveContainer" containerID="a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77"
Jul 01 17:20:01.524989 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:20:01.524971    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77\": container with ID starting with a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77 not found: ID does not exist" containerID="a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77"
Jul 01 17:20:01.525038 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.524998    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77"} err="failed to get container status \"a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77\": rpc error: code = NotFound desc = could not find container \"a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77\": container with ID starting with a5c6594689de1d0ce692c5e238c50d3d0aa260fde17c092b642a2a311173fc77 not found: ID does not exist"
Jul 01 17:20:01.536971 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.536950    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"]
Jul 01 17:20:01.541638 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.541619    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-ce016-7b6cbf87f8-94t72"]
Jul 01 17:20:01.552418 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.552402    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4169310d-a7c3-4f9d-a766-d78b52814468-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:20:01.552528 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.552422    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4169310d-a7c3-4f9d-a766-d78b52814468-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:20:01.901944 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:01.901905    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" path="/var/lib/kubelet/pods/4169310d-a7c3-4f9d-a766-d78b52814468/volumes"
Jul 01 17:20:15.548793 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.548748    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"]
Jul 01 17:20:15.549199 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.549118    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336"
Jul 01 17:20:15.549199 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.549129    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336"
Jul 01 17:20:15.549199 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.549139    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016"
Jul 01 17:20:15.549199 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.549145    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016"
Jul 01 17:20:15.549331 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.549207    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f954d33-263e-402e-87e2-24efc5c36fe2" containerName="switch-graph-3c336"
Jul 01 17:20:15.549331 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.549219    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4169310d-a7c3-4f9d-a766-d78b52814468" containerName="sequence-graph-ce016"
Jul 01 17:20:15.552470 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.552430    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.556163 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.556135    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:20:15.556163 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.556154    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-52e43-serving-cert\""
Jul 01 17:20:15.556392 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.556134    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-52e43-kube-rbac-proxy-sar-config\""
Jul 01 17:20:15.556392 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.556134    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-csvp5\""
Jul 01 17:20:15.563725 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.563698    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"]
Jul 01 17:20:15.644477 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.644418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2c88393-d778-4166-aa58-f552479a37ba-proxy-tls\") pod \"ensemble-graph-52e43-65c965b44d-tmkgc\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") " pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.644664 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.644567    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c88393-d778-4166-aa58-f552479a37ba-openshift-service-ca-bundle\") pod \"ensemble-graph-52e43-65c965b44d-tmkgc\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") " pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.744924 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.744889    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c88393-d778-4166-aa58-f552479a37ba-openshift-service-ca-bundle\") pod \"ensemble-graph-52e43-65c965b44d-tmkgc\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") " pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.745084 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.744936    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2c88393-d778-4166-aa58-f552479a37ba-proxy-tls\") pod \"ensemble-graph-52e43-65c965b44d-tmkgc\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") " pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.745531 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.745505    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c88393-d778-4166-aa58-f552479a37ba-openshift-service-ca-bundle\") pod \"ensemble-graph-52e43-65c965b44d-tmkgc\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") " pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.747335 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.747308    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2c88393-d778-4166-aa58-f552479a37ba-proxy-tls\") pod \"ensemble-graph-52e43-65c965b44d-tmkgc\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") " pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.863428 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.863402    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:15.991484 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:15.991413    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"]
Jul 01 17:20:15.993708 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:20:15.993677    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c88393_d778_4166_aa58_f552479a37ba.slice/crio-9c1eb79768e2574e1fd3989e1a16af016f0379d6f6ab97f232fb970133af1a3e WatchSource:0}: Error finding container 9c1eb79768e2574e1fd3989e1a16af016f0379d6f6ab97f232fb970133af1a3e: Status 404 returned error can't find the container with id 9c1eb79768e2574e1fd3989e1a16af016f0379d6f6ab97f232fb970133af1a3e
Jul 01 17:20:16.582472 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:16.582433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" event={"ID":"c2c88393-d778-4166-aa58-f552479a37ba","Type":"ContainerStarted","Data":"90b466ea2e09e38aac5906d4570501f90cc2479d3fb4dae7e3e1dad0196af7d5"}
Jul 01 17:20:16.582889 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:16.582505    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" event={"ID":"c2c88393-d778-4166-aa58-f552479a37ba","Type":"ContainerStarted","Data":"9c1eb79768e2574e1fd3989e1a16af016f0379d6f6ab97f232fb970133af1a3e"}
Jul 01 17:20:16.602043 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:16.601995    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podStartSLOduration=1.601980338 podStartE2EDuration="1.601980338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:16.599913767 +0000 UTC m=+1299.046834751" watchObservedRunningTime="2026-07-01 17:20:16.601980338 +0000 UTC m=+1299.048901372"
Jul 01 17:20:17.586597 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:17.586570    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:23.595982 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:23.595949    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:25.619882 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:25.619849    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"]
Jul 01 17:20:25.620304 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:25.620042    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43" containerID="cri-o://90b466ea2e09e38aac5906d4570501f90cc2479d3fb4dae7e3e1dad0196af7d5" gracePeriod=30
Jul 01 17:20:28.595435 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:28.595387    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:33.594976 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:33.594940    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:38.595343 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:38.595301    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:38.595844 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:38.595417    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:41.394156 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.394111    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"]
Jul 01 17:20:41.398788 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.398766    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:41.401213 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.401194    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-1f194-serving-cert\""
Jul 01 17:20:41.401376 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.401360    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-1f194-kube-rbac-proxy-sar-config\""
Jul 01 17:20:41.407403 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.407379    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"]
Jul 01 17:20:41.451361 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.451330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6ff716-5428-4626-bc17-81e7b5470ec9-openshift-service-ca-bundle\") pod \"sequence-graph-1f194-54bc64db78-46rl4\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") " pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:41.451523 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.451373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls\") pod \"sequence-graph-1f194-54bc64db78-46rl4\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") " pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:41.552350 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.552320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6ff716-5428-4626-bc17-81e7b5470ec9-openshift-service-ca-bundle\") pod \"sequence-graph-1f194-54bc64db78-46rl4\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") " pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:41.552521 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.552359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls\") pod \"sequence-graph-1f194-54bc64db78-46rl4\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") " pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:41.552521 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:20:41.552494    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-1f194-serving-cert: secret "sequence-graph-1f194-serving-cert" not found
Jul 01 17:20:41.552596 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:20:41.552573    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls podName:2e6ff716-5428-4626-bc17-81e7b5470ec9 nodeName:}" failed. No retries permitted until 2026-07-01 17:20:42.05255183 +0000 UTC m=+1324.499472791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls") pod "sequence-graph-1f194-54bc64db78-46rl4" (UID: "2e6ff716-5428-4626-bc17-81e7b5470ec9") : secret "sequence-graph-1f194-serving-cert" not found
Jul 01 17:20:41.553042 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:41.553023    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6ff716-5428-4626-bc17-81e7b5470ec9-openshift-service-ca-bundle\") pod \"sequence-graph-1f194-54bc64db78-46rl4\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") " pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:42.057067 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.057024    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls\") pod \"sequence-graph-1f194-54bc64db78-46rl4\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") " pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:42.059643 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.059620    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls\") pod \"sequence-graph-1f194-54bc64db78-46rl4\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") " pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:42.310094 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.310014    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:42.443809 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.443786    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"]
Jul 01 17:20:42.446485 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:20:42.446442    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6ff716_5428_4626_bc17_81e7b5470ec9.slice/crio-fc7abe44f99894e34781db24c8bd6f0832d35f5fed5d3c7063ffecf44819c039 WatchSource:0}: Error finding container fc7abe44f99894e34781db24c8bd6f0832d35f5fed5d3c7063ffecf44819c039: Status 404 returned error can't find the container with id fc7abe44f99894e34781db24c8bd6f0832d35f5fed5d3c7063ffecf44819c039
Jul 01 17:20:42.697690 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.697655    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" event={"ID":"2e6ff716-5428-4626-bc17-81e7b5470ec9","Type":"ContainerStarted","Data":"12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd"}
Jul 01 17:20:42.697851 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.697708    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" event={"ID":"2e6ff716-5428-4626-bc17-81e7b5470ec9","Type":"ContainerStarted","Data":"fc7abe44f99894e34781db24c8bd6f0832d35f5fed5d3c7063ffecf44819c039"}
Jul 01 17:20:42.697851 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.697748    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:42.716787 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:42.716742    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podStartSLOduration=1.716726638 podStartE2EDuration="1.716726638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:42.715966271 +0000 UTC m=+1325.162887255" watchObservedRunningTime="2026-07-01 17:20:42.716726638 +0000 UTC m=+1325.163647622"
Jul 01 17:20:43.594687 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:43.594652    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:48.594476 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:48.594427    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:48.707841 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:48.707818    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:20:51.461695 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:51.461663    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"]
Jul 01 17:20:51.462155 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:51.461866    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194" containerID="cri-o://12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd" gracePeriod=30
Jul 01 17:20:53.595107 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:53.595057    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:53.706821 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:53.706781    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:20:55.754610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.754447    2569 generic.go:356] "Generic (PLEG): container finished" podID="c2c88393-d778-4166-aa58-f552479a37ba" containerID="90b466ea2e09e38aac5906d4570501f90cc2479d3fb4dae7e3e1dad0196af7d5" exitCode=0
Jul 01 17:20:55.754610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.754488    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" event={"ID":"c2c88393-d778-4166-aa58-f552479a37ba","Type":"ContainerDied","Data":"90b466ea2e09e38aac5906d4570501f90cc2479d3fb4dae7e3e1dad0196af7d5"}
Jul 01 17:20:55.772037 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.772016    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:55.866578 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.866548    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2c88393-d778-4166-aa58-f552479a37ba-proxy-tls\") pod \"c2c88393-d778-4166-aa58-f552479a37ba\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") "
Jul 01 17:20:55.866719 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.866619    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c88393-d778-4166-aa58-f552479a37ba-openshift-service-ca-bundle\") pod \"c2c88393-d778-4166-aa58-f552479a37ba\" (UID: \"c2c88393-d778-4166-aa58-f552479a37ba\") "
Jul 01 17:20:55.866957 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.866935    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2c88393-d778-4166-aa58-f552479a37ba-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c2c88393-d778-4166-aa58-f552479a37ba" (UID: "c2c88393-d778-4166-aa58-f552479a37ba"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:20:55.868767 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.868746    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2c88393-d778-4166-aa58-f552479a37ba-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c2c88393-d778-4166-aa58-f552479a37ba" (UID: "c2c88393-d778-4166-aa58-f552479a37ba"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:20:55.967368 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.967342    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2c88393-d778-4166-aa58-f552479a37ba-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:20:55.967368 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:55.967362    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c88393-d778-4166-aa58-f552479a37ba-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:20:56.760751 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:56.760725    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"
Jul 01 17:20:56.761277 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:56.760768    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc" event={"ID":"c2c88393-d778-4166-aa58-f552479a37ba","Type":"ContainerDied","Data":"9c1eb79768e2574e1fd3989e1a16af016f0379d6f6ab97f232fb970133af1a3e"}
Jul 01 17:20:56.761277 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:56.760839    2569 scope.go:117] "RemoveContainer" containerID="90b466ea2e09e38aac5906d4570501f90cc2479d3fb4dae7e3e1dad0196af7d5"
Jul 01 17:20:56.779650 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:56.779628    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"]
Jul 01 17:20:56.786926 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:56.786904    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-52e43-65c965b44d-tmkgc"]
Jul 01 17:20:57.902706 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:57.902674    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2c88393-d778-4166-aa58-f552479a37ba" path="/var/lib/kubelet/pods/c2c88393-d778-4166-aa58-f552479a37ba/volumes"
Jul 01 17:20:58.706238 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:20:58.706159    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:21:03.706268 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:03.706233    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:21:03.706671 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:03.706333    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:21:08.706735 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:08.706696    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:21:13.706592 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:13.706553    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:21:18.706250 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:18.706214    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:21:21.612420 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.612398    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:21:21.667938 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.667910    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls\") pod \"2e6ff716-5428-4626-bc17-81e7b5470ec9\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") "
Jul 01 17:21:21.668093 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.667946    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6ff716-5428-4626-bc17-81e7b5470ec9-openshift-service-ca-bundle\") pod \"2e6ff716-5428-4626-bc17-81e7b5470ec9\" (UID: \"2e6ff716-5428-4626-bc17-81e7b5470ec9\") "
Jul 01 17:21:21.668318 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.668294    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e6ff716-5428-4626-bc17-81e7b5470ec9-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "2e6ff716-5428-4626-bc17-81e7b5470ec9" (UID: "2e6ff716-5428-4626-bc17-81e7b5470ec9"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:21:21.670053 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.670033    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2e6ff716-5428-4626-bc17-81e7b5470ec9" (UID: "2e6ff716-5428-4626-bc17-81e7b5470ec9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:21:21.769440 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.769369    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e6ff716-5428-4626-bc17-81e7b5470ec9-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:21:21.769440 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.769393    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e6ff716-5428-4626-bc17-81e7b5470ec9-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:21:21.869946 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.869910    2569 generic.go:356] "Generic (PLEG): container finished" podID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerID="12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd" exitCode=0
Jul 01 17:21:21.869946 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.869950    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"
Jul 01 17:21:21.870203 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.869978    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" event={"ID":"2e6ff716-5428-4626-bc17-81e7b5470ec9","Type":"ContainerDied","Data":"12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd"}
Jul 01 17:21:21.870203 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.870028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4" event={"ID":"2e6ff716-5428-4626-bc17-81e7b5470ec9","Type":"ContainerDied","Data":"fc7abe44f99894e34781db24c8bd6f0832d35f5fed5d3c7063ffecf44819c039"}
Jul 01 17:21:21.870203 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.870057    2569 scope.go:117] "RemoveContainer" containerID="12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd"
Jul 01 17:21:21.879036 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.879017    2569 scope.go:117] "RemoveContainer" containerID="12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd"
Jul 01 17:21:21.879269 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:21:21.879249    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd\": container with ID starting with 12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd not found: ID does not exist" containerID="12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd"
Jul 01 17:21:21.879312 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.879279    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd"} err="failed to get container status \"12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd\": rpc error: code = NotFound desc = could not find container \"12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd\": container with ID starting with 12624581000d3e765650bdc937a16a021d46613555b35257554a29b17da68bdd not found: ID does not exist"
Jul 01 17:21:21.892805 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.892786    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"]
Jul 01 17:21:21.902577 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:21.902559    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-1f194-54bc64db78-46rl4"]
Jul 01 17:21:23.901375 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:23.901340    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" path="/var/lib/kubelet/pods/2e6ff716-5428-4626-bc17-81e7b5470ec9/volumes"
Jul 01 17:21:25.901332 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.901307    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"]
Jul 01 17:21:25.901710 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.901613    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43"
Jul 01 17:21:25.901710 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.901624    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43"
Jul 01 17:21:25.901710 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.901630    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194"
Jul 01 17:21:25.901710 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.901635    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194"
Jul 01 17:21:25.901710 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.901700    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e6ff716-5428-4626-bc17-81e7b5470ec9" containerName="sequence-graph-1f194"
Jul 01 17:21:25.901710 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.901710    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2c88393-d778-4166-aa58-f552479a37ba" containerName="ensemble-graph-52e43"
Jul 01 17:21:25.905906 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.905888    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:25.908796 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.908775    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-csvp5\""
Jul 01 17:21:25.908990 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.908968    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-bbcac-serving-cert\""
Jul 01 17:21:25.909249 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.909231    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-bbcac-kube-rbac-proxy-sar-config\""
Jul 01 17:21:25.909930 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.909902    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:21:25.910499 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:25.910476    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"]
Jul 01 17:21:26.003412 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.003380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9827710e-da00-4730-af3d-3bbe29d57231-openshift-service-ca-bundle\") pod \"ensemble-graph-bbcac-77d4868ccd-zlxf7\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") " pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.003412 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.003419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls\") pod \"ensemble-graph-bbcac-77d4868ccd-zlxf7\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") " pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.104181 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.104151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9827710e-da00-4730-af3d-3bbe29d57231-openshift-service-ca-bundle\") pod \"ensemble-graph-bbcac-77d4868ccd-zlxf7\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") " pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.104181 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.104186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls\") pod \"ensemble-graph-bbcac-77d4868ccd-zlxf7\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") " pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.104372 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:21:26.104313    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-bbcac-serving-cert: secret "ensemble-graph-bbcac-serving-cert" not found
Jul 01 17:21:26.104412 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:21:26.104375    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls podName:9827710e-da00-4730-af3d-3bbe29d57231 nodeName:}" failed. No retries permitted until 2026-07-01 17:21:26.604358388 +0000 UTC m=+1369.051279350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls") pod "ensemble-graph-bbcac-77d4868ccd-zlxf7" (UID: "9827710e-da00-4730-af3d-3bbe29d57231") : secret "ensemble-graph-bbcac-serving-cert" not found
Jul 01 17:21:26.104784 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.104763    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9827710e-da00-4730-af3d-3bbe29d57231-openshift-service-ca-bundle\") pod \"ensemble-graph-bbcac-77d4868ccd-zlxf7\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") " pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.609258 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.609223    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls\") pod \"ensemble-graph-bbcac-77d4868ccd-zlxf7\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") " pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.611776 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.611750    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls\") pod \"ensemble-graph-bbcac-77d4868ccd-zlxf7\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") " pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.817162 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.817124    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:26.953547 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:26.953496    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"]
Jul 01 17:21:26.956203 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:21:26.956175    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9827710e_da00_4730_af3d_3bbe29d57231.slice/crio-4cb5664bccd4be569929f45d9b7666b05eff0a30d8bceabfe0f32da1662929e3 WatchSource:0}: Error finding container 4cb5664bccd4be569929f45d9b7666b05eff0a30d8bceabfe0f32da1662929e3: Status 404 returned error can't find the container with id 4cb5664bccd4be569929f45d9b7666b05eff0a30d8bceabfe0f32da1662929e3
Jul 01 17:21:27.901219 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:27.901188    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" event={"ID":"9827710e-da00-4730-af3d-3bbe29d57231","Type":"ContainerStarted","Data":"d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136"}
Jul 01 17:21:27.901382 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:27.901238    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" event={"ID":"9827710e-da00-4730-af3d-3bbe29d57231","Type":"ContainerStarted","Data":"4cb5664bccd4be569929f45d9b7666b05eff0a30d8bceabfe0f32da1662929e3"}
Jul 01 17:21:27.916123 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:27.916070    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podStartSLOduration=2.916049963 podStartE2EDuration="2.916049963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:21:27.914806857 +0000 UTC m=+1370.361727836" watchObservedRunningTime="2026-07-01 17:21:27.916049963 +0000 UTC m=+1370.362970952"
Jul 01 17:21:28.903184 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:28.903157    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:34.919224 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:34.919197    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:21:51.693970 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.693932    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"]
Jul 01 17:21:51.698880 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.698857    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:51.701825 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.701806    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-6460c-kube-rbac-proxy-sar-config\""
Jul 01 17:21:51.701959 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.701810    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-6460c-serving-cert\""
Jul 01 17:21:51.707589 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.707564    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"]
Jul 01 17:21:51.804953 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.804925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls\") pod \"sequence-graph-6460c-7c977b8767-wcnvq\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") " pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:51.805105 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.804995    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3450c9cd-5280-457d-a637-cab3661fc1a6-openshift-service-ca-bundle\") pod \"sequence-graph-6460c-7c977b8767-wcnvq\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") " pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:51.905425 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.905392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls\") pod \"sequence-graph-6460c-7c977b8767-wcnvq\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") " pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:51.905591 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.905508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3450c9cd-5280-457d-a637-cab3661fc1a6-openshift-service-ca-bundle\") pod \"sequence-graph-6460c-7c977b8767-wcnvq\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") " pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:51.905591 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:21:51.905528    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-6460c-serving-cert: secret "sequence-graph-6460c-serving-cert" not found
Jul 01 17:21:51.905591 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:21:51.905580    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls podName:3450c9cd-5280-457d-a637-cab3661fc1a6 nodeName:}" failed. No retries permitted until 2026-07-01 17:21:52.405565884 +0000 UTC m=+1394.852486846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls") pod "sequence-graph-6460c-7c977b8767-wcnvq" (UID: "3450c9cd-5280-457d-a637-cab3661fc1a6") : secret "sequence-graph-6460c-serving-cert" not found
Jul 01 17:21:51.906098 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:51.906079    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3450c9cd-5280-457d-a637-cab3661fc1a6-openshift-service-ca-bundle\") pod \"sequence-graph-6460c-7c977b8767-wcnvq\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") " pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:52.409716 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:52.409681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls\") pod \"sequence-graph-6460c-7c977b8767-wcnvq\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") " pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:52.412206 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:52.412182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls\") pod \"sequence-graph-6460c-7c977b8767-wcnvq\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") " pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:52.609587 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:52.609553    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:52.741314 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:52.741249    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"]
Jul 01 17:21:52.743645 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:21:52.743612    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3450c9cd_5280_457d_a637_cab3661fc1a6.slice/crio-618e5058f694e0c38dd446b89853d455f855761eb8679a1669463bd6ac6781eb WatchSource:0}: Error finding container 618e5058f694e0c38dd446b89853d455f855761eb8679a1669463bd6ac6781eb: Status 404 returned error can't find the container with id 618e5058f694e0c38dd446b89853d455f855761eb8679a1669463bd6ac6781eb
Jul 01 17:21:53.008557 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:53.008438    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" event={"ID":"3450c9cd-5280-457d-a637-cab3661fc1a6","Type":"ContainerStarted","Data":"0c126066b923a3363d212b0b143b98b707c2bfd18e9d5a95c4710d5eec83d1a1"}
Jul 01 17:21:53.008557 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:53.008518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" event={"ID":"3450c9cd-5280-457d-a637-cab3661fc1a6","Type":"ContainerStarted","Data":"618e5058f694e0c38dd446b89853d455f855761eb8679a1669463bd6ac6781eb"}
Jul 01 17:21:53.008782 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:53.008589    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:21:53.026754 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:53.026706    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podStartSLOduration=2.026692148 podStartE2EDuration="2.026692148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:21:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:21:53.025220153 +0000 UTC m=+1395.472141140" watchObservedRunningTime="2026-07-01 17:21:53.026692148 +0000 UTC m=+1395.473613152"
Jul 01 17:21:59.018132 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:21:59.018095    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:23:37.964840 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:23:37.964732    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:23:37.968668 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:23:37.967194    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:28:37.992960 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:28:37.992856    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:28:37.998858 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:28:37.994711    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:29:40.449074 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:29:40.449037    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"]
Jul 01 17:29:40.449667 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:29:40.449270    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac" containerID="cri-o://d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136" gracePeriod=30
Jul 01 17:29:44.916851 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:29:44.916806    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:49.916469 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:29:49.916422    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:54.916705 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:29:54.916661    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:54.917120 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:29:54.916815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:29:59.916533 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:29:59.916438    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:04.916092 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:04.916053    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:06.251749 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:06.251715    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"]
Jul 01 17:30:06.252215 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:06.252007    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c" containerID="cri-o://0c126066b923a3363d212b0b143b98b707c2bfd18e9d5a95c4710d5eec83d1a1" gracePeriod=30
Jul 01 17:30:09.016501 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:09.016441    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:09.916962 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:09.916919    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:10.600872 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:10.600848    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:30:10.671230 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:10.671206    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls\") pod \"9827710e-da00-4730-af3d-3bbe29d57231\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") "
Jul 01 17:30:10.671335 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:10.671288    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9827710e-da00-4730-af3d-3bbe29d57231-openshift-service-ca-bundle\") pod \"9827710e-da00-4730-af3d-3bbe29d57231\" (UID: \"9827710e-da00-4730-af3d-3bbe29d57231\") "
Jul 01 17:30:10.671628 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:10.671604    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9827710e-da00-4730-af3d-3bbe29d57231-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9827710e-da00-4730-af3d-3bbe29d57231" (UID: "9827710e-da00-4730-af3d-3bbe29d57231"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:30:10.673299 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:10.673276    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9827710e-da00-4730-af3d-3bbe29d57231" (UID: "9827710e-da00-4730-af3d-3bbe29d57231"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:30:10.772154 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:10.772099    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9827710e-da00-4730-af3d-3bbe29d57231-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:30:10.772154 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:10.772119    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9827710e-da00-4730-af3d-3bbe29d57231-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:30:11.222070 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.222033    2569 generic.go:356] "Generic (PLEG): container finished" podID="9827710e-da00-4730-af3d-3bbe29d57231" containerID="d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136" exitCode=0
Jul 01 17:30:11.222236 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.222089    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"
Jul 01 17:30:11.222236 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.222116    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" event={"ID":"9827710e-da00-4730-af3d-3bbe29d57231","Type":"ContainerDied","Data":"d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136"}
Jul 01 17:30:11.222236 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.222164    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7" event={"ID":"9827710e-da00-4730-af3d-3bbe29d57231","Type":"ContainerDied","Data":"4cb5664bccd4be569929f45d9b7666b05eff0a30d8bceabfe0f32da1662929e3"}
Jul 01 17:30:11.222236 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.222189    2569 scope.go:117] "RemoveContainer" containerID="d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136"
Jul 01 17:30:11.231886 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.231862    2569 scope.go:117] "RemoveContainer" containerID="d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136"
Jul 01 17:30:11.232245 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:30:11.232220    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136\": container with ID starting with d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136 not found: ID does not exist" containerID="d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136"
Jul 01 17:30:11.232293 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.232255    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136"} err="failed to get container status \"d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136\": rpc error: code = NotFound desc = could not find container \"d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136\": container with ID starting with d95e5290f897b5e014c7eac8c8716e88339c5ccdd7d0e17180af56c8ba227136 not found: ID does not exist"
Jul 01 17:30:11.245980 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.245937    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"]
Jul 01 17:30:11.247426 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.247404    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-bbcac-77d4868ccd-zlxf7"]
Jul 01 17:30:11.902652 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:11.902606    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9827710e-da00-4730-af3d-3bbe29d57231" path="/var/lib/kubelet/pods/9827710e-da00-4730-af3d-3bbe29d57231/volumes"
Jul 01 17:30:14.016802 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:14.016753    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:19.017376 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:19.017338    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:19.017795 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:19.017495    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:30:24.017226 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:24.017187    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:29.017131 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:29.017097    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:34.016810 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:34.016771    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:36.332945 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:36.332919    2569 generic.go:356] "Generic (PLEG): container finished" podID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerID="0c126066b923a3363d212b0b143b98b707c2bfd18e9d5a95c4710d5eec83d1a1" exitCode=0
Jul 01 17:30:36.333212 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:36.332983    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" event={"ID":"3450c9cd-5280-457d-a637-cab3661fc1a6","Type":"ContainerDied","Data":"0c126066b923a3363d212b0b143b98b707c2bfd18e9d5a95c4710d5eec83d1a1"}
Jul 01 17:30:36.901674 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:36.901645    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:30:36.969284 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:36.969257    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3450c9cd-5280-457d-a637-cab3661fc1a6-openshift-service-ca-bundle\") pod \"3450c9cd-5280-457d-a637-cab3661fc1a6\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") "
Jul 01 17:30:36.969427 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:36.969297    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls\") pod \"3450c9cd-5280-457d-a637-cab3661fc1a6\" (UID: \"3450c9cd-5280-457d-a637-cab3661fc1a6\") "
Jul 01 17:30:36.969659 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:36.969633    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3450c9cd-5280-457d-a637-cab3661fc1a6-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3450c9cd-5280-457d-a637-cab3661fc1a6" (UID: "3450c9cd-5280-457d-a637-cab3661fc1a6"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:30:36.971365 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:36.971343    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3450c9cd-5280-457d-a637-cab3661fc1a6" (UID: "3450c9cd-5280-457d-a637-cab3661fc1a6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:30:37.070619 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.070565    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3450c9cd-5280-457d-a637-cab3661fc1a6-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:30:37.070619 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.070586    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3450c9cd-5280-457d-a637-cab3661fc1a6-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:30:37.339146 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.339124    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"
Jul 01 17:30:37.339582 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.339141    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq" event={"ID":"3450c9cd-5280-457d-a637-cab3661fc1a6","Type":"ContainerDied","Data":"618e5058f694e0c38dd446b89853d455f855761eb8679a1669463bd6ac6781eb"}
Jul 01 17:30:37.339582 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.339204    2569 scope.go:117] "RemoveContainer" containerID="0c126066b923a3363d212b0b143b98b707c2bfd18e9d5a95c4710d5eec83d1a1"
Jul 01 17:30:37.360329 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.360302    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"]
Jul 01 17:30:37.366248 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.366227    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6460c-7c977b8767-wcnvq"]
Jul 01 17:30:37.902294 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:37.902267    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" path="/var/lib/kubelet/pods/3450c9cd-5280-457d-a637-cab3661fc1a6/volumes"
Jul 01 17:30:50.708174 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.708101    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"]
Jul 01 17:30:50.708610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.708422    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c"
Jul 01 17:30:50.708610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.708435    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c"
Jul 01 17:30:50.708610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.708446    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac"
Jul 01 17:30:50.708610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.708451    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac"
Jul 01 17:30:50.708610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.708529    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3450c9cd-5280-457d-a637-cab3661fc1a6" containerName="sequence-graph-6460c"
Jul 01 17:30:50.708610 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.708539    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9827710e-da00-4730-af3d-3bbe29d57231" containerName="ensemble-graph-bbcac"
Jul 01 17:30:50.711516 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.711497    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:50.715233 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.715209    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-4517b-kube-rbac-proxy-sar-config\""
Jul 01 17:30:50.716133 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.716119    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-csvp5\""
Jul 01 17:30:50.716193 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.716175    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-4517b-serving-cert\""
Jul 01 17:30:50.716930 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.716913    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:30:50.724814 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.724794    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"]
Jul 01 17:30:50.775753 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.775716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1e5a4c-3139-4615-b8c1-6f1778839e95-openshift-service-ca-bundle\") pod \"splitter-graph-4517b-7b778f989-h6fmq\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") " pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:50.775871 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.775781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls\") pod \"splitter-graph-4517b-7b778f989-h6fmq\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") " pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:50.876954 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.876921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1e5a4c-3139-4615-b8c1-6f1778839e95-openshift-service-ca-bundle\") pod \"splitter-graph-4517b-7b778f989-h6fmq\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") " pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:50.877136 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.876978    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls\") pod \"splitter-graph-4517b-7b778f989-h6fmq\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") " pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:50.877136 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:30:50.877090    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-4517b-serving-cert: secret "splitter-graph-4517b-serving-cert" not found
Jul 01 17:30:50.877260 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:30:50.877153    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls podName:6e1e5a4c-3139-4615-b8c1-6f1778839e95 nodeName:}" failed. No retries permitted until 2026-07-01 17:30:51.377136513 +0000 UTC m=+1933.824057476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls") pod "splitter-graph-4517b-7b778f989-h6fmq" (UID: "6e1e5a4c-3139-4615-b8c1-6f1778839e95") : secret "splitter-graph-4517b-serving-cert" not found
Jul 01 17:30:50.877686 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:50.877662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1e5a4c-3139-4615-b8c1-6f1778839e95-openshift-service-ca-bundle\") pod \"splitter-graph-4517b-7b778f989-h6fmq\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") " pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:51.380999 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:51.380963    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls\") pod \"splitter-graph-4517b-7b778f989-h6fmq\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") " pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:51.383416 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:51.383390    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls\") pod \"splitter-graph-4517b-7b778f989-h6fmq\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") " pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:51.621978 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:51.621944    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:51.750750 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:51.750725    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"]
Jul 01 17:30:51.753239 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:30:51.753206    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1e5a4c_3139_4615_b8c1_6f1778839e95.slice/crio-746ad5dc1ab1ebe7102685d0ed7e2e04193b3cec4211f3a02edac2ae0951d8f5 WatchSource:0}: Error finding container 746ad5dc1ab1ebe7102685d0ed7e2e04193b3cec4211f3a02edac2ae0951d8f5: Status 404 returned error can't find the container with id 746ad5dc1ab1ebe7102685d0ed7e2e04193b3cec4211f3a02edac2ae0951d8f5
Jul 01 17:30:52.410638 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:52.410607    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" event={"ID":"6e1e5a4c-3139-4615-b8c1-6f1778839e95","Type":"ContainerStarted","Data":"343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2"}
Jul 01 17:30:52.410804 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:52.410658    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" event={"ID":"6e1e5a4c-3139-4615-b8c1-6f1778839e95","Type":"ContainerStarted","Data":"746ad5dc1ab1ebe7102685d0ed7e2e04193b3cec4211f3a02edac2ae0951d8f5"}
Jul 01 17:30:52.410804 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:52.410697    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:30:52.429006 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:52.428946    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podStartSLOduration=2.428929091 podStartE2EDuration="2.428929091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:30:52.428629318 +0000 UTC m=+1934.875550297" watchObservedRunningTime="2026-07-01 17:30:52.428929091 +0000 UTC m=+1934.875850076"
Jul 01 17:30:58.420184 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:30:58.420153    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:31:00.774568 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:00.774530    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"]
Jul 01 17:31:00.775009 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:00.774788    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b" containerID="cri-o://343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2" gracePeriod=30
Jul 01 17:31:03.419128 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:03.419078    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:06.481243 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.481208    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"]
Jul 01 17:31:06.485009 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.484988    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.487567 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.487538    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-db836-kube-rbac-proxy-sar-config\""
Jul 01 17:31:06.487685 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.487605    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-db836-serving-cert\""
Jul 01 17:31:06.500150 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.500129    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"]
Jul 01 17:31:06.608052 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.608014    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8ea489-c354-493a-ae8c-c376ed1547be-openshift-service-ca-bundle\") pod \"switch-graph-db836-5758686fdc-568g5\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") " pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.608202 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.608091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7e8ea489-c354-493a-ae8c-c376ed1547be-proxy-tls\") pod \"switch-graph-db836-5758686fdc-568g5\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") " pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.709304 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.709276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8ea489-c354-493a-ae8c-c376ed1547be-openshift-service-ca-bundle\") pod \"switch-graph-db836-5758686fdc-568g5\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") " pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.709436 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.709320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7e8ea489-c354-493a-ae8c-c376ed1547be-proxy-tls\") pod \"switch-graph-db836-5758686fdc-568g5\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") " pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.709903 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.709883    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8ea489-c354-493a-ae8c-c376ed1547be-openshift-service-ca-bundle\") pod \"switch-graph-db836-5758686fdc-568g5\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") " pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.711822 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.711802    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7e8ea489-c354-493a-ae8c-c376ed1547be-proxy-tls\") pod \"switch-graph-db836-5758686fdc-568g5\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") " pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.795206 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.795136    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:06.926291 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:06.926269    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"]
Jul 01 17:31:06.928519 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:31:06.928492    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8ea489_c354_493a_ae8c_c376ed1547be.slice/crio-d5f91f1873a56aab66baf712dec3e5a59c5d34ca5eb405b5e0c5b1a69c0a9951 WatchSource:0}: Error finding container d5f91f1873a56aab66baf712dec3e5a59c5d34ca5eb405b5e0c5b1a69c0a9951: Status 404 returned error can't find the container with id d5f91f1873a56aab66baf712dec3e5a59c5d34ca5eb405b5e0c5b1a69c0a9951
Jul 01 17:31:07.484105 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:07.484070    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" event={"ID":"7e8ea489-c354-493a-ae8c-c376ed1547be","Type":"ContainerStarted","Data":"f2c700b5553786e0613cc355befabf8b069b1453cf3beb00f548c9760dd51321"}
Jul 01 17:31:07.484530 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:07.484120    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" event={"ID":"7e8ea489-c354-493a-ae8c-c376ed1547be","Type":"ContainerStarted","Data":"d5f91f1873a56aab66baf712dec3e5a59c5d34ca5eb405b5e0c5b1a69c0a9951"}
Jul 01 17:31:07.484530 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:07.484162    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:07.501788 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:07.501722    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podStartSLOduration=1.50170572 podStartE2EDuration="1.50170572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:31:07.500492725 +0000 UTC m=+1949.947413710" watchObservedRunningTime="2026-07-01 17:31:07.50170572 +0000 UTC m=+1949.948626705"
Jul 01 17:31:08.418829 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:08.418792    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:13.419103 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:13.419060    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:13.419512 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:13.419168    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:31:13.494080 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:13.494057    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:31:18.418872 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:18.418834    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:23.419427 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:23.419379    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:28.419347 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:28.419259    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:30.918864 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:30.918842    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:31:30.994867 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:30.994836    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls\") pod \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") "
Jul 01 17:31:30.995057 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:30.994881    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1e5a4c-3139-4615-b8c1-6f1778839e95-openshift-service-ca-bundle\") pod \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\" (UID: \"6e1e5a4c-3139-4615-b8c1-6f1778839e95\") "
Jul 01 17:31:30.995236 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:30.995211    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1e5a4c-3139-4615-b8c1-6f1778839e95-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6e1e5a4c-3139-4615-b8c1-6f1778839e95" (UID: "6e1e5a4c-3139-4615-b8c1-6f1778839e95"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:31:31.002497 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.002475    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6e1e5a4c-3139-4615-b8c1-6f1778839e95" (UID: "6e1e5a4c-3139-4615-b8c1-6f1778839e95"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:31:31.096100 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.096078    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e1e5a4c-3139-4615-b8c1-6f1778839e95-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:31:31.096100 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.096099    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1e5a4c-3139-4615-b8c1-6f1778839e95-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:31:31.600484 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.600427    2569 generic.go:356] "Generic (PLEG): container finished" podID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerID="343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2" exitCode=0
Jul 01 17:31:31.600644 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.600495    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"
Jul 01 17:31:31.600644 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.600523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" event={"ID":"6e1e5a4c-3139-4615-b8c1-6f1778839e95","Type":"ContainerDied","Data":"343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2"}
Jul 01 17:31:31.600644 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.600586    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq" event={"ID":"6e1e5a4c-3139-4615-b8c1-6f1778839e95","Type":"ContainerDied","Data":"746ad5dc1ab1ebe7102685d0ed7e2e04193b3cec4211f3a02edac2ae0951d8f5"}
Jul 01 17:31:31.600644 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.600618    2569 scope.go:117] "RemoveContainer" containerID="343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2"
Jul 01 17:31:31.610272 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.610254    2569 scope.go:117] "RemoveContainer" containerID="343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2"
Jul 01 17:31:31.610594 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:31:31.610573    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2\": container with ID starting with 343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2 not found: ID does not exist" containerID="343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2"
Jul 01 17:31:31.610679 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.610608    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2"} err="failed to get container status \"343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2\": rpc error: code = NotFound desc = could not find container \"343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2\": container with ID starting with 343be37576991d49e667f3e721f54fad1d9e74fff66f8afcead2433a1ff5bef2 not found: ID does not exist"
Jul 01 17:31:31.622090 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.622063    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"]
Jul 01 17:31:31.625904 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.625881    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4517b-7b778f989-h6fmq"]
Jul 01 17:31:31.902253 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:31:31.902185    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" path="/var/lib/kubelet/pods/6e1e5a4c-3139-4615-b8c1-6f1778839e95/volumes"
Jul 01 17:32:01.004781 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.004744    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"]
Jul 01 17:32:01.005217 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.005064    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b"
Jul 01 17:32:01.005217 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.005074    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b"
Jul 01 17:32:01.005217 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.005137    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1e5a4c-3139-4615-b8c1-6f1778839e95" containerName="splitter-graph-4517b"
Jul 01 17:32:01.008002 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.007985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.010451 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.010430    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-bbf0f-serving-cert\""
Jul 01 17:32:01.010716 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.010700    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-bbf0f-kube-rbac-proxy-sar-config\""
Jul 01 17:32:01.018919 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.018897    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"]
Jul 01 17:32:01.123818 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.123782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc3420c9-9f51-498d-b2db-a47e62ce39d2-proxy-tls\") pod \"splitter-graph-bbf0f-c98544745-zdsfs\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") " pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.123978 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.123850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3420c9-9f51-498d-b2db-a47e62ce39d2-openshift-service-ca-bundle\") pod \"splitter-graph-bbf0f-c98544745-zdsfs\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") " pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.224758 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.224724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc3420c9-9f51-498d-b2db-a47e62ce39d2-proxy-tls\") pod \"splitter-graph-bbf0f-c98544745-zdsfs\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") " pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.224881 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.224793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3420c9-9f51-498d-b2db-a47e62ce39d2-openshift-service-ca-bundle\") pod \"splitter-graph-bbf0f-c98544745-zdsfs\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") " pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.225367 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.225346    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3420c9-9f51-498d-b2db-a47e62ce39d2-openshift-service-ca-bundle\") pod \"splitter-graph-bbf0f-c98544745-zdsfs\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") " pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.227229 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.227200    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc3420c9-9f51-498d-b2db-a47e62ce39d2-proxy-tls\") pod \"splitter-graph-bbf0f-c98544745-zdsfs\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") " pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.319240 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.319181    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.448384 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.448287    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"]
Jul 01 17:32:01.450625 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:32:01.450594    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3420c9_9f51_498d_b2db_a47e62ce39d2.slice/crio-300b452a8cff43b48ff4fcf81d6555b2b9e8de2d0944212f5c7a45bdbf71ac5e WatchSource:0}: Error finding container 300b452a8cff43b48ff4fcf81d6555b2b9e8de2d0944212f5c7a45bdbf71ac5e: Status 404 returned error can't find the container with id 300b452a8cff43b48ff4fcf81d6555b2b9e8de2d0944212f5c7a45bdbf71ac5e
Jul 01 17:32:01.744056 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.744017    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" event={"ID":"dc3420c9-9f51-498d-b2db-a47e62ce39d2","Type":"ContainerStarted","Data":"c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b"}
Jul 01 17:32:01.744227 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.744072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" event={"ID":"dc3420c9-9f51-498d-b2db-a47e62ce39d2","Type":"ContainerStarted","Data":"300b452a8cff43b48ff4fcf81d6555b2b9e8de2d0944212f5c7a45bdbf71ac5e"}
Jul 01 17:32:01.744227 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.744099    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:32:01.760008 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:01.759962    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podStartSLOduration=1.759947747 podStartE2EDuration="1.759947747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:32:01.758644236 +0000 UTC m=+2004.205565219" watchObservedRunningTime="2026-07-01 17:32:01.759947747 +0000 UTC m=+2004.206868750"
Jul 01 17:32:07.754347 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:32:07.754312    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:33:38.020209 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:33:38.020088    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:33:38.024260 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:33:38.023555    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:38:38.045599 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:38:38.045499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:38:38.050320 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:38:38.050303    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:40:15.672494 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:15.672428    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"]
Jul 01 17:40:15.672972 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:15.672679    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f" containerID="cri-o://c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b" gracePeriod=30
Jul 01 17:40:17.752752 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:17.752711    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:40:22.752023 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:22.751982    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:40:27.751962 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:27.751918    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:40:27.752377 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:27.752045    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:40:32.752803 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:32.752705    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:40:37.752517 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:37.752472    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:40:42.751799 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:42.751758    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:40:45.822440 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:45.822417    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:40:45.891523 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:45.891495    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3420c9-9f51-498d-b2db-a47e62ce39d2-openshift-service-ca-bundle\") pod \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") "
Jul 01 17:40:45.891683 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:45.891534    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc3420c9-9f51-498d-b2db-a47e62ce39d2-proxy-tls\") pod \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\" (UID: \"dc3420c9-9f51-498d-b2db-a47e62ce39d2\") "
Jul 01 17:40:45.891828 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:45.891808    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3420c9-9f51-498d-b2db-a47e62ce39d2-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "dc3420c9-9f51-498d-b2db-a47e62ce39d2" (UID: "dc3420c9-9f51-498d-b2db-a47e62ce39d2"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:40:45.893569 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:45.893545    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc3420c9-9f51-498d-b2db-a47e62ce39d2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "dc3420c9-9f51-498d-b2db-a47e62ce39d2" (UID: "dc3420c9-9f51-498d-b2db-a47e62ce39d2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:40:45.992607 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:45.992547    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3420c9-9f51-498d-b2db-a47e62ce39d2-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:40:45.992607 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:45.992571    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc3420c9-9f51-498d-b2db-a47e62ce39d2-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:40:46.102449 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.102419    2569 generic.go:356] "Generic (PLEG): container finished" podID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerID="c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b" exitCode=0
Jul 01 17:40:46.102592 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.102487    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"
Jul 01 17:40:46.102592 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.102518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" event={"ID":"dc3420c9-9f51-498d-b2db-a47e62ce39d2","Type":"ContainerDied","Data":"c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b"}
Jul 01 17:40:46.102592 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.102585    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs" event={"ID":"dc3420c9-9f51-498d-b2db-a47e62ce39d2","Type":"ContainerDied","Data":"300b452a8cff43b48ff4fcf81d6555b2b9e8de2d0944212f5c7a45bdbf71ac5e"}
Jul 01 17:40:46.102758 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.102618    2569 scope.go:117] "RemoveContainer" containerID="c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b"
Jul 01 17:40:46.111680 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.111661    2569 scope.go:117] "RemoveContainer" containerID="c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b"
Jul 01 17:40:46.111993 ip-10-0-138-165 kubenswrapper[2569]: E0701 17:40:46.111971    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b\": container with ID starting with c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b not found: ID does not exist" containerID="c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b"
Jul 01 17:40:46.112055 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.112002    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b"} err="failed to get container status \"c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b\": rpc error: code = NotFound desc = could not find container \"c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b\": container with ID starting with c62c074f65212127b64f8fc00a9728d4e5dff7038b87c68134d4fc794bb48b4b not found: ID does not exist"
Jul 01 17:40:46.129976 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.129942    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"]
Jul 01 17:40:46.137268 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:46.137248    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bbf0f-c98544745-zdsfs"]
Jul 01 17:40:47.902187 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:40:47.902152    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" path="/var/lib/kubelet/pods/dc3420c9-9f51-498d-b2db-a47e62ce39d2/volumes"
Jul 01 17:43:38.072854 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:43:38.072831    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:43:38.079855 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:43:38.079835    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkt6f_190a2135-e2dc-461b-83e9-c2e2d8bff5fd/ovn-acl-logging/0.log"
Jul 01 17:47:25.788919 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:25.788888    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"]
Jul 01 17:47:25.789539 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:25.789168    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836" containerID="cri-o://f2c700b5553786e0613cc355befabf8b069b1453cf3beb00f548c9760dd51321" gracePeriod=30
Jul 01 17:47:28.493496 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:28.493435    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:47:33.492571 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:33.492531    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:47:38.492980 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:38.492944    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:47:38.493395 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:38.493054    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:47:42.621168 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:42.621138    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:43.446107 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:43.446080    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:43.492432 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:43.492402    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:47:44.278447 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:44.278389    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:45.092908 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:45.092873    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:45.949596 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:45.949557    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:46.899826 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:46.899790    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:47.936970 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:47.936928    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:48.492822 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:48.492773    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:47:48.831614 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:48.831581    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:49.708665 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:49.708637    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:50.511181 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:50.511147    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:51.286718 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:51.286689    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:52.118498 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:52.118448    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:52.950126 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:52.950096    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:53.493528 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:53.493489    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:47:53.774768 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:53.774682    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-db836-5758686fdc-568g5_7e8ea489-c354-493a-ae8c-c376ed1547be/switch-graph-db836/0.log"
Jul 01 17:47:56.046385 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.046317    2569 generic.go:356] "Generic (PLEG): container finished" podID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerID="f2c700b5553786e0613cc355befabf8b069b1453cf3beb00f548c9760dd51321" exitCode=0
Jul 01 17:47:56.046385 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.046359    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" event={"ID":"7e8ea489-c354-493a-ae8c-c376ed1547be","Type":"ContainerDied","Data":"f2c700b5553786e0613cc355befabf8b069b1453cf3beb00f548c9760dd51321"}
Jul 01 17:47:56.436704 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.436679    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:47:56.510420 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.510384    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7e8ea489-c354-493a-ae8c-c376ed1547be-proxy-tls\") pod \"7e8ea489-c354-493a-ae8c-c376ed1547be\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") "
Jul 01 17:47:56.510571 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.510439    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8ea489-c354-493a-ae8c-c376ed1547be-openshift-service-ca-bundle\") pod \"7e8ea489-c354-493a-ae8c-c376ed1547be\" (UID: \"7e8ea489-c354-493a-ae8c-c376ed1547be\") "
Jul 01 17:47:56.510822 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.510797    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8ea489-c354-493a-ae8c-c376ed1547be-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7e8ea489-c354-493a-ae8c-c376ed1547be" (UID: "7e8ea489-c354-493a-ae8c-c376ed1547be"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:47:56.512496 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.512477    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8ea489-c354-493a-ae8c-c376ed1547be-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7e8ea489-c354-493a-ae8c-c376ed1547be" (UID: "7e8ea489-c354-493a-ae8c-c376ed1547be"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:47:56.611532 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.611501    2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7e8ea489-c354-493a-ae8c-c376ed1547be-proxy-tls\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:47:56.611532 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:56.611531    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8ea489-c354-493a-ae8c-c376ed1547be-openshift-service-ca-bundle\") on node \"ip-10-0-138-165.ec2.internal\" DevicePath \"\""
Jul 01 17:47:57.052882 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:57.052802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5" event={"ID":"7e8ea489-c354-493a-ae8c-c376ed1547be","Type":"ContainerDied","Data":"d5f91f1873a56aab66baf712dec3e5a59c5d34ca5eb405b5e0c5b1a69c0a9951"}
Jul 01 17:47:57.053300 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:57.052814    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"
Jul 01 17:47:57.053588 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:57.052860    2569 scope.go:117] "RemoveContainer" containerID="f2c700b5553786e0613cc355befabf8b069b1453cf3beb00f548c9760dd51321"
Jul 01 17:47:57.080099 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:57.080075    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"]
Jul 01 17:47:57.086016 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:57.085993    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-db836-5758686fdc-568g5"]
Jul 01 17:47:57.908586 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:47:57.908554    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" path="/var/lib/kubelet/pods/7e8ea489-c354-493a-ae8c-c376ed1547be/volumes"
Jul 01 17:48:02.020430 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:02.020338    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wvdhd_802e4941-e3f7-4467-beca-9a569b62ca6a/global-pull-secret-syncer/0.log"
Jul 01 17:48:02.162523 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:02.162499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k42dq_319af92a-d5fc-4fb5-81a6-4d9139adae04/konnectivity-agent/0.log"
Jul 01 17:48:02.415794 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:02.415768    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-165.ec2.internal_74de3413fa164734c8b5ebbbbf272e87/haproxy/0.log"
Jul 01 17:48:07.021270 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.021239    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-g9cwq_6f848807-dc14-4528-81ab-3f5f000c0ac2/cluster-monitoring-operator/0.log"
Jul 01 17:48:07.047684 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.047664    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-2qpvl_3fee4958-e063-459a-a9ea-177f2ac1434f/kube-state-metrics/0.log"
Jul 01 17:48:07.068691 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.068665    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-2qpvl_3fee4958-e063-459a-a9ea-177f2ac1434f/kube-rbac-proxy-main/0.log"
Jul 01 17:48:07.102169 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.102151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-2qpvl_3fee4958-e063-459a-a9ea-177f2ac1434f/kube-rbac-proxy-self/0.log"
Jul 01 17:48:07.300063 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.299987    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6pqs_a3c8b9c4-79c6-4895-9d02-6f36015ef5f6/node-exporter/0.log"
Jul 01 17:48:07.323839 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.323812    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6pqs_a3c8b9c4-79c6-4895-9d02-6f36015ef5f6/kube-rbac-proxy/0.log"
Jul 01 17:48:07.348451 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.348430    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6pqs_a3c8b9c4-79c6-4895-9d02-6f36015ef5f6/init-textfile/0.log"
Jul 01 17:48:07.874386 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:07.874356    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-6sr4z_66d6b2ec-a2a3-465a-9faf-fdeec8935c31/prometheus-operator-admission-webhook/0.log"
Jul 01 17:48:08.056855 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:08.056821    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fb4fc8d4f-4xxqr_d0c463a1-aa9b-4458-8d3e-8b5dea116845/thanos-query/0.log"
Jul 01 17:48:08.096057 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:08.096031    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fb4fc8d4f-4xxqr_d0c463a1-aa9b-4458-8d3e-8b5dea116845/kube-rbac-proxy-web/0.log"
Jul 01 17:48:08.146985 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:08.146931    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fb4fc8d4f-4xxqr_d0c463a1-aa9b-4458-8d3e-8b5dea116845/kube-rbac-proxy/0.log"
Jul 01 17:48:08.193506 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:08.193478    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fb4fc8d4f-4xxqr_d0c463a1-aa9b-4458-8d3e-8b5dea116845/prom-label-proxy/0.log"
Jul 01 17:48:08.225004 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:08.224977    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fb4fc8d4f-4xxqr_d0c463a1-aa9b-4458-8d3e-8b5dea116845/kube-rbac-proxy-rules/0.log"
Jul 01 17:48:08.272560 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:08.272538    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fb4fc8d4f-4xxqr_d0c463a1-aa9b-4458-8d3e-8b5dea116845/kube-rbac-proxy-metrics/0.log"
Jul 01 17:48:09.718179 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.718144    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"]
Jul 01 17:48:09.718570 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.718519    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836"
Jul 01 17:48:09.718570 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.718532    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836"
Jul 01 17:48:09.718570 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.718543    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f"
Jul 01 17:48:09.718570 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.718548    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f"
Jul 01 17:48:09.718705 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.718613    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3420c9-9f51-498d-b2db-a47e62ce39d2" containerName="splitter-graph-bbf0f"
Jul 01 17:48:09.718705 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.718621    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e8ea489-c354-493a-ae8c-c376ed1547be" containerName="switch-graph-db836"
Jul 01 17:48:09.723163 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.723145    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.733918 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.733900    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-76kqn\"/\"kube-root-ca.crt\""
Jul 01 17:48:09.734628 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.734613    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-76kqn\"/\"default-dockercfg-rgc45\""
Jul 01 17:48:09.734679 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.734649    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-76kqn\"/\"openshift-service-ca.crt\""
Jul 01 17:48:09.745789 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.745759    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"]
Jul 01 17:48:09.805236 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.805208    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-sys\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.805360 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.805240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-proc\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.805360 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.805271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-lib-modules\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.805360 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.805309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw999\" (UniqueName: \"kubernetes.io/projected/b1adc041-0055-43d9-b29e-ace5db22543b-kube-api-access-cw999\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.805484 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.805391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-podres\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906631 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906610    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-lib-modules\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906736 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw999\" (UniqueName: \"kubernetes.io/projected/b1adc041-0055-43d9-b29e-ace5db22543b-kube-api-access-cw999\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906736 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-podres\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906736 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-sys\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906736 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906728    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-proc\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906911 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906779    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-lib-modules\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906911 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906802    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-proc\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906911 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906829    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-sys\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.906911 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.906848    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1adc041-0055-43d9-b29e-ace5db22543b-podres\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:09.922028 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:09.922006    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw999\" (UniqueName: \"kubernetes.io/projected/b1adc041-0055-43d9-b29e-ace5db22543b-kube-api-access-cw999\") pod \"perf-node-gather-daemonset-7phqn\" (UID: \"b1adc041-0055-43d9-b29e-ace5db22543b\") " pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:10.033306 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:10.033241    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:10.170590 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:10.170566    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"]
Jul 01 17:48:10.172601 ip-10-0-138-165 kubenswrapper[2569]: W0701 17:48:10.172574    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb1adc041_0055_43d9_b29e_ace5db22543b.slice/crio-4dc9ed811bf664e56ae9207ad251ea262623c9d56bb7d0fd4ec88944f1ff632c WatchSource:0}: Error finding container 4dc9ed811bf664e56ae9207ad251ea262623c9d56bb7d0fd4ec88944f1ff632c: Status 404 returned error can't find the container with id 4dc9ed811bf664e56ae9207ad251ea262623c9d56bb7d0fd4ec88944f1ff632c
Jul 01 17:48:10.544338 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:10.544315    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cdf5994cb-2f7m2_ed7d3bea-6f2e-4652-b5d2-ea80a66bb097/console/0.log"
Jul 01 17:48:10.588923 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:10.588893    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-kz2r6_4501a87c-0e31-4410-a241-5d4693658ffa/download-server/0.log"
Jul 01 17:48:11.117819 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:11.117786    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn" event={"ID":"b1adc041-0055-43d9-b29e-ace5db22543b","Type":"ContainerStarted","Data":"1e9df8aed107f7309b9d4bf3b3492c01e05719fe523e4b662f2cccad38f51d49"}
Jul 01 17:48:11.118220 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:11.117831    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn" event={"ID":"b1adc041-0055-43d9-b29e-ace5db22543b","Type":"ContainerStarted","Data":"4dc9ed811bf664e56ae9207ad251ea262623c9d56bb7d0fd4ec88944f1ff632c"}
Jul 01 17:48:11.118220 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:11.117889    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:11.137281 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:11.137238    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn" podStartSLOduration=2.137223877 podStartE2EDuration="2.137223877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:48:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:11.13555205 +0000 UTC m=+2973.582473037" watchObservedRunningTime="2026-07-01 17:48:11.137223877 +0000 UTC m=+2973.584144861"
Jul 01 17:48:12.138955 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:12.138923    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h66qg_e7f5afc9-5418-490a-9c51-cfb05c4f3c09/dns/0.log"
Jul 01 17:48:12.162856 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:12.162833    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h66qg_e7f5afc9-5418-490a-9c51-cfb05c4f3c09/kube-rbac-proxy/0.log"
Jul 01 17:48:12.304655 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:12.304632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r7qkz_c145cde9-97cf-4583-9d5d-07bfd26e46ac/dns-node-resolver/0.log"
Jul 01 17:48:12.951738 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:12.951706    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rkdsj_7449b2b4-18f4-4ef6-b2e8-65ec79091d93/node-ca/0.log"
Jul 01 17:48:13.756443 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:13.756414    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-587cf9f4d5-p6b7c_0ca11c81-9695-4c5b-a62a-ad5f64b4e96f/router/0.log"
Jul 01 17:48:14.100790 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:14.100764    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56svg_cd661844-e21f-443c-ac88-f8632cd4e46e/serve-healthcheck-canary/0.log"
Jul 01 17:48:14.969622 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:14.969591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w72lj_bb9b943f-e169-4639-bf76-57a77cbb93de/kube-rbac-proxy/0.log"
Jul 01 17:48:14.998734 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:14.998706    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w72lj_bb9b943f-e169-4639-bf76-57a77cbb93de/exporter/0.log"
Jul 01 17:48:15.032730 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:15.032702    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w72lj_bb9b943f-e169-4639-bf76-57a77cbb93de/extractor/0.log"
Jul 01 17:48:17.133877 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:17.133846    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-76kqn/perf-node-gather-daemonset-7phqn"
Jul 01 17:48:17.223437 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:17.223407    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-84f4454459-sj5ld_c84c4c43-89df-4087-9ff0-29cb4d2ab3d6/manager/0.log"
Jul 01 17:48:17.318118 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:17.318094    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-5l5jz_5b3e1155-b23c-4bd1-87f9-4515734bd26f/manager/0.log"
Jul 01 17:48:17.823507 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:17.823479    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-n6kzn_8317ae2d-0d4f-49b8-9e1f-2368498a793c/seaweedfs/0.log"
Jul 01 17:48:24.341084 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:24.341043    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-2zj2s_07713b9d-a31e-4f52-944e-daf359a2c946/kube-storage-version-migrator-operator/1.log"
Jul 01 17:48:24.342900 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:24.342865    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-2zj2s_07713b9d-a31e-4f52-944e-daf359a2c946/kube-storage-version-migrator-operator/0.log"
Jul 01 17:48:25.796073 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:25.796044    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tsg5_56491b52-96d9-46ed-8cf2-7011c9e244df/kube-multus-additional-cni-plugins/0.log"
Jul 01 17:48:25.827766 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:25.827736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tsg5_56491b52-96d9-46ed-8cf2-7011c9e244df/egress-router-binary-copy/0.log"
Jul 01 17:48:25.866758 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:25.866739    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tsg5_56491b52-96d9-46ed-8cf2-7011c9e244df/cni-plugins/0.log"
Jul 01 17:48:25.916263 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:25.916245    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tsg5_56491b52-96d9-46ed-8cf2-7011c9e244df/bond-cni-plugin/0.log"
Jul 01 17:48:25.951217 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:25.951192    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tsg5_56491b52-96d9-46ed-8cf2-7011c9e244df/routeoverride-cni/0.log"
Jul 01 17:48:26.023868 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:26.023845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tsg5_56491b52-96d9-46ed-8cf2-7011c9e244df/whereabouts-cni-bincopy/0.log"
Jul 01 17:48:26.084943 ip-10-0-138-165 kubenswrapper[2569]: I0701 17:48:26.084920    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tsg5_56491b52-96d9-46ed-8cf2-7011c9e244df/whereabouts-cni/0.log"